Quickstart

Prerequisites

For this Quickstart, we'll install on a laptop-hosted Kubernetes using kind.

For more install options, see the Installation Guide.

Docker Desktop, Rancher Desktop, or Podman (16GB RAM, 6 cores recommended)
Kind
(optional) Ollama for local LLM inference.
- Alternatively, use OpenAI or a cloud-hosted LLM.

Clone the repository:

git clone https://github.com/rossoctl/rossoctl.git
cd rossoctl

Check out the latest stable release (recommended). Find the current version at https://github.com/rossoctl/rossoctl/releases/latest.

git checkout v0.7.0-alpha.6

Copy and configure secrets (optional). Edit deployments/envs/.secret_values.yaml with your values.

cp deployments/envs/secret_values.yaml.example deployments/envs/.secret_values.yaml

Deploy to kind self-hosted Kubernetes cluster:

scripts/kind/setup-rossoctl.sh --with-ui --with-spire --with-agent-sandbox --with-builds

Show service URLs and credentials:

.github/scripts/local-setup/show-services.sh

Open the dashboard and log in with the credentials from the show-services.sh output:

open http://rossoctl-ui.localtest.me:8080

note

You may skip this step and see Cloud Models if you are using a cloud-hosted LLM.

Install Ollama: https://ollama.com/download
Pull a model:
```
ollama pull llama3.2:3b-instruct-fp16
```
Start Ollama (listening on all interfaces):
```
OLLAMA_HOST=0.0.0.0 ollama serve
```