Skip to main content

Ollama

Configure Ollama when LIGHTFLARE_LLM_PROVIDER is set to ollama.

Required Properties

VariableDescription
LIGHTFLARE_LLM_PROVIDERSet to ollama.
LIGHTFLARE_LLM_OLLAMA_ENABLEDSet to true.
LIGHTFLARE_LLM_OLLAMA_MODELOllama model name used for generation.

Optional Properties

VariableDefaultDescription
LIGHTFLARE_LLM_OLLAMA_BASE_URLhttp://127.0.0.1:11434Ollama base URL.
LIGHTFLARE_LLM_OLLAMA_API_KEYemptyOptional bearer token for remote or proxied Ollama APIs.
LIGHTFLARE_LLM_OLLAMA_EMBEDDING_MODELsame as LIGHTFLARE_LLM_OLLAMA_MODELOllama model used for embeddings.
LIGHTFLARE_LLM_OLLAMA_EMBEDDING_DIMENSIONS1536Embedding vector dimensions.