Ollama

Ollama allows you to run open-source large language models, such as Llama 3, locally.

​

Preparation

Install Ollama and download models.

​

Configuration

We’re using the gemma2 model in this example.

API Key is required but ignored, so you can input any string.