Ollama Example

Ollama allows you to run open-source large language models, such as Llama 3, locally.

Preparation

Install Ollama and download models.

Configuration

We're using the gemma2 model in this example.

API Key is required but ignored, so you can input any string.