Together.ai Example

Together.ai makes it easy to run or fine-tune leading open source models.

Preparation

Register a Together.ai account to get your API key (they give you $25 to get started).

Configuration

We're using the mistralai/Mixtral-8x7B-Instruct-v0.1 model in this example.

You can find all the available models from Together.ai website: https://docs.together.ai/docs/inference-models