AnythingLLM Setup
LLM Setup
Together AI
Together AI LLM

Together AI LLM

Together AI (opens in a new tab) is an online service that provides API access to hundreds of various open-source models without having to spin up any infrastructure yourself.

Connecting to Together AI


Valid API Key required!

You must obtain a valid API key from (opens in a new tab) for this integration to work.

Like other LLM providers, the Chat Model Selection dropdown will automatically populate when your API key is entered.

All Together AI models are currently available for use with AnythingLLM. View the full list of models supported. (opens in a new tab)

You can update your model to a different model at any time in the Settings.

Together AI LLM settings