AnythingLLM Setup
LLM Setup
Mistral AI
Mistral AI LLM

Mistral AI LLM

Mistral AI (opens in a new tab) is the creator of the popular, uncensored, open-source Mistral-7B model.

They provide an API for a simple interface that you can use for chatting.

Connecting to Mistral AI


Valid API Key required!

You must obtain a valid API key from (opens in a new tab) for this integration to work.



The API-based model is subject to censoring of sensitive topics, the open-source model is uncensored.

To use the full model - use a local LLM provider like LocalAI, LMStudio, or Ollama

Like other LLM providers, the Chat Model Selection dropdown will automatically populate when your API key is entered.

All Mistral models are currently available for use with AnythingLLM.

You can update your model to a different model at any time in the Settings.

Mistral LLM settings