🚀 AnythingLLM v1.5.4 is out. Update now →
Features
Language Models
AnythingLLM Large Language Models

Large Language Models

AnythingLLM allows you to use a host of LLM providers for chatting and generative AI.

Depending on your selection additional configuration might be required.

Supported Language Model Providers

Local Language Model Providers

AnythingLLM Built-in (default)Built-in (default)→OllamaOllama→LM StudioLM Studio→Local AILocal AI→

Cloud Language Model Providers

OpenAIOpenAI→Azure OpenAIAzure OpenAI→AnthropicAnthropic→CohereCohere→Google Gemini ProGoogle Gemini Pro→Hugging FaceHugging Face→Together AITogether AI→OpenRouterOpenRouter→Perplexity AIPerplexity AI→Mistral APIMistral API→GroqGroq→KobaldCPPKobaldCPP→OpenAI (generic)OpenAI (generic)→
Embedding ModelsTranscription Models