Large Language Models
️💡
Tip: Models that are multi-modal (text-to-text & image-to-text) are supported for System & Workspace models.
AnythingLLM allows you to use a host of LLM providers for chatting and generative AI.
Depending on your selection additional configuration might be required.
Supported Language Model Providers
Local Language Model Providers
Cloud Language Model Providers
OpenAIAzure OpenAIAWS BedrockAnthropicCohereCerebrasGoogle GeminiHugging FaceTogether AIFireworks AIOpenRouterPerplexity AIMistralGroqLiteLLMDeepSeekAPIPieNovita AIxAINVIDIA NIMPPIODell Pro AI StudioMoonshot AIComet APIFoundryzAIGitee AISambaNovaMinimaxOpenAI (generic)
Specialized Providers
The model router is not a provider, but it is a feature that allows you to route your sessions to different LLM providers and models based on rules you define within a chat without having to change the model manually.