AnythingLLM Setup
LLM Setup
OpenAI (generic)
OpenAI (Generic) LLM

OpenAI (Generic) LLM



This is a developer-focused llm provider - you should not use it unless you know what you are doing.

The Generic OpenAI wrapper is an easy way to interact with any LLM provider that we do not explicitly integrate with and is OpenAi-compatible in both API functionality and inference response.

You should only use this provider if you know the LLM provider you wish it interact with is OpenAI compatible and you understand what each input is for.

Connecting to OpenAI (Generic)


Use with Caution

Generic OpenAI is a highly configurable and as such may not function as intended if you input any configuration setting incorrectly.

You can update your configuration at any time in the Settings.

OpenAI (Generic) LLM settings