KobaldCPP LLM

KobaldCPP (opens in a new tab) is a simple one-file way to run various GGML and GGUF models with KoboldAI's UI

KobaldCPP is a separate application that you need to download first and connect to.

Connecting to KobaldCPP

You can update your model to a different model at any time in the Settings.