koboldcpp-1.124.2 [ a e s t h e t i c . e d i t i o n ] kobo_music_vid.mp4 NEW! - KoboldCpp has now integrated a small subset of popular models from audio.cpp by @0xShug0! This greatly enhances the available built-in Music Gen and TTS Gen capabilities! Music Gen: The long awaited YuE2 music gen model is supported. Download, save and load one of the following templates: YuE2, no LLM - Lightest opti…
updated lite
Conflicts: .github/workflows/behavior-check.yml .github/workflows/build-apple.yml CMakeLists.txt docs/backend/SYCL.md docs/ops.md docs/ops/OpenCL.csv docs/speculative.md ggml/CMakeLists.txt ggml/src/ggml-cann/ggml-cann.cpp ggml/src/ggml-cpu/amx/amx.cpp ggml/src/ggml-cuda/common.cuh ggml/src/ggml-cuda/fattn.cu ggml/src/ggml-et/ggml-et.cpp ggml/src/ggml-hexagon/ggml-hexagon.cpp ggml/src/ggml-hexagon…
koboldcpp-1.123.1 NEW: Introducing koboldcpp.net, our new community website! - KoboldCpp now has an official community website! This is a legitimate community site put together with the help of @Autumnlight02 and aims to be a simple and helpful resource for newbies to get started, (and also to help combat other fake websites floating around). So, do check it out at https://koboldcpp.net - contribu…
sd: add a non-default target for a Vulkan sdmain binary (#2534)
koboldcpp-1.122.1 kobold_agent.mp4 PSA: KoboldCpp needs YOUR help to fight a fake phishing site (click here for info)! NEW: Added an integrated KoboldCpp Agent - KoboldCpp now ships with a bundled Agentic harness. This works like an extremely lightweight replacement for tools like Opencode, Codex or Claude Code. Comes with 9 built-in tools, and a tiny system prompt of only 2k tokens including all…
dont exclude toolcall prose prefix
koboldcpp-1.121 nobold_mtv.mp4 Music generated by @Dampfinchen, clips for music video created entirely in KoboldCpp NEW: Media reference support added for Minimax H3! - You will now be able to attach audio clips and multiple reference images to generate minimax H3 videos. The music video attached to this video was created entirely in KoboldCpp (in segments of 7s each) Fixed a race condition during…
koboldcpp-1.120 Minor fix to assistant gen prefills being triggered incorrectly Fixed a bug where failsafe mode was incorrectly selected Added support for DirectIO model load mode (--usedirectio), also mlock and mmap can now be combined. New model support: Qwen3.8-Flash-Next and Ling-3.0-flash are fully supported. Note that there are bad quants floating out there, so make sure you use the right fi…
koboldcpp-1.119 pasta.mp4 NEW: Added support for Video generation and I2V with Minimax H3. Requires 4 files as described in this docs. For ease of use, you can download the MiniMax H3 quick setup .kcppt template here NEW: Added support for Muse Glimmer, jinja templates and tool calling also supported. Qwen 3.8 is also fully supported now. Added support for DSpark and Dflash speculative decoding In…
koboldcpp-1.118.1 Row Split has been removed, selecting it will now default to tensor split. Rocwmma has been removed, matching upstream behavior. Added support for qwen3tts aliases for all voices. Breaking change for RPC to match upstream behavior, allowing llama.cpp RPC server and clients to be interchangeable with koboldcpp ones again. Fixed loading for SeFI image. Fixed a quality regression in…
update lite and sdui
koboldcpp-1.117.1 Fixed terminal output sometimes not showing thinking traces Multimodal Images are now inserted inline instead of at the top of the context. This should improve vision coherence and quality on most models. llama.cpp UI mic input is now disabled by default (toggle in settings) Prevent MTP drafting for parallel requests as it's not currently supported. Added Ollama compatible embedd…
updated cmake
koboldcpp-1.116.1 NEW: Added Krea 2 Turbo support (Recommended). This is an extremely powerful image generation model with incredible knowledge. Grab and load the Krea 2 Turbo template containing all necessary files here. Recommended settings for Krea 2 Turbo: 8 steps at 1.0 guidance cfg. Prompt with descriptive natural language. NEW: Added Ideogram 4 support. Grab and load the Ideogram 4 template…
fix builds
koboldcpp-1.115.2 sad.mp4 (Base Image = Klein 9B, To Video = LTX2.3, Add Music = AceStep 1.5, all 100% done in Kobold) NEW: Full support for the Anthropic /v1/messages API has been implemented, including multimodal and tool calling support. Added an easy toggle for default reasoning effort in the GUI launcher, can also be set with --reasoningeffort. This uses --gendefaults under the hood to set AP…
up version
refactor drafting
koboldcpp-1.114.1 kobo.mp4 NEW: Experimental parallel text generation requests (continuous batching) is now optionally supported - Normal text gen requests can be executed in parallel instead of queued in this experimental mode. To use, set --parallelrequests X where X is the number of simultaneous generations to allow at one time, or set parallel requests in network tab in the GUI. This can be us…
mmap fix from leejet/stable-diffusion.cpp#1575
koboldcpp-1.113.2 intermission edition Breaking change: Split mode is now set independently, in order to accommodate tensor split mode (experimental). This more closely follows the syntax used upstream with --split-mode Example Before: --usecuda rowsplit Example Now: --usecuda --splitmode (layer/row/tensor) Allow a runtime image LoRA directory to be easily selected, will allow all image gen LoRAs…
colab link to download directly, set a different fallback url
allow token bans and eos handling in