koboldcpp-1.118 Row Split has been removed, selecting it will now default to tensor split. Rocwmma has been removed, matching upstream behavior. Added support for qwen3tts aliases for all voices. Breaking change for RPC to match upstream behavior, allowing llama.cpp RPC server and clients to be interchangeable with koboldcpp ones again. Fixed loading for SeFI image. Fixed a quality regression in Q…
koboldcpp-1.117.1 Fixed terminal output sometimes not showing thinking traces Multimodal Images are now inserted inline instead of at the top of the context. This should improve vision coherence and quality on most models. llama.cpp UI mic input is now disabled by default (toggle in settings) Prevent MTP drafting for parallel requests as it's not currently supported. Added Ollama compatible embedd…
updated cmake
koboldcpp-1.116.1 NEW: Added Krea 2 Turbo support (Recommended). This is an extremely powerful image generation model with incredible knowledge. Grab and load the Krea 2 Turbo template containing all necessary files here. Recommended settings for Krea 2 Turbo: 8 steps at 1.0 guidance cfg. Prompt with descriptive natural language. NEW: Added Ideogram 4 support. Grab and load the Ideogram 4 template…
fix builds
koboldcpp-1.115.2 sad.mp4 (Base Image = Klein 9B, To Video = LTX2.3, Add Music = AceStep 1.5, all 100% done in Kobold) NEW: Full support for the Anthropic /v1/messages API has been implemented, including multimodal and tool calling support. Added an easy toggle for default reasoning effort in the GUI launcher, can also be set with --reasoningeffort. This uses --gendefaults under the hood to set AP…
up version
refactor drafting
koboldcpp-1.114.1 kobo.mp4 NEW: Experimental parallel text generation requests (continuous batching) is now optionally supported - Normal text gen requests can be executed in parallel instead of queued in this experimental mode. To use, set --parallelrequests X where X is the number of simultaneous generations to allow at one time, or set parallel requests in network tab in the GUI. This can be us…
mmap fix from leejet/stable-diffusion.cpp#1575
koboldcpp-1.113.2 intermission edition Breaking change: Split mode is now set independently, in order to accommodate tensor split mode (experimental). This more closely follows the syntax used upstream with --split-mode Example Before: --usecuda rowsplit Example Now: --usecuda --splitmode (layer/row/tensor) Allow a runtime image LoRA directory to be easily selected, will allow all image gen LoRAs…
colab link to download directly, set a different fallback url
allow token bans and eos handling in