🎉 LocalAI 4.9.0 Release! 🚀 LocalAI 4.9.0 is out! Thirteen days and 146 pull requests, spent on the parts of LocalAI you touch every day rather than on new engines. Authentication is now deny-by-default, chat gained end-to-end context compression, models and backends each have one canonical page instead of three, and vllm-cpp grew a video modality serving MiniMax-H3 with a real audio track. Highlig…
What's Changed 👒 Dependencies chore(deps): bump actions/stale from 10.4.0 to 11.0.0 by @dependabot[bot] in #11395 chore(deps): bump actions/checkout from 4 to 7 by @dependabot[bot] in #11396 Other Changes feat(gallery): fall back to mirrors and a cached index when the primary source fails by @localai-bot in #11389 chore(model-gallery): ⬆️ update checksum by @localai-bot in #11405 docs: ⬆️ update d…
What's Changed Other Changes docs(blog): cover the terminal agent in the 4.8 post by @localai-bot in #11372 fix(vram): contain malformed GGUF metadata by @richiejp in #11374 docs: ⬆️ update docs version mudler/LocalAI by @localai-bot in #11377 chore: ⬆️ Update 0xShug0/audio.cpp to 7efbb58def443722ea540d931dd3debee3e4d5e8 by @localai-bot in #11378 chore: ⬆️ Update ikawrakow/ik_llama.cpp to cf1aa57e…
🎉 LocalAI 4.8.0 Release! 🚀 LocalAI 4.8.0 is out! Twenty-two days, 386 pull requests, and three new modalities. This release introduces vllm.cpp, a C++20 engine maintained by the LocalAI team, which began as a vLLM port and now carries its own featureset, shipping as the vllm-cpp backend in alpha development builds. Around it: 3D generation as a new modality, a multi-family audio.cpp engine, galler…
What's Changed Other Changes fix(config): only inject llama.cpp serving options on the llama.cpp path by @localai-bot in #10822 Full Changelog: v4.7.0...v4.7.1
🎉 LocalAI 4.7.0 Release! 🚀 LocalAI 4.7.0 is out! This release widens what LocalAI can generate and how you drive it: a UI-managed voice cloning library, local video and audio-driven avatar generation, and interleaved reasoning that travels with tool calls. It also lands new audio engines (one-pass diarized transcription, F5-TTS, true streaming TTS) and a batch of reliability fixes across auth, tra…
What's Changed 👒 Dependencies chore(deps): bump actions/cache from 4 to 6 by @dependabot[bot] in #10704 Other Changes refactor: use slices.Contains to simplify code by @weifanglab in #10702 fix(ci): shard single-arch backend matrix under GitHub's 256-job limit by @localai-bot in #10703 chore(model gallery): add MiniCPM series models by @ZMXJJ in #10699 New Contributors @weifanglab made their first…
What's Changed Other Changes fix(auth): log the real cause of OIDC/OAuth user-info failures by @localai-bot in #10679 feat(api): add GET /v1/models/capabilities endpoint by @localai-bot in #10687 chore: ⬆️ Update CrispStrobe/CrispASR to 1109cb3fcae2e242c2b3d42ec0e3fd6e813f2ce7 by @localai-bot in #10685 chore: ⬆️ Update ggml-org/llama.cpp to 665892536dfb1b7532161e3182304bd35c33e768 by @localai-bot…
🎉 LocalAI 4.6.0 Release! 🚀 LocalAI 4.6.0 is out! This is a reliability-focused release: AMD ROCm backends now run on-GPU at full speed, distributed model loads no longer wedge when a worker dies, and realtime sessions warm up predictably. It also brings conversation forking to the built-in chat UI, a Prometheus counter for PII/audit events, and an SSRF fix for the model gallery. Highlights: 🔴 AMD…
What's Changed 👒 Dependencies chore(deps): bump actions/cache from 4 to 6 by @dependabot[bot] in #10593 Other Changes docs: ⬆️ update docs version mudler/LocalAI by @localai-bot in #10560 fix(distributed): missing agent NATS permission by @ALameLlama in #10549 feat(distributed): SyncedMap component + migrate finetune/quant/agent-tasks to cross-replica state by @localai-bot in #10542 chore(fish-spe…
What's Changed Other Changes fix(backends): repair release CI build/test breaks (kokoros, fish-speech, llama-cpp-quantization, sglang) by @localai-bot in #10547 chore(model gallery): 🤖 add 1 new models via gallery agent by @localai-bot in #10544 fix(backends): whisper darwin run.sh loads whichever fallback lib exists (.so/.dylib) by @localai-bot in #10553 Full Changelog: v4.5.4...v4.5.5
What's Changed Other Changes fix(backends): derive darwin RUN_BINARY from the exec line only by @localai-bot in #10541 Full Changelog: v4.5.3...v4.5.4
What's Changed Other Changes feat(macos): sign and notarize the DMG, app, and server binary by @localai-bot in #10510 fix(backends): set rpath on the piper darwin binary so it can load its bundled libs by @localai-bot in #10525 fix(backends): darwin packaging for silero-vad (last Linux-only Go backend) by @localai-bot in #10528 chore(model gallery): 🤖 add 1 new models via gallery agent by @localai…
What's Changed Other Changes fix(backends): make the opus backend build and package on macOS/Darwin by @localai-bot in #10523 Full Changelog: v4.5.1...v4.5.2
What's Changed Other Changes chore(model gallery): 🤖 add 1 new models via gallery agent by @localai-bot in #10472 chore: ⬆️ Update ikawrakow/ik_llama.cpp to 7ccf1d209588962b96eacca325b37e9b3e8faf5e by @localai-bot in #10456 chore: ⬆️ Update CrispStrobe/CrispASR to 96b2a6ee31d30389fed8a7ef1a54239b75231ddc by @localai-bot in #10465 chore: ⬆️ Update ggml-org/llama.cpp to be4a6a63eb2b848e19c277bdcf2bd…
🎉 LocalAI 4.5.0 Release! 🚀 LocalAI 4.5.0 is out! This release widens what LocalAI can perceive, sharpens the realtime voice API, and makes multi-user serving fast with zero configuration. Four new backends land, the React UI redesign ships in full, and distributed mode gets a robustness pass. Highlights: 👁️ See depth - new depth-anything backend (Depth Anything 3): monocular metric depth + camera…
What's Changed Other Changes chore: ⬆️ Update CrispStrobe/CrispASR to d745bda4386ae0f9d1d2f23fff8ec95d76428221 by @localai-bot in #10260 docs: ⬆️ update docs version mudler/LocalAI by @localai-bot in #10259 chore: ⬆️ Update antirez/ds4 to d881f2a05e8ff6bec001315a36b794b4aa310173 by @localai-bot in #10262 chore: ⬆️ Update mudler/parakeet.cpp to 9db92be63179a27201d3b88d5d40c545b2ac48ae by @localai-b…
What's Changed Other Changes chore: ⬆️ Update ggml-org/llama.cpp to ac4cddeb0dbd778f650bf568f6f08344a06abe3a by @localai-bot in #10239 chore: ⬆️ Update CrispStrobe/CrispASR to 4b27392ffd0991a857594652cbb8b57e585bcd7b by @localai-bot in #10241 fix(vllm): parse tool_call function arguments before applying the chat template by @pos-ei-don in #10256 fix(cuda): install cuda-nvrtc-dev alongside the othe…
What's Changed Other Changes docs: ⬆️ update docs version mudler/LocalAI by @localai-bot in #10245 chore: ⬆️ Update antirez/ds4 to 8384adf0f9fa0f3bb342dd925372de778b95b263 by @localai-bot in #10242 fix(vllm): restore compatibility with vLLM >= 0.22 (get_tokenizer moved to vllm.tokenizers) by @pos-ei-don in #10252 feat(realtime): stream the LLM / TTS / transcription pipeline stages by @localai-bot…