Patch release v4.12.1. Security fix only. Security Hardened the external URL policy for user-supplied URLs (chat vision image/audio/video URLs, image and audio endpoints). Redirect targets are now validated on every hop, 100.64.0.0/10 and 0.0.0.0/8 are treated as non-public, and the connection goes to the address that was validated. See #12853. Credits to @spicysharkco for the discovery. Full Chan…
🎉 LocalAI 4.12.0 Release! 🚀 LocalAI 4.12.0 is out! This release redesigns the web UI and adds streaming voice responses, native decision routing, and more control over model memory and prompt state. It also adds image upscaling, live motion capture, Qdrant stores, and authenticated chat history. It is also a preparation for the upcoming release which will include addon support. Our plan is to move…
🎉 LocalAI 4.11.0 Release! 🚀 LocalAI 4.11.0 is out! This release makes LocalAI more useful for audio understanding, resilient model serving, structured decisions, and day-to-day operation. Audio scenes can now combine transcription, diarization, sound detection, and remembered speaker names. Ordered failover chains keep a public model available across local and remote targets, while new Studio and…
🎉 LocalAI 4.10.0 Release! 🚀 LocalAI 4.10.0 is out! Twenty-eight days and 280 pull requests. The work landed on three fronts: operating a fleet, feeding it models from private sources, and fixing the backends you depend on. A fleet operations dashboard replaces the flat node list with cluster-wide health, capacity, running models, and bulk lifecycle actions. A credentials file lets one credentials.…
🎉 LocalAI 4.9.0 Release! 🚀 LocalAI 4.9.0 is out! Thirteen days and 146 pull requests, spent on the parts of LocalAI you touch every day rather than on new engines. Authentication is now deny-by-default, chat gained end-to-end context compression, models and backends each have one canonical page instead of three, and vllm-cpp grew a video modality serving MiniMax-H3 with a real audio track. Highlig…
What's Changed 👒 Dependencies chore(deps): bump actions/stale from 10.4.0 to 11.0.0 by @dependabot[bot] in #11395 chore(deps): bump actions/checkout from 4 to 7 by @dependabot[bot] in #11396 Other Changes feat(gallery): fall back to mirrors and a cached index when the primary source fails by @localai-bot in #11389 chore(model-gallery): ⬆️ update checksum by @localai-bot in #11405 docs: ⬆️ update d…
What's Changed Other Changes docs(blog): cover the terminal agent in the 4.8 post by @localai-bot in #11372 fix(vram): contain malformed GGUF metadata by @richiejp in #11374 docs: ⬆️ update docs version mudler/LocalAI by @localai-bot in #11377 chore: ⬆️ Update 0xShug0/audio.cpp to 7efbb58def443722ea540d931dd3debee3e4d5e8 by @localai-bot in #11378 chore: ⬆️ Update ikawrakow/ik_llama.cpp to cf1aa57e…
🎉 LocalAI 4.8.0 Release! 🚀 LocalAI 4.8.0 is out! Twenty-two days, 386 pull requests, and three new modalities. This release introduces vllm.cpp, a C++20 engine maintained by the LocalAI team, which began as a vLLM port and now carries its own featureset, shipping as the vllm-cpp backend in alpha development builds. Around it: 3D generation as a new modality, a multi-family audio.cpp engine, galler…
What's Changed Other Changes fix(config): only inject llama.cpp serving options on the llama.cpp path by @localai-bot in #10822 Full Changelog: v4.7.0...v4.7.1
🎉 LocalAI 4.7.0 Release! 🚀 LocalAI 4.7.0 is out! This release widens what LocalAI can generate and how you drive it: a UI-managed voice cloning library, local video and audio-driven avatar generation, and interleaved reasoning that travels with tool calls. It also lands new audio engines (one-pass diarized transcription, F5-TTS, true streaming TTS) and a batch of reliability fixes across auth, tra…
What's Changed 👒 Dependencies chore(deps): bump actions/cache from 4 to 6 by @dependabot[bot] in #10704 Other Changes refactor: use slices.Contains to simplify code by @weifanglab in #10702 fix(ci): shard single-arch backend matrix under GitHub's 256-job limit by @localai-bot in #10703 chore(model gallery): add MiniCPM series models by @ZMXJJ in #10699 New Contributors @weifanglab made their first…
What's Changed Other Changes fix(auth): log the real cause of OIDC/OAuth user-info failures by @localai-bot in #10679 feat(api): add GET /v1/models/capabilities endpoint by @localai-bot in #10687 chore: ⬆️ Update CrispStrobe/CrispASR to 1109cb3fcae2e242c2b3d42ec0e3fd6e813f2ce7 by @localai-bot in #10685 chore: ⬆️ Update ggml-org/llama.cpp to 665892536dfb1b7532161e3182304bd35c33e768 by @localai-bot…
🎉 LocalAI 4.6.0 Release! 🚀 LocalAI 4.6.0 is out! This is a reliability-focused release: AMD ROCm backends now run on-GPU at full speed, distributed model loads no longer wedge when a worker dies, and realtime sessions warm up predictably. It also brings conversation forking to the built-in chat UI, a Prometheus counter for PII/audit events, and an SSRF fix for the model gallery. Highlights: 🔴 AMD…
What's Changed 👒 Dependencies chore(deps): bump actions/cache from 4 to 6 by @dependabot[bot] in #10593 Other Changes docs: ⬆️ update docs version mudler/LocalAI by @localai-bot in #10560 fix(distributed): missing agent NATS permission by @ALameLlama in #10549 feat(distributed): SyncedMap component + migrate finetune/quant/agent-tasks to cross-replica state by @localai-bot in #10542 chore(fish-spe…
What's Changed Other Changes fix(backends): repair release CI build/test breaks (kokoros, fish-speech, llama-cpp-quantization, sglang) by @localai-bot in #10547 chore(model gallery): 🤖 add 1 new models via gallery agent by @localai-bot in #10544 fix(backends): whisper darwin run.sh loads whichever fallback lib exists (.so/.dylib) by @localai-bot in #10553 Full Changelog: v4.5.4...v4.5.5
What's Changed Other Changes fix(backends): derive darwin RUN_BINARY from the exec line only by @localai-bot in #10541 Full Changelog: v4.5.3...v4.5.4
What's Changed Other Changes feat(macos): sign and notarize the DMG, app, and server binary by @localai-bot in #10510 fix(backends): set rpath on the piper darwin binary so it can load its bundled libs by @localai-bot in #10525 fix(backends): darwin packaging for silero-vad (last Linux-only Go backend) by @localai-bot in #10528 chore(model gallery): 🤖 add 1 new models via gallery agent by @localai…
What's Changed Other Changes fix(backends): make the opus backend build and package on macOS/Darwin by @localai-bot in #10523 Full Changelog: v4.5.1...v4.5.2
What's Changed Other Changes chore(model gallery): 🤖 add 1 new models via gallery agent by @localai-bot in #10472 chore: ⬆️ Update ikawrakow/ik_llama.cpp to 7ccf1d209588962b96eacca325b37e9b3e8faf5e by @localai-bot in #10456 chore: ⬆️ Update CrispStrobe/CrispASR to 96b2a6ee31d30389fed8a7ef1a54239b75231ddc by @localai-bot in #10465 chore: ⬆️ Update ggml-org/llama.cpp to be4a6a63eb2b848e19c277bdcf2bd…
🎉 LocalAI 4.5.0 Release! 🚀 LocalAI 4.5.0 is out! This release widens what LocalAI can perceive, sharpens the realtime voice API, and makes multi-user serving fast with zero configuration. Four new backends land, the React UI redesign ships in full, and distributed mode gets a robustness pass. Highlights: 👁️ See depth - new depth-anything backend (Depth Anything 3): monocular metric depth + camera…
What's Changed Other Changes chore: ⬆️ Update CrispStrobe/CrispASR to d745bda4386ae0f9d1d2f23fff8ec95d76428221 by @localai-bot in #10260 docs: ⬆️ update docs version mudler/LocalAI by @localai-bot in #10259 chore: ⬆️ Update antirez/ds4 to d881f2a05e8ff6bec001315a36b794b4aa310173 by @localai-bot in #10262 chore: ⬆️ Update mudler/parakeet.cpp to 9db92be63179a27201d3b88d5d40c545b2ac48ae by @localai-b…
What's Changed Other Changes chore: ⬆️ Update ggml-org/llama.cpp to ac4cddeb0dbd778f650bf568f6f08344a06abe3a by @localai-bot in #10239 chore: ⬆️ Update CrispStrobe/CrispASR to 4b27392ffd0991a857594652cbb8b57e585bcd7b by @localai-bot in #10241 fix(vllm): parse tool_call function arguments before applying the chat template by @pos-ei-don in #10256 fix(cuda): install cuda-nvrtc-dev alongside the othe…
What's Changed Other Changes docs: ⬆️ update docs version mudler/LocalAI by @localai-bot in #10245 chore: ⬆️ Update antirez/ds4 to 8384adf0f9fa0f3bb342dd925372de778b95b263 by @localai-bot in #10242 fix(vllm): restore compatibility with vLLM >= 0.22 (get_tokenizer moved to vllm.tokenizers) by @pos-ei-don in #10252 feat(realtime): stream the LLM / TTS / transcription pipeline stages by @localai-bot…