Built-in LLM for Docker AnythingLLM Docker now has a default local LLM experience right out of the box. The same kind of built-in engine that ships with AnythingLLM Desktop can now run inside the container: Lemonade, the fully open-source local inference server from AMD, running your models with llama.cpp. You no longer need to run Ollama, LM Studio or any other inference server next to AnythingLL…
What's Changed fix: point k8s probes at the server's /api/ping by @u00dxk2 in #6592 fix: don't crash when removing a parsed file while an image is attached by @marmar9615-cloud in #6585 fix: open the clicked image when attachments share a file name by @marmar9615-cloud in #6586 fix: stop sending history attachments to providers that build prompts from raw chat history by @simonether in #6591 fix:…
What's Changed fix(collector): read spreadsheet dates as dates, not serial numbers by @L4XB in #6478 Drop temp param for Anthropic models by @shatfield4 in #6472 Allow Generic OpenAI max tokens of 0 to omit max_tokens from request by @shatfield4 in #6470 fix: support SearchApi engines in agent web browsing by @evilive3000 in #6465 fix: ignore malformed agent WebSocket frames instead of crashing th…
New Features LLMman - OSS is now available as a local LLM provider, replacing Docker Model Runner Google Vertex AI is now available as an LLM provider New generate-image agent skill for creating images from chat You.com is now the default web search provider for richer web-searches with Zero Data Retention Agent flow variables now support optional arguments Hindi, Bulgarian, and Swedish language s…
Activity and Chain of Thought Overhaul We overhauled our UI for long-horizon agentic tasks that show multiple thinking and tool calls to now roll up into a single clean, collapsible UI element. This gives you more screen real estate for the actual response while still keeping the important call stack and thoughts the model produces in an easy-to-read format. Navigation Warning Recently, we added t…
Notable Changes Image Generation Now you can generate images via /img when a supported provider is set up. This flow also allows image attachments for edits, followups, or combination prompts if your provider supports image editing. Ability for an agent-tool to generate images is coming next update. Better File Picker UX Now in the file picker you can drag entire folders and their hierarchy will b…
AnythingLLM Is Now An AI Agent Across Your Os With AnythingLLM 1.15.0 for Desktop we have been working hard on what it means to bring your agent to you. Something that is still local, but outside of the walls of an app or a browser. This release features our first 3 features about this effort - we hope you enjoy them. Introducing Magic Features Magic Features bring AI to your entire computer — not…
Just some small patches for the upcoming 1.15.0 / 2.0.0-preview initial release for desktop What's Changed Migrate AWS Sdk to OpenAI by @timothycarambat in #5848 Groq STT by @timothycarambat in #5853 Fix edit prompt not appearing on user prompt by @timothycarambat in #5861 add missing headers to ollama embeder engine isAlive method by @TomaszZakrzewski in #5863 docs: update collector language in p…
Meeting Assistant Overhaul Meeting Assistant is desktop app only We have overhauled a large portion of the Meeting Assistant to make it smaller, faster, and more efficient across all devices and platforms. Now supports Intel, AMD, and NVIDIA GPUs for a 92% smaller binary and 15% faster processing times. If you already have the NVIDIA GPU binary installed, you can safely delete it if you want. It w…
Improvements Cerebres provider The default chat thread is now killed when you create a new thread. If you have chats on the default thread, it will be available still. New workspaces or workspaces with no chats on default will no longer show it. All model providers are now opt-out of tool calling by default. Everything will call tools by default unless you opt-out offering better performance for a…
This release is focused on improving the agent experience and adding new features to the agent system as well as moving towards a more passive, personal, and hybrid AI experience. Model Router: The First Consumer Hybrid AI Experience The Model Router feature is the first-ever user-defined intelligent routing system that seamlessly blends local and cloud AI into a single, unified experience that is…
Notable Improvements Streamed Document Embedding Now, when you upload a document to the workspace the process per-document is now reported during embedding. This is a huge improvement in performance and user experience. During this process you can add and remove documents to the queue as well as even close and navigate away from the page without losing your progress. App integrations There are now…
Major Features Automatic Mode for native tool calling For Select providers that support native tool calling, you no longer need to use @agent to use tools. You can now just use the tools without asking. If your prompt input does not have the "@" symbol, your chats will automatically use tools as needed. docs-agent-example.1.mov Intelligent Tool Selection We have added a new feature called Intellig…
More UI Improvements changelog-1.11.2-uiv2.mp4 Now, in the main chat UI we added some much desired UI improvements and fixes. New prompt input Better Citations UI and reporting Metrics for Agent calls Report document and web-search citations during Agent calls! Ability to each toggle on/off Agent skills from the prompt Ability to select the provider and model for the workspace without leaving the…
Homepage Redesign The main AnythingLLM homepage has been completely redesigned to be more modern and user-friendly so you can instantly start chatting the second you open the app after onboarding. Native Tool Calling Native tool calling is the best performance and experience for tool calling with your LLM provider and model. If you can enable it, you should. this only applies to local LLM provider…
AnythingLLM Desktop overlay is live! this is a free & desktop specific feature! Now, AnythingLLM Desktop has an OS-level and application aware panel that opens in a single keystroke. Seamlessly ingest your current open applications alongside all other chat functionality you use like document chat, RAG, agents, and more. This panel is such a smoother and more convenient way to use AnythingLLM - we…