AnythingLLM Is Now An AI Agent Across Your Os With AnythingLLM 1.15.0 for Desktop we have been working hard on what it means to bring your agent to you. Something that is still local, but outside of the walls of an app or a browser. This release features our first 3 features about this effort - we hope you enjoy them. Introducing Magic Features Magic Features bring AI to your entire computer — not…
Just some small patches for the upcoming 1.15.0 / 2.0.0-preview initial release for desktop What's Changed Migrate AWS Sdk to OpenAI by @timothycarambat in #5848 Groq STT by @timothycarambat in #5853 Fix edit prompt not appearing on user prompt by @timothycarambat in #5861 add missing headers to ollama embeder engine isAlive method by @TomaszZakrzewski in #5863 docs: update collector language in p…
Meeting Assistant Overhaul Meeting Assistant is desktop app only We have overhauled a large portion of the Meeting Assistant to make it smaller, faster, and more efficient across all devices and platforms. Now supports Intel, AMD, and NVIDIA GPUs for a 92% smaller binary and 15% faster processing times. If you already have the NVIDIA GPU binary installed, you can safely delete it if you want. It w…
Improvements Cerebres provider The default chat thread is now killed when you create a new thread. If you have chats on the default thread, it will be available still. New workspaces or workspaces with no chats on default will no longer show it. All model providers are now opt-out of tool calling by default. Everything will call tools by default unless you opt-out offering better performance for a…
This release is focused on improving the agent experience and adding new features to the agent system as well as moving towards a more passive, personal, and hybrid AI experience. Model Router: The First Consumer Hybrid AI Experience The Model Router feature is the first-ever user-defined intelligent routing system that seamlessly blends local and cloud AI into a single, unified experience that is…
Notable Improvements Streamed Document Embedding Now, when you upload a document to the workspace the process per-document is now reported during embedding. This is a huge improvement in performance and user experience. During this process you can add and remove documents to the queue as well as even close and navigate away from the page without losing your progress. App integrations There are now…
Major Features Automatic Mode for native tool calling For Select providers that support native tool calling, you no longer need to use @agent to use tools. You can now just use the tools without asking. If your prompt input does not have the "@" symbol, your chats will automatically use tools as needed. docs-agent-example.1.mov Intelligent Tool Selection We have added a new feature called Intellig…
More UI Improvements changelog-1.11.2-uiv2.mp4 Now, in the main chat UI we added some much desired UI improvements and fixes. New prompt input Better Citations UI and reporting Metrics for Agent calls Report document and web-search citations during Agent calls! Ability to each toggle on/off Agent skills from the prompt Ability to select the provider and model for the workspace without leaving the…
Homepage Redesign The main AnythingLLM homepage has been completely redesigned to be more modern and user-friendly so you can instantly start chatting the second you open the app after onboarding. Native Tool Calling Native tool calling is the best performance and experience for tool calling with your LLM provider and model. If you can enable it, you should. this only applies to local LLM provider…
AnythingLLM Desktop overlay is live! this is a free & desktop specific feature! Now, AnythingLLM Desktop has an OS-level and application aware panel that opens in a single keystroke. Seamlessly ingest your current open applications alongside all other chat functionality you use like document chat, RAG, agents, and more. This panel is such a smoother and more convenient way to use AnythingLLM - we…