You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: pages/mcp-compatibility/desktop.mdx
+141-3
Original file line number
Diff line number
Diff line change
@@ -5,8 +5,146 @@ description: "How to use and debug MCP tools on AnythingLLM Desktop"
5
5
6
6
import { Callout } from"nextra/components";
7
7
8
-
## MCP on AnythingLLM Desktop
8
+
<Callouttype="info"emoji="💡">
9
+
The use of MCP for AnythingLLM Desktop is available in the [v1.8.0 release](/changelog/v1.8.0) - please [update to at least this version](/changelog/v1.8.0#pinned-download-links) to use this feature.
10
+
</Callout>
9
11
10
-
The current version of AnythingLLM Desktop does not support MCP at this time.
12
+
## Things to know about MCP on AnythingLLM Desktop
11
13
12
-
However, we are working on it! Join the [Discord server](https://discord.gg/Dh4zSZCdsC) or Star on [Github](https://github.com/Mintplex-Labs/anything-llm) to stay updated.
14
+
<Callouttype="error"emoji="🔒">
15
+
As always, **never run MCPs you do not trust** - we **do not** endorse or guarantee the security of any MCPs you may find on the internet.
16
+
</Callout>
17
+
18
+
### MCP Server support
19
+
20
+
AnythingLLM Desktop supports `Tools` loading via MCP Servers. We **do not** support Resources, Prompts, or Sampling.
21
+
22
+
### Startup sequence
23
+
24
+
<Callouttype="info"emoji="💡">
25
+
The more MCP servers you have defined, the longer it will take for them to start up.
26
+
</Callout>
27
+
28
+
AnythingLLM _does not_ automatically start MCP servers when the application starts to prevent any overloading of resources on boot or unexpected resource consumption.
29
+
30
+
AnythingLLM _will_ automatically start MCP servers when you open the "Agent Skills" page in the AnythingLLM UI **or** invoke the `@agent` directive.
31
+
All MCP servers will be started in the background - subsequent "boots" will then be much faster since the MCP servers will already be running.
32
+
33
+
If you mark a tool as `anythingllm.autoStart: false` in your configuration file, it will not be started automatically - you will need to start it manually from the UI.
34
+
35
+
### Command availability
36
+
37
+
<Callouttype="warning"emoji="⚠️">
38
+
It is not within the scope of AnythingLLM Desktop to debug when a command is not working or available. This is not a bug and you should instead check the [MCP Server documentation](https://modelcontextprotocol.io/introduction) or [community support channels](https://github.com/orgs/modelcontextprotocol/discussions).
39
+
</Callout>
40
+
41
+
In order for the `command` of **any MCP Server** to work, you **must** have the respective command installed on your host machine.
42
+
43
+
AnythingLLM **does not** automatically install the commands for you - you **must** install them manually and also ensure the command is available in your `PATH` or the command is a path directly to the binary being used.
44
+
eg: `npx`, `uv`, `uvx`, `node`, `bash`, etc.
45
+
46
+
### Where is the MCP Server configuration file?
47
+
48
+
<Callouttype="info"emoji="💡">
49
+
The configuration file is automatically created if you open the "Agent Skills" page in the AnythingLLM UI and it does not exist.
50
+
</Callout>
51
+
52
+
The MCP Server configuration file is located in the `plugins/anythingllm_mcp_servers.json` file in the [AnythingLLM storage directory](/installation-desktop/storage).
53
+
54
+
### Reloading MCP Servers
55
+
56
+
You can reload MCP Servers *on the fly* by clicking the "Refresh" button in the "Agent Skills" page. This will reload the MCP Servers from the configuration file and restart them.
57
+
This does not require you to restart the AnythingLLM Desktop application - the currently running MCPs will be killed and rebooted with whatever changes you made to the configuration file.
58
+
59
+
You can also click "Refresh" to reload the MCP Servers if you are debugging a specific MCP Server.
60
+
61
+
### Starting and stopping MCP Servers
62
+
63
+
You can start and stop MCP Servers *on the fly* by clicking the "Start" or "Stop" action via the gear icon in the "Agent Skills" page while selecting the MCP Server you want to start or stop.
64
+
65
+
This does not require you to restart the AnythingLLM Desktop application - the target MCP Server will be started or stopped immediately.
66
+
67
+
If you wish to stop an MCP Server from automatically starting - see the [Autostart prevention](#autostart-prevention) section.
68
+
69
+
### How do I add/remove an MCP Server?
70
+
71
+
#### Adding an MCP Server
72
+
Adding an MCP Server is as simple as adding a new tool to the `mcpServers` object in the `anythingllm_mcp_servers.json` file in your [AnythingLLM storage directory](/installation-desktop/storage).
73
+
74
+
#### Removing an MCP Server
75
+
76
+
You can remove an MCP Server by clicking on an MCP Server in the "Agent Skills" page, select the gear icon, and clicking "Delete".
77
+
Deleting the MCP Server from the UI **will remove** the MCP Server from the file and kill the process running that MCP Server.
78
+
79
+
You can also manually remove an MCP Server by removing the object from the `mcpServers` object in the `anythingllm_mcp_servers.json` file and clicking "Refresh" in the "Agent Skills" page on the UI afterwards.
80
+
81
+
### Viewing the status of an MCP Server
82
+
83
+
On the "Agent Skills" page, you can view the status of an MCP Server by clicking on the MCP Server in the list - if there is an error, it will be displayed in the card.
84
+
85
+
Additionally, you can quickly see the status of all MCP Servers by clicking the "Agent Skills" page and looking at the MCP Servers list.
86
+
87
+
### Debugging MCP Servers
88
+
89
+
If you are having issues with an MCP Server, you can best debug these by looking at the [Desktop application logs](/installation-desktop/debug#general-debugging).
90
+
91
+
### Issues installing a tool
92
+
93
+
<Callouttype="info"emoji="💡">
94
+
**Please do not open issues about tool issues on GitHub - we are not the MCP authors or maintainers.**
95
+
96
+
If you are having issues, you should post on the [MCP Discussion board](https://github.com/orgs/modelcontextprotocol/discussions) - or ask in the AnythingLLM Discord server.
97
+
</Callout>
98
+
99
+
Sometimes, an MCP Server will require a tool to be installed via `uv tool install xyz`.
100
+
The easiest way to do this is to open command line and run the command manually on your machine. Then you can click "Refresh" in the "Agent Skills" and see if the tool now boots successfully.
101
+
102
+
### Autostart prevention
103
+
104
+
_This property is **specific to AnythingLLM only** and will have no effect on other tools._
105
+
106
+
Sometimes, you may want to optionally start an MCP server manually to prevent it from starting automatically and consuming resources.
107
+
108
+
To do this, AnythingLLM respects the `anythingllm.autoStart` property in the MCP Server configuration file.
109
+
110
+
For example, if you want to prevent the `face-generator` MCP Server from starting automatically, you can set the `autoStart` property to `false` in the configuration file.
111
+
112
+
Any tool that does not have `autoStart: false` explicitly set will be started automatically when the rest of the MCP servers are started.
113
+
114
+
```json
115
+
{
116
+
"mcpServers": {
117
+
"face-generator": {
118
+
"command": "npx",
119
+
"args": [
120
+
"@dasheck0/face-generator"
121
+
],
122
+
"anythingllm": {
123
+
"autoStart": false
124
+
}
125
+
},
126
+
"mcp-youtube": {
127
+
"command": "mcp-youtube",
128
+
"args": []
129
+
}
130
+
}
131
+
}
132
+
```
133
+
134
+
### Tool persistence
135
+
136
+
Since AnythingLLM Desktop is a desktop application, the tools downloaded for MCP are stored on your host machine and will persist across application restarts and even application uninstalls.
137
+
138
+
MCP tools are stored outside of AnythingLLM and you should delete them manually if you want to remove them.
139
+
140
+
### Writing files to the host machine
141
+
142
+
Often, you may want to write or even read files from the host machine - since the MCP Server is running on your host machine you can use any path on your host machine that would normally function in a command line.
143
+
144
+
### My LLM is not calling my MCP Server!
145
+
146
+
First, ensure that the MCP Server is running and that the tool is available in the "Agent Skills" page.
147
+
148
+
Next, your issue is probably the model you are using - this is especially true if you are using a small local model with a limited context window.
149
+
150
+
[Learn more about LLMs with Agent Skills →](/agent-not-using-tools)
0 commit comments