LlamaIndex
Log in

Find answers from the community

Updated 14 hours ago

Integrate MCP tools into LlamaIndex

At a glance

A community member has written a blog post and provided an end-to-end example demonstrating how to convert the MCP (Model Context Protocol) tool to the LlamaIndex tool. The post has generated interest from other community members, with some expressing difficulties in integrating MCP with LlamaIndex in the past. The community members have discussed the provided demo code, which simplifies the integration process by having LlamaIndex implement the ToolAdapter. One community member is considering contributing an MCPToolSpec to the LlamaIndex framework, which would allow for easier integration of MCP tools. Another community member has already started working on implementing support for MCP tools in the LlamaIndex project.

Useful resources
PPsiACE
·
hi everyone , I wrote a blog and end-to-end example showing how to convert the MCP (Model Context Protocol) tool to the ready-to-use LlamaIndex tool, hope you guys like it! https://psiace.me/posts/integrate-mcp-tools-into-llamaindex/
P
L
0
13 comments
PPsiACE
e2e demo: https://github.com/psiace/psiace/tree/main/demo/llamaindex-mcp-adapter
LLogan M
When MCP first came out, I wanted to integrate it with llama-index officially, but all their docs/guides made zero sense (for example, the server and client needing to start in the same process/script ??)

Will be giving this a read!
PPsiACE
Their official example is not clear enough, you can check out the demo code I provided. Essentially, LlamaIndex just needs to implement the ToolAdapter and doesn't need to care about the rest.
LLogan M
I might use this code to contribute some kind of MCPToolSpec to the framework 🙂 It would be very cool if you could do something like

pip install llama-index-tools-mcp

Plain Text
from llama_index.tools.mcp import MCPToolSpec

tool_spec = MCPToolSpec(url, allowed_tools=["tool_name1", tool_name2"])

tools = tool_spec.to_tool_list()
agent = AgentWorkflow.from_tools_or_functions(tools)
PPsiACE
Sounds good, I might check it out later. I use llamaindex at work and have recently started trying to integrate mcp.
PPsiACE
cc @Logan M https://github.com/run-llama/llama_index/pull/17795 I've roughly implemented a simple version for initially providing support for mcp tools.
LLogan M
awesome! I will review this later today. Appreciate you getting that in so quickly
00xDrTuna
oh wait so there's mcp support now?
00xDrTuna
dope
00xDrTuna
And it supports SSE!
00xDrTuna
Very nice
00xDrTuna
https://tenor.com/view/meme-american-psycho-business-card-gif-25561759
00xDrTuna
Now let's see that sse auth support
Add a reply
Sign up and join the conversation on Discord