Find answers from the community

Updated last month

Version

At a glance
https://github.com/run-llama/llama_index/issues/17428


Hi Folks,
A brief overview of what i am trying to do:
I am making a multi-tool agent which will be having 3 different tools as of now, 2 are QueryEngineTool and 1 is FunctionTool .
I am using open source model -- microsoft/Phi-3-mini-4k-instruct model using llama_index HuggingFace and models/gemini-1.5-flash model.

HuggingFace model will be used by the tool to perfrom the given task.
Gemini -- will be used by the llama_index agent.


For faster inference and optimized memory utiluzation i am using llama_index Vllm on top of huggingface llm.

At the end i am using A CustomReAct agent toperform the given task.

Everything is working fine but the issue arrises when i am deploying it using gradio. There is a version conflict while installing gradio it is not able to find any suitable version, i tried using poetry as well but that too is not working.
I have also raised an issue of llama_index git, if anyone has worked on any such similar task please help me out with this.

I have attached a link that gives a detailed explanation about the version conflict.
Thanks for your time.
a
L
2 comments
Thank you for your quick reply on Sundays.
I hope you resolve the version conflicts soon so that llama-index-llms-huggingface can be installed without any issues.
Add a reply
Sign up and join the conversation on Discord