https://github.com/run-llama/llama_index/issues/17428Hi Folks,
A brief overview of what i am trying to do:
I am making a multi-tool agent which will be having 3 different tools as of now, 2 are
QueryEngineTool
and 1 is
FunctionTool
.
I am using open source model --
microsoft/Phi-3-mini-4k-instruct
model using llama_index HuggingFace and
models/gemini-1.5-flash
model.
HuggingFace model will be used by the tool to perfrom the given task.
Gemini -- will be used by the llama_index agent.
For faster inference and optimized memory utiluzation i am using
llama_index Vllm
on top of huggingface llm.
At the end i am using A CustomReAct agent toperform the given task.
Everything is working fine but the issue arrises when i am deploying it using gradio. There is a version conflict while installing gradio it is not able to find any suitable version, i tried using poetry as well but that too is not working.
I have also raised an issue of llama_index git, if anyone has worked on any such similar task please help me out with this.
I have attached a link that gives a detailed explanation about the version conflict.
Thanks for your time.