Find answers from the community

Updated 3 months ago

Google vertex llm grounding tool configuration issue

Hi I'm trying to use LLM from Google Vertex IA from llamaindex package from llama_index.llms.vertex import Vertex llm_vertex = Vertex(model="gemini-1.5-flash-002", additional_kwargs={}) , but I cannot figure out how to add grounding tool to that model. If I use this model from package provided by google , I have option to add grounding tool.
Plain Text
# search grounding tool for rag
search_ground = Tool.from_google_search_retrieval(grounding.GoogleSearchRetrieval())
llm_vertex = GenerativeModel(model_name="gemini-1.5-flash-002")
response = llm_vertex.generate_content(query, tools=[search_ground])
Any thoughts on how to achieve the same from the llama_index library?
L
2 comments
I don't think thats integrated
I might have saw a (very old) PR for this that didn't get merged for one reason or another
Add a reply
Sign up and join the conversation on Discord