Find answers from the community

V
Vitali
Offline, last seen 3 months ago
Joined October 10, 2024
Hi I'm trying to use LLM from Google Vertex IA from llamaindex package from llama_index.llms.vertex import Vertex llm_vertex = Vertex(model="gemini-1.5-flash-002", additional_kwargs={}) , but I cannot figure out how to add grounding tool to that model. If I use this model from package provided by google , I have option to add grounding tool.
Plain Text
# search grounding tool for rag
search_ground = Tool.from_google_search_retrieval(grounding.GoogleSearchRetrieval())
llm_vertex = GenerativeModel(model_name="gemini-1.5-flash-002")
response = llm_vertex.generate_content(query, tools=[search_ground])
Any thoughts on how to achieve the same from the llama_index library?
2 comments
L