Find answers from the community

Updated 3 months ago

Agent

Is it possible to setup a groq agent? instead of openai?
L
t
6 comments
Yea, just setup a react agent and pass in the groq llm
Just to be sure, a Query engine tool, that I setup like this:
function_llm = groq_llm
agent = AgentRunner.from_llm(
None,
llm=function_llm,
verbose=True,
chat_history=history,
)

doc_tool = QueryEngineTool(
query_engine=agent,
metadata=ToolMetadata(
name=f"{route.title()}",
description=tool_summary,
),
)

Is the same as just querying the llm with the chat history right?
Because i'm confused, this is dramatically different when I use openai and groq, whereas when I do it on the groq playground I get the expected result
that seems not correct? You created an agent without any tools?
the history in here is the only thing this agent needs
That seems right to me then
Add a reply
Sign up and join the conversation on Discord