Find answers from the community

Updated 9 months ago

Agents

@Logan M do you think I could contribute this change, where I add an optional reasoning llm that handles the reasoning portion, and a generation llm that does the final generation
L
m
4 comments
Hmm, but how do you know ahead of time whether a tool is called vs. a final response?
Good question, and I'm going to need to look at the code to see but I was thinking maybe something could be done in finalize response
I think since the LLM dynamically writes tool calls and final responses, there isn't really a way to know before it write it πŸ€”
Oof yeah that makes sense
Add a reply
Sign up and join the conversation on Discord