Find answers from the community

Updated 8 months ago

what if the model in question, say a

what if the model in question, say a small custom model, gets hung up trying to return a specific format implied by the Pydantic model?
L
n
4 comments
lol there is no garuntee πŸ˜… By default the model gets one chance

You could also loop for some max iterations.

In general, it takes a very good LLM to be reliable at this.
thanks for the clarification. what setting changes the "one chance by default."?
Sorry, not a setting, its hardcoded -- youd have to subclass the appropriate component and modify the logic from there
PRs definitely welcome as well
Add a reply
Sign up and join the conversation on Discord