Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 8 months ago
0
Follow
what if the model in question, say a
what if the model in question, say a
Inactive
0
Follow
n
nbulkz
8 months ago
Β·
what if the model in question, say a small custom model, gets hung up trying to return a specific format implied by the Pydantic model?
L
n
4 comments
Share
Open in Discord
L
Logan M
8 months ago
lol there is no garuntee π By default the model gets one chance
You could also loop for some max iterations.
In general, it takes a very good LLM to be reliable at this.
n
nbulkz
8 months ago
thanks for the clarification. what setting changes the "one chance by default."?
L
Logan M
8 months ago
Sorry, not a setting, its hardcoded -- youd have to subclass the appropriate component and modify the logic from there
L
Logan M
8 months ago
PRs definitely welcome as well
Add a reply
Sign up and join the conversation on Discord
Join on Discord