Find answers from the community

Updated 3 months ago

Anyone using Claude 3 (Sonnet in

Anyone using Claude 3 (Sonnet in particular?) I'm finding it's cutting off the output tokens at a certain point, every time, mid sentence, if a response is longer than X length.
D
L
3 comments
I think it's 2000 tokens max length by default
I think the default is 512 actually? You can increase this
Anthropic(..., max_tokens=2000)
Add a reply
Sign up and join the conversation on Discord