Find answers from the community

Updated 6 months ago

Anyone using Claude 3 (Sonnet in

At a glance

The community member is experiencing an issue with Claude 3 (Sonnet in particular), where the output is being cut off mid-sentence if the response is longer than a certain length. The comments suggest that the default maximum token length is either 2000 or 512, and that the user can increase this limit.

Anyone using Claude 3 (Sonnet in particular?) I'm finding it's cutting off the output tokens at a certain point, every time, mid sentence, if a response is longer than X length.
D
L
3 comments
I think it's 2000 tokens max length by default
I think the default is 512 actually? You can increase this
Anthropic(..., max_tokens=2000)
Add a reply
Sign up and join the conversation on Discord