Find answers from the community

Updated 6 months ago

How can i limit the amount of characters

At a glance

The community member is asking how to limit the number of characters in the response of an OpenAI model. A comment suggests setting the max_tokens parameter to 512 when initializing the OpenAI model, which provides a hard limit on the response length. The comment also mentions that response lengths can be controlled through the prompt.

Useful resources

FFran Piantoni

How can i limit the amount of characters inside the reponse of the Model?
I am using a OpenAI model

1 comment

TTeemu

Plain Text

Settings.llm = OpenAI(temperature=0, model="gpt-3.5-turbo", max_tokens=512)

Max tokens for a hard limit but you can also control the response lengths with your prompt https://docs.llamaindex.ai/en/stable/module_guides/models/llms/usage_custom.html#example-changing-the-number-of-output-tokens-for-openai-cohere-ai21

Add a reply