Find answers from the community

Updated 6 months ago

hi guys I have a problem here and spend

At a glance

hi, guys, I have a problem here, and spend much time on google but with no luck. I use this code response = index.query(prompt, response_mode="default") to query the response, but the response is not incomplete, it's only part of the hole result, what should I do to get the hole result? I have try to call response = index.query(":continue") too but the reuslt is not the rest part of the first one, How can I get around this? thank you very much.

19 comments

LLogan M

What do you mean by the response not being complete?

(Also, I wouldn't set the chunk_size_limit, it gets calculated automatically so sometimes setting it causes issues)

jjerryjliu0

@imengxi not sure if this is what you're getting at, but try increasing max_tokens https://gpt-index.readthedocs.io/en/latest/how_to/custom_llms.html#example-changing-the-number-of-output-tokens-for-openai-cohere-ai21

iimengxi

Thank you, I will have a try

iimengxi

I mean, the answer from GPT-3 have been truncated

iimengxi

https://discord.com/channels/1059199217496772688/1059200010622873741/1079903103190569050

iimengxi

as this image shows, I have set max_tokens to 3000, so, may be not the max_tokens problem?

Attachment