Find answers from the community

Updated 2 years ago

Hello I m trying to generate a

At a glance
Hello, I'm trying to generate a summarization of a large document and followed https://gpt-index.readthedocs.io/en/latest/guides/usage_pattern.html#customizing-llm-s. For the num_output variable, I tried a smaller value (like 500) and a bigger value (4000). I was able to get some decent summarization using the smaller value, however, for the big value, the response is like I'm sorry, I cannot summarize texts that do not exist in the provided context information. Does anyone know what is causing this? I assumed using a bigger num_output will ouput a longer summary. Thanks
j
k
4 comments
are you using the new chatgpt api? we're not entirely what's going on there re: responses

you could try text-davinci-003 which should be the default
Thank you! I tried the davinci model, it works great. Wanted to try the chatGPT api
i think the chatgpt api is not great at following longer instructions
at least in the current format we're testing it with
Add a reply
Sign up and join the conversation on Discord