Find answers from the community

Updated last year

Gpt4all

I'm getting response as "ERROR: The prompt size exceeds the context window size and cannot be processed." while quering a document using LLM QA bot , how to solve this
https://stackoverflow.com/questions/76873456/error-the-prompt-size-exceeds-the-context-window-size-and-cannot-be-processed

3 comments

Isn't the max input size for gpt4all 2048? But you are setting it to 4096?

You probably also want to lower the chunk size in that case, maybe to 512

Thank you very much, yes the max size is 2048 and with it chunk size 512 will go, 1024 chunk size doesn't work.

Add a reply