LlamaIndex
Log in

Find answers from the community

Updated 3 months ago

Tokens

SSristi Agrawal
·
Hi, how can we solve this error

ValueError: Requested tokens (12453) exceed context window of 10000

I’m using mistral v2 7b model.
W
1 comment
WWhiteFang_Jr
I think something went wild in between.


  • Check the max_token size
  • Try restarting the session of colab if using colab.
Add a reply
Sign up and join the conversation on Discord