LlamaIndex
Log in

Find answers from the community

Updated 2 years ago

Chunk size

JJW
·
When I make index, I set chunk_size_limit = 512. However, I see one node text is very long and its token is about 3000. Would it be at most 512 tokens ?
L
J
3 comments
LLogan M
Are you passing in a prompt helper to the service context, or just setting the chunk size limit in the service context itself?
LLogan M
Theres two levels of chunking: one during indexing and one during querying

If you set the chunk_size_limit in the service context, it will apply to both.

But if you set in the prompt helper only, it only applies to the prompt helper (confusing I know)
JJW
Thank you so much. I'll try again. Have good night
Add a reply
Sign up and join the conversation on Discord