Find answers from the community

s
F
Y
a
P
Updated 2 years ago

Chunk size

When I make index, I set chunk_size_limit = 512. However, I see one node text is very long and its token is about 3000. Would it be at most 512 tokens ?
L
J
3 comments
Are you passing in a prompt helper to the service context, or just setting the chunk size limit in the service context itself?
Theres two levels of chunking: one during indexing and one during querying

If you set the chunk_size_limit in the service context, it will apply to both.

But if you set in the prompt helper only, it only applies to the prompt helper (confusing I know)
Thank you so much. I'll try again. Have good night
Add a reply
Sign up and join the conversation on Discord