Find answers from the community

s
F
Y
a
P
Updated 2 years ago

I have pre chunked text and pre computed

I have pre-chunked text, and pre-computed embedding that I want to insert into an index
M
1 comment
You can set the chunk size very high but there is a limit, based on how much data the LLMs can accept in one call. So depends how long your chunks are.
Add a reply
Sign up and join the conversation on Discord