Find answers from the community

Updated 2 years ago

Is there a way to pass chunk size limit

At a glance

The community member is asking how to pass the chunk_size_limit parameter to a Streamlit app that uses the data loader widget to create embeddings from PDFs. They mention that the load_from_disk function in their app has the chunk_size_limit defined, but it's not being applied. The community member is asking if there is another way to apply the chunk_size_limit.

Another community member responds by asking where the chunk size limit is being specified, whether in the data loader or during index construction.

Is there a way to pass chunk_size_limit to a streamlit app that uses the data loader widget for creating embeddings from PDFs? My load from disk function in the app has the chunk_size_limit defined but it's not applying it.

Is there another way to apply the chunk_size_limit?
j
1 comment
just checking, where are you specifying the chunk size limit? in the data loader or during index construction?
Add a reply
Sign up and join the conversation on Discord