Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 3 months ago
0
Follow
Embedding large documents
Embedding large documents
Inactive
0
Follow
a
autratec
last year
ยท
i have close 1000 txt documents need to be indexed using vector db and whole process should take pretty long time. is there anyway i can know the % of index progress ?
L
1 comment
Share
Open in Discord
L
Logan M
last year
You can set the show_progress boolean
https://gpt-index.readthedocs.io/en/latest/core_modules/data_modules/index/usage_pattern.html#high-level-api
You can also try changing the batch size (the default is 10)
https://gpt-index.readthedocs.io/en/latest/core_modules/model_modules/embeddings/usage_pattern.html#batch-size
Add a reply
Sign up and join the conversation on Discord
Join on Discord