LlamaIndex
Log in

Find answers from the community

Updated 2 years ago

hi trying to add documents to a simple

KKrrish@LiteLLM.ai
·
hi, trying to add documents to a simple vector index and hitting these openai errors.. is there anything i should keep in mind while doing this? @jerryjliu0
Attachments
Screen_Shot_2023-02-24_at_11.21.01_PM.png
Screen_Shot_2023-02-24_at_11.21.20_PM.png
b
K
j
20 comments
bbmax
what do the docs_all_up look like
KKrrish@LiteLLM.ai
list of llama_index Documents
KKrrish@LiteLLM.ai
cc: @ravitheja
bbmax
that stack trace doesnt' look like it's coming from the lines you pasted
KKrrish@LiteLLM.ai
hmm, i'm trying to debug this as well, but there's no where else where i might be interfacing with the openai endpoint
KKrrish@LiteLLM.ai
ok - running a test where i comment out that line, will see if i still get this error
jjerryjliu0
are all your docs well-formed? e.g. is there a chance a chunk of a doc could have all spaces
KKrrish@LiteLLM.ai
oh - i'm not running checking for that
KKrrish@LiteLLM.ai
was reading and dumping into docs
KKrrish@LiteLLM.ai
yea just finished checking, it's definitely the simplevectorindex line i shared
KKrrish@LiteLLM.ai
is there any reference / things i should be checking for?
jjerryjliu0
i was actually trying to help someone debug this issue, and i wasn't sure what the cause was
jjerryjliu0
will devote some time tmrw to fixing it
jjerryjliu0
if you can send me some sample help to repro that'd be 🙏
KKrrish@LiteLLM.ai
hmm thinking aloud - can't share the data file for privacy stuff.. what else could i send that might be helpful?
jjerryjliu0
yeah no worries. i'm mostly just tryign to repro and fix the issue. so let me know if you run across it on test data too
jjerryjliu0
taking a deeper look, this seems triggered if any Document object just contains a blank string. could you verify all your text has content in it?
KKrrish@LiteLLM.ai
i ended up writing a pretty simple regex
KKrrish@LiteLLM.ai
to check if the content was well-formed
KKrrish@LiteLLM.ai
worked out
Add a reply
Sign up and join the conversation on Discord