Log in
Log into community
Find answers from the community
s
F
Y
a
P
3,278
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 2 years ago
0
Follow
hi trying to add documents to a simple
hi trying to add documents to a simple
0
Follow
K
Krrish@LiteLLM.ai
2 years ago
Β·
hi, trying to add documents to a simple vector index and hitting these openai errors.. is there anything i should keep in mind while doing this? @jerryjliu0
Attachments
b
K
j
20 comments
Share
Open in Discord
b
bmax
2 years ago
what do the docs_all_up look like
K
Krrish@LiteLLM.ai
2 years ago
list of llama_index Documents
K
Krrish@LiteLLM.ai
2 years ago
cc: @ravitheja
b
bmax
2 years ago
that stack trace doesnt' look like it's coming from the lines you pasted
K
Krrish@LiteLLM.ai
2 years ago
hmm, i'm trying to debug this as well, but there's no where else where i might be interfacing with the openai endpoint
K
Krrish@LiteLLM.ai
2 years ago
ok - running a test where i comment out that line, will see if i still get this error
j
jerryjliu0
2 years ago
are all your docs well-formed? e.g. is there a chance a chunk of a doc could have all spaces
K
Krrish@LiteLLM.ai
2 years ago
oh - i'm not running checking for that
K
Krrish@LiteLLM.ai
2 years ago
was reading and dumping into docs
K
Krrish@LiteLLM.ai
2 years ago
yea just finished checking, it's definitely the simplevectorindex line i shared
K
Krrish@LiteLLM.ai
2 years ago
is there any reference / things i should be checking for?
j
jerryjliu0
2 years ago
i was actually trying to help someone debug this issue, and i wasn't sure what the cause was
j
jerryjliu0
2 years ago
will devote some time tmrw to fixing it
j
jerryjliu0
2 years ago
if you can send me some sample help to repro that'd be π
K
Krrish@LiteLLM.ai
2 years ago
hmm thinking aloud - can't share the data file for privacy stuff.. what else could i send that might be helpful?
j
jerryjliu0
2 years ago
yeah no worries. i'm mostly just tryign to repro and fix the issue. so let me know if you run across it on test data too
j
jerryjliu0
2 years ago
taking a deeper look, this seems triggered if any Document object just contains a blank string. could you verify all your text has content in it?
K
Krrish@LiteLLM.ai
2 years ago
i ended up writing a pretty simple regex
K
Krrish@LiteLLM.ai
2 years ago
to check if the content was well-formed
K
Krrish@LiteLLM.ai
2 years ago
worked out
Add a reply
Sign up and join the conversation on Discord
Join on Discord