Find answers from the community

s
F
Y
a
P
Updated 2 years ago

e g when i insert a new document saying

e.g. when i insert a new 'document' saying 'hello / good morning', the results of an index about a research paper get pretty weird, unless i specify top k
Attachments
Screen_Shot_2023-03-17_at_8.23.49_AM.png
Screen_Shot_2023-03-17_at_8.24.17_AM.png
1
K
L
r
4 comments
cc: @jerryjliu0 @ravitheja
I don't know of any bugs with insert(), but I see the similarity is 0.76 on that dummy document. I think the embeddings are less helpful with short documents like that. I suspect it would work fine with actual document text
@Krrish@LiteLLM.ai can you share the code base? would like to check it.
@Krrish@LiteLLM.ai by default the top k is 1 (which tbf is not a great default top k).

Also echoing @Logan M's point, using a vector store index for a "summarization"-esque question like "What is the paper about" is not a great fit. for those types of questions i'd recommend using a list index
Add a reply
Sign up and join the conversation on Discord