example.md

sshinji3046

Hi, there i am having problem troubleshooting with querying issues. I am use combination of text splitters, markdownsplitters and multilingual models to retreive answers . However the query fails even in basic questions such as "what is the topic about" citing there are no nodes that contain the information . I am wondering what could be the reason. Attaching the code block and also the markdown files. I am not sure why is the case so . The example md file is here : https://drive.google.com/file/d/1XiZD4QIcwi4eQjbh0vn4nn5YGlWpDIhI/view?usp=sharing . Any tips or troubleshooting that could help ?

3 comments

LLogan M

Questions like "what is the topic about" are not really useful for a vector index?

Like, it will take that, and retrieve a top-k most similar, which thinking about that query text, wont be very helpful

LLogan M

A common pattern is routing between two indexes (vector vs. summary) for queries that require all nodes vs a top k

sshinji3046

@Logan M thank you for the quick reply. Is there a way to resolve this kind of issues. The use case is to go through a few such posts and query for example
a) what are the comments mentioning ?
b) When the post posted
c) Explain the post in 5 bullet points .

this way the posts could be analysed to get insights. The posts are from reddit , that way it would help to get a quick overview . It could be something like chatting with llama index community for example. However after custom chunking and embedding it seems that it fails to work or my methodology is totally wrong .

Add a reply

Find answers from the community

example.md