Find answers from the community

Updated 9 months ago

If I want to the retriever to take in

If I want to the retriever to take in account the date metadata and assign better score to new nodes to avoid retrieving outdated nodes. How should I approach?
L
L
4 comments
Maybe a node-postprocessor to filter / sort by date?
@Logan M lets say i'm working with a new dataset. If i look for bitcoin there are thousands if news so i would need to retrieve all of them and order by date which i dont think is ideal a top_k of 2000. Other solution would be to filter only the newest. But if i filter only the newest and I look for news about chatgpt founding, news that are already a few year old, I wont get relevant results
I need something like retrieve the newest, if score less than threshold, retrieve again. Repeat until memory leak probably
Yea vector dbs I've seen don't offer filtering for dates πŸ€·β€β™‚οΈ
Add a reply
Sign up and join the conversation on Discord