Find answers from the community

Updated 2 years ago

Would people find it useful if the

Would people find it useful if the RetrieverQueryEngine query method took an optional retriever_query_bundle param in case you want your retriever's query to be different from the one the response synthesizer uses? I'm feeling like I'd like to be able to fine tune the retriever with the query bundle but I don't want to change what the synthesizer gets.

6 comments

PPocketColin

I can create a PR if other people would benefit from this, but I could also tweak my prompts so it didn't matter as much for me if this is one of those one-off use case situations.

LLogan M

The purpose of this would be to use a different query string to using for embeddings/finding nodes?

PPocketColin

Correct. I mean they're usually similar (if not the same), but sometimes it seems like the embeddings query string could be much specific/targeted.

PPocketColin

but that's why I wanted to ask if people would us it here. I may also be misunderstanding how the embeddings query string works.

LLogan M

Yea I think this is already supported!

When call query(), you can pass in a query bundle that has both the query str and an embedding str. The embedding str is only used for retrieval

https://gpt-index.readthedocs.io/en/latest/reference/query/query_bundle.html

PPocketColin

Oh! That's great. Ok thanks!

Add a reply