Find answers from the community

Updated 3 months ago

What s the difference between a

What's the difference between a retriever and a query engine in terms of functionality? Can I assume the retriever just simply grabs context without ranking?

8 comments

LLogan M

exactly, a retriver will just fetch nodes for a given query 👍

LLawWing

I see and what does setting the retriever mode to LLM do? I assume it chooses where it pulls from between the local index or the LLM itself?

LLogan M

That mode (for the list index) uses the LLM to select which nodes to use to answer the query

LLogan M

I think it's a little beta tbh haha I didn't realize that was there

LLawWing

I see, yeah I was just looking around on the high level class retriever docs

LLawWing

https://gpt-index.readthedocs.io/en/latest/core_modules/query_modules/retriever/usage_pattern.html#low-level-composition-api

LLawWing

Oh also, one more question but do I need to always init the NodeParser between loading docs and constructing the index?

LLogan M

I think only if you are customizing the node parser, otherwise it gets setup automatically under the hood

Add a reply