Find answers from the community

Updated last year

Retriever

I have a question: instead of getting response from LLM using query_engine, how do I get the retrieved context from the step before sending to LLM for generating response

4 comments

EEmanuel Ferreira

https://gpt-index.readthedocs.io/en/stable/core_modules/query_modules/retriever/root.html#retriever

CChiken1

Thanks

CChiken1

Do I still have to define a llm in ServiceContext if I only intend to use retrieval?

CChiken1

Ah I found it, I set llm=None

Add a reply