Hi there, I am struggling with having full control about what exact components of the service_context are actually used in a RetrieverQueryEngine.
Components are passed via ServiceContext.from_defaults during
- creation of the index
- adding of nodes
- and then creating the query engine itself.
But what exactly is used when is not obvious. Especially when passing a certain llm in the last step, it seems like it will possibly not use it.
So questions are:
- Is there a way to have adequate logging output to be sure what exact llms/apis are used
- What are the design principles behind the service context? Alway use the latest component passed somewhere? And jump to defaults when the component is invalid? Ors th like that. Maybe you have a link on that?
- Is there a more appropriate way to have such control, cause maybe service context is rather for fast prototyping only?
Thank you so much
Andi