Find answers from the community

Updated 2 years ago

Choose llm

hi guys - quick question. I have two python scripts - 1 which builds the indicies and 1 which retrieves the index from storage and queries it - Its clear how to choose and LLM to build hte indicies, but I'm missing on how to specifiy a LLM to query the index? I want to try different combinations - I've probably missed something easy, buy can anyone help?
L
H
2 comments
Yea when you create the query engine, you can specify a new service context

index.as_query_engine(service_context=service_context)
Add a reply
Sign up and join the conversation on Discord