Find answers from the community

Updated 3 months ago

Thanks but I don t understand how and

Thanks, but I don't understand how and what to use here. When I call from_documents, inside it calls the OpenAI() instance where the openai key could be passed to but I don't see any way to do it. Maybe it can be done via customization?

2 comments

ddiridiri

Sorry for abbreviations,

you can choose llm to use using the service_context as argument for from_document method (https://gpt-index.readthedocs.io/en/latest/reference/service_context.html)

just like
GPTSimpleVectorIndex.from_documents(
city_docs[wiki_title], service_context=service_context
)

SSeaCat

Yes, exactly. I was able to implement it from this example: https://gpt-index.readthedocs.io/en/latest/how_to/customization/custom_llms.html#example-changing-the-underlying-llm

Thanks a lot!!

Add a reply