Hi everyone. I'm wondering if we could be using gpt with a custom endpoint? I mean, the OpenAI API is bridged to a new URL but the API stays the same, and I want to set the base URL of GPT to that bridged one. Many thanks!
I failed upon setting it and then executing ServiceContext.from_defaults(llm=llm), then I accidentally came across that setting openai.base_url for the openai pkg solves it. π But still, thank you!