Openai key

At a glance

The community member is trying to preload an index of data from storage, but they also want users to be able to specify their own OpenAI API key. However, the OpenAI key is required before the llama_index can successfully load a saved index, which takes about a minute. This creates a poor user experience, as users have to wait for the index to load before they can use their own API key.

A community member suggests a potential workaround: the index could be loaded with a fake key, and then the models could be re-initialized with the proper key. This would allow the index to load without the user having to wait for the full minute.

aafewell

hi, I am trying to preload an index of data from storage, and I also want the user to be able to specify their own openAI api key, but, it looks like the openAI key is needed before llama_index can successfully load a saved index, so I cant load the index until the user specifies their openAI key, and it takes like a minute to load the index. It would be a much better user experience if the index would load from storage without needing the openai key present. So If I want the user to be able to use their own key, I have to have them sit and wait for a full minute for the index to load. I understand why the API key is needed for doing the indexing, but I dont understand why it would be needed to load a saved index from storage. Is there anything that could be done about this? Thanks!

1 comment

LLogan M

The only reason it's needed is because loading the index also initialized the llm_predictor and embed_model under the hood.

Technically, you could load the index with a fake key and it would work fine... I think lol just a little hacky

Plain Text

os.environ["OPENAI_API_KEY] = "FAKE"

index = load_index_from_storage(...)

# re initialize models with proper key
index.service_context llm_predictor = LLMPredictor(llm=ChatOpenAI(..., openai_api_key="real"))
index.sevice_context.embed_model = OpenAIEmbedding(openai_api_key="real")

Add a reply

Find answers from the community

Openai key