Find answers from the community

Updated 2 months ago

Replacing default chatgpt with anthropic llm in tutorial still asks for openai api key

I am replacing default chatgpt with anthropic llm in tutorial(https://docs.llamaindex.ai/en/stable/examples/index_structs/doc_summary/DocSummary/). But it is still asking me for OpenAI API key, is it for embeddings? If yes, how to make it completely Anthropic based tutorial?

5 comments

WWhiteFang_Jr

Yes default embedding is OpenAI too, So if you wanna drift away from defaults you;ll need to use local embedding model as well.

Which is pretty easy:

Plain Text

# install Llama-index Huggingface lib
pip install llama-index-embeddings-huggingface

# now load the model
Settings.embed_model = "local:BAAI/bge-base-en-v1.5"

JJatin.K

It is throwing below error

Attachments

JJatin.K

Attachment

WWhiteFang_Jr

Ah DocumentSummaryIndex uses openai for generating summaries.
Just define your llm as global with Settings.llm=llm and the error will go away

JJatin.K

It's working now! thanks. Just out of curiosity, defining LLM or any other model through Settings. will override their local/abstraction/object based definition i.e. DocumentSummaryIndex.from_documents(documents, llm=llm,), right?

Add a reply