Find answers from the community

Updated 3 months ago

llama-hub/llama_hub/llama_packs/fuzzy_ci...

Hello guys! I'm a bit puzzled over the need for an OpenAi API key for the FuzzyCitationEnginePack: https://github.com/run-llama/llama-hub/blob/main/llama_hub/llama_packs/fuzzy_citation/fuzzy_citation_example.ipynb

Can anyone clarify what I'm missing out on?

4 comments

LLogan M

You can use any llm, just configure your index/query engine to use whichever llm you want

MMotzWanted

@Logan M what if want to run without a LLM? Mostly interested in evaluating the citations, and not the LLM response. Howver, I get an openai.AuthenticationError imidiately:

Plain Text

openai.AuthenticationError: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 3a03c59b********************1c2d. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}}

LLogan M

You need an LLM to evaluate citations? The citations are generated using fuzzy matching based on what the LLM wrote vs the retrieved text

LLogan M

if you just want the retrieved text, you don't need this -- just run a retriever

Plain Text

retriever = index.as_retriever(similarity_top_k=2)
nodes = retriever.retrieve("query")

You'll still need an embed mode for that though

Add a reply