Find answers from the community

Updated 3 months ago

llama-hub/llama_hub/llama_packs/fuzzy_ci...

Hello guys! I'm a bit puzzled over the need for an OpenAi API key for the FuzzyCitationEnginePack: https://github.com/run-llama/llama-hub/blob/main/llama_hub/llama_packs/fuzzy_citation/fuzzy_citation_example.ipynb

Can anyone clarify what I'm missing out on?
L
M
4 comments
You can use any llm, just configure your index/query engine to use whichever llm you want
@Logan M what if want to run without a LLM? Mostly interested in evaluating the citations, and not the LLM response. Howver, I get an openai.AuthenticationError imidiately:
Plain Text
openai.AuthenticationError: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 3a03c59b********************1c2d. You can find your API key at https://platform.openai.com/account/api-keys.', 'type': 'invalid_request_error', 'param': None, 'code': 'invalid_api_key'}}
You need an LLM to evaluate citations? The citations are generated using fuzzy matching based on what the LLM wrote vs the retrieved text
if you just want the retrieved text, you don't need this -- just run a retriever

Plain Text
retriever = index.as_retriever(similarity_top_k=2)
nodes = retriever.retrieve("query")


You'll still need an embed mode for that though
Add a reply
Sign up and join the conversation on Discord