Find answers from the community

Updated 2 months ago

Functuon

I was trying to create a FunctionCallingAgentWorker using instance of HuggingFaceLLM class, only to receive an error

Plain Text
     68         if not llm.metadata.is_function_calling_model:
     69             raise ValueError(
---> 70                 f"Model name {llm.model} does not support function calling API. "
     71             )
     72         self._llm = llm

AttributeError: 'HuggingFaceLLM' object has no attribute 'model'

Dived into github repo to see that the HuggingFaceLLM does not support function calling (mentioned in the screenshot).

What is the best way around it, given I do not have any API key, so using HuggingFaceLLM is the only option. My task is to create a RAG pipeline consisting of 10 documents by creating summary and vector query tools, and use them inside a FunctionCallingAgentWorker to answer questions.
Attachment
image.png
L
1 comment
Yea huggingface doesn't have a function calling api

You have to use ReActAgentWorker
Add a reply
Sign up and join the conversation on Discord