Find answers from the community

K
Kushal
Offline, last seen 3 months ago
Joined September 25, 2024
K
Kushal
·

Functuon

I was trying to create a FunctionCallingAgentWorker using instance of HuggingFaceLLM class, only to receive an error

Plain Text
     68         if not llm.metadata.is_function_calling_model:
     69             raise ValueError(
---> 70                 f"Model name {llm.model} does not support function calling API. "
     71             )
     72         self._llm = llm

AttributeError: 'HuggingFaceLLM' object has no attribute 'model'

Dived into github repo to see that the HuggingFaceLLM does not support function calling (mentioned in the screenshot).

What is the best way around it, given I do not have any API key, so using HuggingFaceLLM is the only option. My task is to create a RAG pipeline consisting of 10 documents by creating summary and vector query tools, and use them inside a FunctionCallingAgentWorker to answer questions.
1 comment
L