Find answers from the community

Updated 2 months ago

Hey guys,

Hey guys,

I'm trying to run the example on StructuredPlannerAgent(agent_worker=worker, tools=[lyft_tool, uber_tool], verbose=True)
but I'm hitting this error ValueError: Model name anthropic.claude-3-sonnet-20240229-v1:0 does not support function calling API.
I'm using Clude-3 sonnet via Bedrock and I'm seeing sonnet supports function calling, Any help on why I'm seeing this error. Any help will be greatly appreciated. Screenshot attached.

Attachment

Screenshot_2024-06-12_at_10.07.51_AM.png

12 comments

LLogan M

function calling through bedrock is not supported

LLogan M

Well, we actually just merged support for bedrock converse, which supports function calling

LLogan M

https://docs.llamaindex.ai/en/latest/examples/agent/bedrock_converse_agent/?h=converse

lllm_dev

Ah thx @Logan M , appreciate the help as always. will look into it. BTW we released the our app to prod last week, we're getting tremendous support and traction from our management team. Its definitely not possible with your team and especially your support. 🙏

LLogan M

Happy to hear it! Just out of curiosity, what is the app/use-case with llamaindex here? 👀

lllm_dev

we're a 10B hedge fund. one of the top in healthcare, we're ingesting all internal research data, headlines, sec filings, global market pricing and 6 others data souces on companies, drugs etc

lllm_dev

currently i have build the entire app in llama_index on internal research data and financial sql engine.

lllm_dev

our ceo wants this to be like 'tony stark's machine to pretty much answer everything

lllm_dev

hence i'm working on the structured agent planner

LLogan M

Oh sick! So pretty much, general q/a on top of a ton of investment/research data, very cool

lllm_dev

yep

bbiswaroop

Great use case, and good to hear about the traction you are seeing. Let us know how we can help further/ any feature requests you have etc. Always happy to learn more about how we can improve our product

Add a reply