Find answers from the community

Updated 2 months ago

Seeing the following error when trying

Seeing the following error when trying to use llm.chat with Claude3 Sonnet through Bedrock:

ValidationException: An error occurred (ValidationException) when calling the InvokeModel operation: "claude-3-sonnet-20240229" is not supported on this API. Please use the Messages API instead.

13 comments

DDS

Hey @maybe goats dont exist , seems you have Claude3 up and working already, are you invoking through Bedrock? Run into this error at all?

WWhiteFang_Jr

I think bedrock needs to add claude 3 first. Since it was released yetserday maybe it is not available yet on there platfrom

DDS

I am able to use it through boto3 currently but am just getting started now

WWhiteFang_Jr

Okay I see sonet is available on bedrock, You can do one thing until Bedrock package is updated

https://github.com/run-llama/llama_index/blob/a0d793aa07c8baf9683cf682f07b712f56971db5/llama-index-integrations/llms/llama-index-llms-bedrock/llama_index/llms/bedrock/utils.py#L42

These are the list of Chat model that bedrock currently can use in llamaindex. Add your claude sonet 3 mdoel like how previous ones are added

DDS

okay got it

DDS

new format as well I guess, some chatter here https://github.com/langchain-ai/langchain/issues/18513

mmaybe goats dont exist

Upgrade llama index and Anthropic llama packages

DDS

Thanks, you are using through Bedrock?

LLogan M

Yea bedrock probably isn't fully updated 😦 managing bedrock is so annoying because there's no unified api, it's more like a gateway on top of other apis

DDS

Ahh gotcha, is the AnthropicBedrock client from anthropic supported through LllamaIndex? Little confused about the different implementation here

DDS

Attachment

LLogan M

ha you and me both

Looks like thats not supported, but it could be supported if we allowed passing in the client to the Anthropic LLM class

mmaybe goats dont exist

Nope but I saw the same issue!
I see a PR for bedrock so per logan maybe that update will get you situated

Add a reply