Find answers from the community

Updated last year

I think beceause 'Bedrock' object has

At a glance

The community member posted about an issue they were facing with the 'Bedrock' object, which they believed did not have the 'complete' attribute, only 'predict'. The comments suggest that the issue may be related to formatting requirements for the 'claude' model, and that the community member found a way to bypass the error by using the 'CustomLLM' from the 'llama_index.llms' module instead of the 'Bedrock' LLM. The comments also mention that the 'Bedrock' LLM has a 'complete' method, and that the community member was able to customize the LLM to have the 'complete' method. However, the community member still faced an issue with using the 'complete' method with 'generate_qa_embedding_pairs'.

I think beceause 'Bedrock' object has no attribute 'complete', there is only 'predict', How I can fix this?
L
a
7 comments
No, that's not why.

If you look at the error, there is some extra steps bedrock is requiring for formatting for claude?
The prompt should look like

Plain Text
Human: Paul graham is 
Assistant:
I found that I can bypass the error using from llama_index.llms import (
CustomLLM, and # from langchain.llms.bedrock import Bedrock
I customized the LLM to have complete method
The bedrock LLM has a complete method πŸ˜… But that works too
Yes indeed, but I couldn't use it with generate_qa_embedding_pairs, I had this error of formatting
Add a reply
Sign up and join the conversation on Discord