Find answers from the community

Updated 4 months ago

Llama2

Hi All, I'm new to Llama-Index and trying to build a "RouterQueryEngine", product documentation is based on OPENAI_API_KEY for this. However, I'm trying to use REPLICATE_API_KEY (that uses model=llama2_7b_chat). But I'm getting error "ValueError: Failed to convert output to JSON: "

Suggest, if anyone has faced similar issue.
Attachment
image.png
L
A
4 comments
Llama2 is not smart enough to output structured json needed for parsing
Thanks @Logan M , What could be an alternate option other than OPENAI.
Llama3.1? Especially with ollama
Thanks, Let me try that.
Add a reply
Sign up and join the conversation on Discord