Find answers from the community

Updated 4 months ago

But if you use open ai model then it

At a glance

But if you use open ai model then it will work fine
Settings.llm = OpenAI(temperature=0.2, model="gpt-3.5-turbo")
#Settings.llm=llm

4 comments

Nothing broke, the LLM just did not follow instructions

This relies on the LLM outputting a structured JSON

Open-Source LLMs are generally unreliable/bad at this, at least most of them are

llama2 especially is probably the worst haha

Add a reply