Find answers from the community

Updated 3 months ago

While using llamaindex

While using llamaindex subquestionqueryengine with guidance question generator, i am getting this error. I am following the demo showed over the llamaindex blog exactly but getting this error everytime.
Attachment
rn_image_picker_lib_temp_4ce0e2f5-86c8-49d5-bf65-198668337343.jpg
L
S
4 comments
This is because the LLM decided not produce a valid JSON object -- it happens.

Tbh I would probably just use something that takes advantages of openais function/tool calling API rather than relying on JSON parsing. Something like a pydantic program or pydantic query engine
Oh I thought guidance api will handle this problem. Actually i have openai access through azure and they don't have function calling capability yet
guidance tries to, but tbh I never found it that good.

Azure is so slow to update :PSadge:
Yeah they will take at least a month for sure😂. Anyway thanks again.
Add a reply
Sign up and join the conversation on Discord