Find answers from the community

Updated last year

Error

At a glance

The community member is facing an issue with query_engine.query() and has provided the error output on Pastebin. They suspect it could be a Python version issue, as the error does not occur when providing an LLM to StructuredLLMPredictor(llm=my_llm). The comments suggest that the issue might be a bug with the prompts and guardrails, which are not used often. One community member is currently avoiding the issue by passing the rails in the query, while another suggests that the bug needs to be fixed in the library.

Useful resources
I'm facing an issue with query_engine.query(), the error output is quite long so I've put it here with the minimal code that resulted in the issue.
https://pastebin.com/zabV7Uc3
Could it be a python version issue?
tested in a new venv on LlamaIndex v0.8.14 on python 3.11.4

Another note, this error does not show up when providing an llm to StructuredLLMPredictor(llm=my_llm)
L
h
6 comments
Tbh I think this is a bug with the prompts and gaurdrails

I don't see gaurdrails used often, probably why this got missed πŸ˜…
well any suggestion on this ?
currently to avoid it im passing the rails in the query
No suggestion πŸ˜… We just need to fix that bug in the library
Add a reply
Sign up and join the conversation on Discord