The community member is experiencing an error while performing RAG (Retrieval Augmented Generation) on the meta-llama/Llama-2-7b-chat-hf model. The code was working fine a few days ago, but now the community member is unable to perform query_engine.query(). The community member tried using str(query_wrapper_prompt), which allowed the model to be downloaded, but the issue persists.
In the comments, another community member suggests that the type has changed and advises the original poster to avoid wrapping the query_wrapper_prompt with the Prompt class, and instead use something like query_wrapper_prompt = "...{query_str}...". The original poster confirms that this solution worked.
I am getting this error. I am performing RAG on meta-llama/Llama-2-7b-chat-hf, few days ago the same code was working fine. I tried with str(query_wrapper_prompt) the model gets downloaded but I can't perform query_engine.query(). 1st image - when I keep query_wrapper_prompt as it is. 2nd image - after applying str(query_wrapper_prompt)
