Find answers from the community

Updated 2 months ago

Hey I am trying to use doc ids filter in

Hey, I am trying to use doc_ids filter in Weaviate vector store by doing this

Plain Text

query_engine = self.index.as_query_engine(
            service_context=self.service_context,
            text_qa_template=qa_template_copy, 
            refine_template=refine_template_prompt,
            streaming=streaming,
            similarity_top_k=3, 
            doc_ids=doc_ids,
            verbose=True,
        )

But I get the following error

Plain Text

'Response' object has no attribute 'response_gen'

Does any one know how what is causing this error?
Thanks!

14 comments

TTeemu

How are you trying to access the response object?

mmrmvp

this is what I am doing

Plain Text

def generate_response_stream(response_gen):
    """Yield the response stream."""
    # stream json data
    for text in response_gen:
        yield text
return Response(generate_response_stream(data.response_gen), mimetype='text/json')

mmrmvp

It works fine when I remove the doc_ids filter

TTeemu

Yeah I don't think you can pass that in the query engine like that, do you have more details on your implementation of doc_id?

mmrmvp

doc_ids is basically an array of strings which I pass in the body of the post request.

LLogan M

Is streaming actually set to true? What kind of LLM are you using?

mmrmvp

Yup streaming is set to True and I am using opean ai's gpt-3.5-turbo model.

LLogan M

Are you using langchains LLM object or the one from LlamaIndex?