hello guys,
I'm currently working with OpenAI Agent with multiple query engine tools.
I want to stream query engine tool result directly from the OpenAI Agent,
however, though I set streaming as True, OpenAI Agent stream output after the response from the query engine completed.
Does anybody have soution or idea for this issue?
the query engine tool defined as below,
query_engine: RetrieverQueryEngine = self._as_query_engine(
similarity_top_k=similarity_top_k,
vector_store_query_mode=vector_store_query_mode,
only_live=only_live,
llm=llm or Settings.cheap_llm,
node_postprocessors=node_postprocessors,
response_mode=response_mode,
text_qa_template=text_qa_template,
refine_template=refine_template,
summary_template=summary_template,
simple_template=simple_template,
use_rerank=use_rerank,
rerank_top_k=rerank_top_k,
rerank_template=rerank_template,
use_async=use_async,
streaming=streaming,
verbose=verbose,
)
return QueryEngineTool.from_defaults(
query_engine=query_engine,
name=tool_name,
description=tool_description,
return_direct=return_direct,
)