Find answers from the community

S
Santo
Offline, last seen 4 months ago
Joined September 25, 2024
S
Santo
·

hello guys,

hello guys,

I'm currently working with OpenAI Agent with multiple query engine tools.

I want to stream query engine tool result directly from the OpenAI Agent,

however, though I set streaming as True, OpenAI Agent stream output after the response from the query engine completed.
Does anybody have soution or idea for this issue?

the query engine tool defined as below,

query_engine: RetrieverQueryEngine = self._as_query_engine(
similarity_top_k=similarity_top_k,
vector_store_query_mode=vector_store_query_mode,
only_live=only_live,
llm=llm or Settings.cheap_llm,
node_postprocessors=node_postprocessors,
response_mode=response_mode,
text_qa_template=text_qa_template,
refine_template=refine_template,
summary_template=summary_template,
simple_template=simple_template,
use_rerank=use_rerank,
rerank_top_k=rerank_top_k,
rerank_template=rerank_template,
use_async=use_async,
streaming=streaming,
verbose=verbose,
)

return QueryEngineTool.from_defaults(
query_engine=query_engine,
name=tool_name,
description=tool_description,
return_direct=return_direct,
)
6 comments
L
R
L