Find answers from the community

Updated 2 months ago

Parallel Streaming of Events from Two Different LLMs

At a glance

The community member is trying to do parallel streaming of events from two different large language models (LLMs) but is getting the data in sequential order. Another community member suggests that the issue may be related to the implementation of asynchronous functionality in the Glean library used for the LLMs. The original poster thanks the other community member for the suggestion and says they will check it on their side.

I'm trying to do parallel streaming of event from two different llm's at the same time and I'm getting the data in sequential order. Any help on this pls
L
l
2 comments
I don't know what Glean is for an LLM, but maybe it doesn't implement async properly?
@Logan M your the man. thx Logan. I'll check on my side. Greatly appreciated.
Add a reply
Sign up and join the conversation on Discord