Find answers from the community

Home
Members
Sumemerboy
S
Sumemerboy
Offline, last seen 4 months ago
Joined September 25, 2024
Plain Text
def stream(response_stream):
    # Iterate over the response generator and send each part
    for text in response_stream.response_gen:
        yield {"message": text, "end": False}  # Add an 'end' field with value of False

    print("\n","Total LLM Token Count: ",token_counter.total_llm_token_count,"\n")

    # When finished, yield a final message with 'end' set to True
    yield {"message": "Finished", "end": True}
7 comments
S
L
E