hi, does anyone have token counting working for streaming? seems prompt and completion tokens are not tracked. in verbose counter logs it seems prompt and completion events are not raised
has anyone seen "cross talk" for multi user streaming response? i'm seeing when 2 simulatneous streaming chat calls cause the response streams to cross talk.