Hey all! I've got streaming responses working on a token level, but now I'd like to move into passing more complex JSON objects through the streaming interface. Something like passing document metadata back to our front-end. I've found a few closed issues on the repo asking about something similar but I'm unable to surface an example. Has anyone tried this yet and/or is there a working example I might reference?
Nevermind, I think I got it. I just passed a serialized JSON object to the FastAPI StreamingResponse and I got what I need, I think. Either way, if anyone else has any ideas, I'm open 🙂
