Incorporating OpenAI Realtime API with Llamaindex Workflows
Incorporating OpenAI Realtime API with Llamaindex Workflows
At a glance
The community members are seeking guidance on how to incorporate the OpenAI Realtime API with Llamaindex Workflows. They are familiar with Llamaindex but are unsure of how to use the Realtime API client provided by OpenAI. The community members received a response suggesting that the Realtime API is more user-facing and may not fit well into most code structures, but they could potentially create a workflow that wraps OpenAI's raw client. The community members indicate they now have a better understanding of the situation.
No problem, just have no idea where to start. We are very familiar with Llamaindex in general and have been working with it for a year. We have examined your Realtime API client but don't know what to do with it.
Not sure what you mean by "you don't know what to do with it"
The way the realtime api works, it doesn't really make sense to use in most code structures (since it is extremely user facing). The example with that client is really meant to just give it tools and let it run
You could theoretically make a workflow that wraps openais raw client if you wanted though
