Hi guys, I am building a chatbot using OpenAIAssistantAgent but it takes 10+ seconds to generate an answer. Is there any way to improve the speed of response?
You can implement streaming to make it feel faster.
It depends on the length of your answers but in most cases generating answers faster than 10 seconds is unrealistic. Also OpenAI API's suffered from degraded performance the last couple of days.
