LlamaIndex
Log in

Find answers from the community

Updated 4 months ago

4o-mini

NNiels
·
Anyone else had experience that 4o mini was a lot slower than 3.5 turbo?
L
N
7 comments
LLogan M
Me as well
LLogan M
3.5 turbo is still the king for speed
NNiels
Cool
NNiels
Kind of weird that they market it as a next gen replacement for 3.5 turbo
LLogan M
I agree. I wonder if they released it before they could scale their backend properly
NNiels
Ahh interesting
NNiels
I think the initial delay is huge too, time to first token
Add a reply
Sign up and join the conversation on Discord