Llm

Question

Which llm is fastest has least response time when deployed as a chatbot@Logan M @WhiteFang_Jr

WhiteFang_Jr · Answer

You could try using llms from grok or cerebras platform. They claim to provide fastest text generation.

saika · Answer

depends of the model param and the infra, expect slower token/second on high parameter model. Grok infra claim to be one of the fastest in the field

Pragyan Mohapatra · Answer

I don’t think it is opensource. Also can you suggest how can I add human feedback loop to train the model to give better response@WhiteFang_Jr @saika @Logan M

Find answers from the community

Llm