Chat with Open Large Language Models

At a glance

The community member is looking for suggestions of non-OpenAI models that would work well with LlamaIndex. They have found one resource at https://chat.lmsys.org/?leaderboard, but are unsure if there are better or more specific resources available.

In the comments, another community member suggests the Hugging Face leaderboard at https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard as a helpful resource. However, they note that most open-source models are not great for complex tasks, and work best for basic Q&A. For more advanced features like routing engines, sub-questions, and structured output, most open-source models may not perform well.

The original community member acknowledges this context as helpful, and expresses hope that they can at least test the "best" open-source models, even if they may not be suitable for complex use cases.

Useful resources

ccodydh

Is there a good way to find a list or suggestions of non-OpenAI models that would work best for something like LlamaIndex? The only resource I've found is https://chat.lmsys.org/?leaderboard but I'm not sure if there are better/more specific resources?

2 comments

LLogan M

I find this one also useful https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

But tbh, most open-source models are not great for complex stuff yet. For basic Q&A, most work ok-ish. But for complex features (router engine, sub question, structured output), most open source models will not work well

ccodydh

Oh that's a very helpful guide, and good context. That was my suspicion, but I'm hoping that I can at least be testing the edges of the "best" open source models. Thank you!

Add a reply

Find answers from the community

Chat with Open Large Language Models