LlamaIndex
Log in

Find answers from the community

Updated 4 months ago

Hi everyone, which open source LLM is

At a glance
nneil21621
·
Hi everyone, which open source LLM is recommended? I have 2xA6000(2x48GB) GPUs. Thanks
T
1 comment
TTeemu
You can check the leaderboard: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

Mixtral 8x7b should be runnable with that: https://www.llamaindex.ai/blog/running-mixtral-8x7-locally-with-llamaindex-e6cebeabe0ab
Add a reply
Sign up and join the conversation on Discord