I am finding myself at this stage shopping for a new LLM for my RAG chatbot. It has to be capable of answering questions about a data/vector store that is almost entirely about an actual person, not "private" data but about a real human. Open source is cool, not a necessity though. Any suggestions welcome! I am thinking OpenAI is a decent option but if it actually can't do private data RAG and doesn't document this important detail PLEASE LET ME KNOW. (looking at you, Google.... 🤦🏻♀️)
Mistral AI is looking pretty neat for now. I like to do stuff for $0 ✌🏻
