Find answers from the community

Updated 2 months ago

Is there anyone here who has worked on

Is there anyone here who has worked on creating a pipeline for chatting with SQL using Open-source LLMs and getting good results?
T
a
6 comments
Generally open source LLMs aren't great with structured data 🤔
Which models have you tried?
Thanks for your response
I have tried too many models.
The issue is sometimes models are generating correct sql query, however , response the main query so weird!

I believe the NLSQL query is not powerful enough! Because gpt3.5 is also can't answer all the questions.
I wanna see if there's any better options such as using agents. The problem is even agents are tailored for OpenAI models🥴
Btw, among the employed LLMs, Zephyr was the best
But not enough good
Yeah you probably need one of the larger models, maybe mixtral could work
Add a reply
Sign up and join the conversation on Discord