Find answers from the community

Updated 5 months ago

Has anyone been able to get a grammar

Has anyone been able to get a grammar file working in the Llama-cpp?
D
C
3 comments
there are 2 issues...
  1. Lamaindex does not support the grammar_path attribute in their Llama.cpp Model
  2. Llama.cpps default grammar file somehow causes issues and u need to use an older one
yea using cpp in the back end.
i have used Lamma Index to import a Langchain Model and used Langchain to use a Llama.cpp model... but i dont think this is a good way to do it
Add a reply
Sign up and join the conversation on Discord