Find answers from the community

Updated 7 months ago

Has anyone been able to get a grammar

At a glance

The post asks if anyone has been able to get a grammar file working in the Llama-cpp. The comments indicate that there are two issues: Lamaindex does not support the grammar_path attribute in their Llama.cpp, and the default grammar file in Llama.cpp causes issues, so an older grammar file needs to be used. One community member mentions using cpp in the backend, and another community member says they have used Lamma Index to import a Langchain Model and used Langchain to use a Llama.cpp model, but they don't think this is a good way to do it. There is no explicitly marked answer in the comments.

Has anyone been able to get a grammar file working in the Llama-cpp?
D
C
3 comments
there are 2 issues...
  1. Lamaindex does not support the grammar_path attribute in their Llama.cpp Model
  2. Llama.cpps default grammar file somehow causes issues and u need to use an older one
yea using cpp in the back end.
i have used Lamma Index to import a Langchain Model and used Langchain to use a Llama.cpp model... but i dont think this is a good way to do it
Add a reply
Sign up and join the conversation on Discord