Find answers from the community

Updated 6 months ago

any idea when the new gemma2 will be

any idea when the new gemma2 will be working?
Plain Text
llama_model_load: error loading model: error loading model architecture: unknown model architecture: 'gemma2'

cant wait to test it out 😍
W
D
4 comments
Are you downloading it from HF?
yes, from bartowski
im using it with llama cpp
Plain Text
llm = LlamaCPP(
    model_path=model_path,
    model_kwargs={
        "n_gpu_layers": 50,
        "grammar_path":"/home/_LLM/llama.cpp/grammars/json.gbnf",
        "repeat_penalty": 0.0},
    temperature=0.0,
    max_new_tokens=max_output_tokens,
    context_window=context_window,
    verbose=True
)
Add a reply
Sign up and join the conversation on Discord