“Llama generate prefix match hit”

llama.cpp has some sort of built-in cache, that just means your generation will be faster... I think

Setting verbose=False on the LLM object should hopefully reduce the amount of logging, althogh the llama.cpp library is pretty noisy in general

It's just a notification though, nothing to worry about 👍

Awesome, thanks!