Find answers from the community

Updated 2 months ago

Hello, just a quick question, does

Hello, just a quick question, does anyone know how to use an already downloaded model using the HuggingFaceLLM class ?, for example is there an option to input the directory of the already downloaded model instead of having to download it in the cache ?
N
g
3 comments
llm = HuggingFaceLLM(
model_name="/path/to/model",
tokenizer_name="/path/to/model",
Thank you so much
no problem. Good luck with your application
Add a reply
Sign up and join the conversation on Discord