Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 2 months ago
0
Follow
Nvidia nvlm support
Nvidia nvlm support
Inactive
0
Follow
a
anjin
2 months ago
Β·
do we have support for the new NVLM from NVIDIA?
L
a
7 comments
Share
Open in Discord
L
Logan M
2 months ago
NVLM? Link?
a
anjin
2 months ago
https://huggingface.co/nvidia/NVLM-D-72B
L
Logan M
2 months ago
oh -- we just merged a multimodal huggingface llm class, so it might be supported there. Not sure yet tbh though
L
Logan M
2 months ago
Its not supported by ollama either, which is annoying
L
Logan M
2 months ago
its also 72B, so you'll need a loooot of GPU
a
anjin
2 months ago
oh yes was hoping for a load_in_4bit option π
L
Logan M
2 months ago
ah yea, huggingface will probably let you do that (probably)
Add a reply
Sign up and join the conversation on Discord
Join on Discord