Find answers from the community

s
F
Y
a
P
Updated 10 months ago

looks like 13b model takes up like 40GB

looks like 13b model takes up like 40GB of ram lmao
S
s
V
4 comments
Which 13b model are you running, and how are you running it?
Turns out 20gb was my web browser. Still it’s more than the 8gb of vram I’ve got
Add a reply
Sign up and join the conversation on Discord