Hello! I'm working on getting Vicuna 13B to operate on an A100, but I keep encountering a CUDA memory error.

Could there be an issue with the code following the tutorial? Or is it more likely that I need to change this Vicuna model because it's not well-optimized? I appreciate any help you can provide! 🙂