Find answers from the community

Home
Members
David Akinpelu
D
David Akinpelu
Offline, last seen 3 months ago
Joined September 25, 2024
Hello, I am trying to benchmark performance of some open source models on a custom datasets using HuggingFaceLLM method in llamaindex. I want to test the models sequentially. How do I remove a particular model from the GPU before moving the next model to the GPU?
2 comments
D
r
Hi guys, is llama-index planning to implement Colbert as a reranker feature soon?
2 comments
D