LlamaIndex
Log in

Find answers from the community

Updated 4 months ago

Hey do i need a GPU to use the

SSaltuk
·
Hey do i need a GPU to use the FlagEmbeddingReranker (that use the BAAI models)? I tried to execute it but got an error... If yes, what kind of GPU do i need at the least? Thanks for any input.
W
S
2 comments
WWhiteFang_Jr
You can do it on CPU too but it will be very slow. GPU depends on the model and model size you are going with.
SSaltuk
Are you sure? IN this blog article
https://medium.com/llamaindex-blog/fine-tuning-embeddings-for-rag-with-synthetic-data-e534409a3971
They say that fine-tuning is light-weight and can be done on a macbook with an M2
Add a reply
Sign up and join the conversation on Discord