LlamaIndex
Log in

Find answers from the community

Updated 3 months ago

Gpu

rronelmg
·
anyone getting this issue running multiple GPUs?
Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1! (when checking argument for argument index in method wrapper_CUDA__index_select)
L
1 comment
LLogan M
You can try explicitly setting the device in the constructor

HuggingFaceEmbedding(..., device="cuda:0")
Add a reply
Sign up and join the conversation on Discord