Hi everyone!

wwrapdepollo

Hi everyone!
Wanted to see if anyone could give me a hand with my error. I'm trying to compare 2 embedding models (so the combination model/embedding). I'm using BGE-base and a more context-specific huggingface model. Everything works fine when creating the vector index with BGE, however with the same params the other model crashes (RuntimeError: CUDA error: device-side assert triggered), I'm guessing probably by a shape mismatch, but I'm not quite sure where to check this. Thanks for any feedback!

2 comments

LLogan M

wow, I really need to fix this lol

roberta-based models seem to indicate that their max length is 514 in their config.json, but really, the max length is 512

Try setting max_length=512 in the constructor for the embedding model that is failing

wwrapdepollo

Cheers Logan! Unrelated (and maybe dumb) question if I may, right now I'm using the HuggingfaceEmbedding constructor, is there any constructor for local models?

Add a reply

Find answers from the community

Hi everyone!