Find answers from the community

Updated 3 months ago

I'm creating a FastAPI to use

I'm creating a FastAPI to use VectorStoreIndex with HuggingFace LLM and embed model. When I am running the FastAPI app on my local Mac M1 and sending a request to it, I am getting this error:
Plain Text
RuntimeError: MPS backend out of memory
. Has anyone dealt with this before?
Add a reply
Sign up and join the conversation on Discord