Find answers from the community

Updated 12 months ago

I tried but couldn't get it work. Most

I tried but couldn't get it work. Most likely, because I need to use 'spawn' method for GPU and llama_index might be setting it to 'fork' somewhere in the code? Getting this error: RuntimeError: context has already been set

2 comments

LLogan M

I mean, it might depend on which LLM or other features you are using. Never seen fork or spawn used anywhere in the codebase

AAnurag Agrawal

I am using llama-cpp for LLM and BGE for embedding. I am also using torch. Will go and check if torch sets this method explicitly. Thanks @Logan M

Add a reply