Find answers from the community

Updated 3 months ago

@Logan M i'm trying to run a custom

i'm trying to run a custom metadata extractor i built in an ingestion pipeline. Using GPT4o works fine but when i try and use anthropic LLM i get 'Anthropic' object has no attribute '_aclient'. Is this just not implemented or am i doing something wrong?
L
s
11 comments
hmm, are you using num_workers>1 ?
I think the client is not picklable, the OpenAI llm class is doing something dynamic, creating a client object each time instead
Anthropics LLM class would have to be updated to support the same
i'm using num_workers = 4
you mean on the pipeline.run right/
if you set it to 1, I think it will work
does that slow down the processing tremendously though?
or it shouldn't
Eh depends. Probably not that much, especially if you use async
@Logan M that worked! i don't fully understand why but will call it resolved for now πŸ™‚ thank you!
Add a reply
Sign up and join the conversation on Discord