Find answers from the community

Updated 2 months ago

Nodes

i think the answer is no but just checking
L
i
5 comments
We really should add that lol

Just that all the current ones are CPU bound for the most part lol
@Logan M I can take a look today to see what it would require
From what I’m seeing they’re not all cpu bound tho
It’s a lot of I/O with LLMs or re-ranker models over HTTP
Yes very true. I think it's as simple as adding async to the base class, and ensuring async gets used when needed
Add a reply
Sign up and join the conversation on Discord