Find answers from the community

Updated last year

Is there a way to parse nodes from

At a glance

The community member is asking if there is a way to parse nodes from documents using a GPU, as generating embeddings is fast but node parsing is a bottleneck. A comment from another community member suggests that node parsing is a sequential process and not using a GPU, but they mention that adding multiprocessing in batches of documents could be a potential solution.

Is there a way to parse nodes from documents with gpu? Generating embeddings is lightning fast, but node parsing seems to be the bottleneck for me.
L
1 comment
nope πŸ™‚ It's not using a gpu or anything, its just a very sequential process

You could multiprocess this in batches of documents though

(tbh adding multiprocessing for this might be a cool PR)
Add a reply
Sign up and join the conversation on Discord