Integration with nvidia nv-ingest that was recently published
Integration with nvidia nv-ingest that was recently published
At a glance
The post inquires about the possibility of integrating with the recently published NVIDIA nv-ingest tool. The community members discuss the tool's requirements, such as needing a large amount of space and memory. One community member mentions previously trying to develop a PDF data parser and stumbling upon nv-ingest, suggesting that the tool could be used to parse and store data in nodes. Another community member agrees, noting that the tool provides a structured JSON format that could be used for this purpose. However, the community members also acknowledge the challenge of convincing their boss to purchase a large number of GPUs required for the implementation.
I dont know if you remember but i tried developing my own parser for .pdf data (to try to match at least some capabilities of llama-parse). During my research I have stumbled upon this nv-ingest. If I understand correctly the nv-ingest could then be parsed to nodes and stored.
Yeah, now I just need to sale the idea of 30k GPUs a piece to my boss hehe... Thanks for feedback! If you will be doing any implementation or other form of nvidia collab I would be glad to help.