Find answers from the community

Home
Members
tomjohnslivers
t
tomjohnslivers
Offline, last seen 3 months ago
Joined September 25, 2024
Hello, everyone. I'm looking for some advice on efficient PropertyGraphIndex indexing practices, with the hope that there are ways to speed up the embedding and indexing process.

I'm currently processing a large amount of JSON data, across around 15 separate documents, and using the JSONNodeParser() and parser.get_nodes_from_documents() to extract the JSON objects as Nodes. I'm then using Ollama and OllamaEmbedding models to push them to a Neo4j instance using ProperyGraphIndex. I've had some success on individual smaller files, but it's looking like it'll take many, many, hours to complete the embedding and indexing process for everything. I'm prepared to just "hurry up and wait" if there's no other options, but I figured I'd reach out to the community and see if there are recommendations on ways improve processing times before I just let it run. Any and all feedback is welcomed and appreciated. Thanks!

P.S. If any other info on my current workflow would be helpful, I'm more than willing to provide it!
6 comments
t
L