I'm on the lookout for a robust indexing solution that can manage more than just a handful of files. I need a system that can index the entirety of my PC's hard drive, including a wide variety of file types like PDFs, Word documents, and emails. This system should not only establish an initial index but also dynamically update itself to reflect new changes, file modifications, and additions in real-time.
I understand there are many (and I have tried them) packages that handle file uploads, but my requirement is a comprehensive tool that can keep up with the evolving landscape of my entire filesystem, with AI-powered search and interaction capabilities, preferably integrating with OpenAI.
If anyone has leads on such a project or is interested in collaborating to create a solution I'd be thrilled to connect and discuss further.
I believe this is still a research-level problem, but you may be able to leverage Microsofts PowerAutomate Platform (I think there's a 90 day trial). One approach would be to use your OneDrive as your filesystem and then use PowerAutomate to listen to changes in OneDrive to index or preform other actions. To use OneDrive as an actual filesystem you may need a pro account tho.
PowerAutomate has integration with GPT4/OpenAI (actually, local models too) as well as Outlook and your other apps like Teams Chat. Even mobile stuff too I think. You can also setup webhooks so you can integrate any non-Microsoft thing.
As an example, earlier this year I used the PowerAutomate platform to create a kind of "life coach" based on my Dataverse. It's all drag and drop and there's even a copilot now so you can just speak what you want to do, but there's still a significant learning curve imo
