So, I took the Postgres repo, dumped all of the source code and documentation files into an index.
It came out to +1.5GB, and my WSL2 box goes OOM sometimes when trying to read from it 😬
]$ ls -lh ./index
total 1.7G
-rw-r--r-- 1 user user 121M Jul 2 19:06 docstore.json
-rw-r--r-- 1 user user 18 Jul 2 19:09 graph_store.json
-rw-r--r-- 1 user user 3.8M Jul 2 19:06 index_store.json
-rw-r--r-- 1 user user 1.6G Jul 2 19:09 vector_store.json
How much memory should a machine have for trying to call
load_index_from_storage() on this?
