Node mappings

The community member is creating a list of nodes and retrieving their mappings, similar to the example in the (create_llama) project. The nodes are stored in OpenSearch, and the question is how to effectively store the node_mappings. The example uses pickle files, but the community member is concerned that this may not scale well when dealing with thousands of mappings for thousands of files. The community member is asking if there is native support for a database to store the mappings, or if there are examples of storing them in a scalable solution like Redis, OpenSearch, PostgreSQL, or S3.

In the comments, one community member suggests storing the node mappings in Redis or an SQL database, as it is not too difficult to do. Another community member agrees, but raises the concern that loading thousands of mappings in-memory might be expensive. They suggest that the node_dict attribute of the RecursiveRetriever should be able to query the mappings dynamically on a storage context built for that purpose. The community member wants to ensure they are framing the problem correctly.