Find answers from the community

Updated 2 years ago

load multiple embeddings files

Hey guys is there a way we can load multiple embeddings files in one go, let's say my index_file is a kind of array or list or a directory.

Plain Text

index = GPTSimpleVectorIndex.load_from_disk(index_file, service_context)

5 comments

any help or reference @Logan M

Sorry, load from disk is only made for one file at a time 🤔

So, do we have any other method to resolve this problem ?

I think there's a few option

create all the embeddings in one file to start with (this is usually the easiest option tbh)
use each index in a composable index, maybe with a top level index (list, tree, etc,)
use each index with the new router abstraction (requires upgrading llama index, which will break a few things and change how some functions work)
create a custom retriever (again, requires updating)

There's maybe some other hacky ways, but tbh I would just recreate the index if possible

let me check this one

Add a reply