Azure

ttheta

Hi everyone! I'm getting started with LlamaIndex and really liking it so far. I was wondering if anyone has been successful creating a storage_context with an azure container blob? I was able to persist() the index no problem using an fsspec instance and can list the files using the fsspec instance. however, when I try to create a storage context with the fsspec instance it only returns an HttpError (no resource). fs1 = fsspec.filesystem("abfs", account_name="name", account_key="key") AZURE_CONTAINER = "report-stores" sentence_index.storage_context.persist(persist_dir=f'{AZURE_CONTAINER}', fs=fs1) print(fs1.ls(AZURE_CONTAINER))

['report-stores/docstore.json', 'report-stores/graph_store.json', 'report-stores/index_store.json', 'report-stores/vector_store.json']

sc = StorageContext.from_defaults(persist_dir=f'{AZURE_CONTAINER}', fs=fs1) <-- HttpResponseError Does anyone have any recommendations? cheers!

6 comments

LLogan M

Hmm, I'm not really sure. Tracing the code path it just ends up calling this

https://github.com/jerryjliu/llama_index/blob/31666919f43ed99d62ca5865fd6327892c45a949/llama_index/storage/kvstore/simple_kvstore.py#L75

ttheta

thanks for checking @Logan M

LLogan M

Maybe try calling fs.open yourself to try and debug 😅 could be an easy fix missing for reading

ttheta

I'm not sure what that means. how do I create a storage context without passing the fsspec instance? I can use the fsspec instance to list the files in the blob and it works fine. I also tried using fs2 = AzureBlobFileSystem(account_name="name", account_key="key") but that didn't work either.

LLogan M

I just mean using fs.open like the code snippet I linked to

LLogan M

Just to see if you can actually open and read the file

Add a reply

Find answers from the community

Azure