Find answers from the community

Updated 6 months ago

Multi -modal

At a glance

The community members are interested in learning about multi-modal use cases using Llamaindex and Weaviate, as well as how to store image documents in Weaviate using Llamaindex. They have found a tutorial for Chroma in Llamaindex, and an article on multi-modal capabilities in Weaviate, but are unsure if the Llamaindex Weaviate class can handle this functionality. One community member suggests storing the image separately and just having a link to it in the metadata, while another asks if it's possible to load and store images in the Weaviate database using the Llamaindex class. The community members have tried some examples but have encountered issues, and are looking for suggestions on which database to use for multi-modal capabilities.

Useful resources
Hi, is there any tutorial on Multi-modal uscases using Llamaindex and weaviate? or is there any tutorial on how to store image document in weaviate using llamaindex?
W
L
P
10 comments
There is a tutorial for chroma in llamaindex: https://docs.llamaindex.ai/en/stable/examples/multi_modal/ChromaMultiModalDemo.html


Found one article on weaviate but not sure if llamaindex weaviate class is updated to handle this or not.

https://weaviate.io/blog/multimodal-rag
normally you'd just store the node in the db, and store the image somewhere else (s3? to disk?) and just have the link to the node in the metadata
My question is more towards if we can load and store images in the weaviate db using llamaindex class the same way as the documents?
its not apparently, I tried
I don't think so right now? Or at least i haven't tried
Give it a shot if you want
Its not working- getting error on index.as_query_engine() part
but it's working as a retriever
Also, can you suggest me which DB to use for Multi-modal capabilities?
Add a reply
Sign up and join the conversation on Discord