Find answers from the community

Updated 2 years ago

Images

At a glance
Text with some images -> Some client writes me a message "my bike is broken! pedals make noise!" and I want my app to generate answer based on a bunch of manuals (including text with a lot of photos) "Dear Peter, you need to grease the pedal bearing, as shown on this photo [photo1.jpg]" - is there a solution for this? In other words, can LLM generate text+image answers, with images put in between the text paragraphs, just like in a typical manual?
L
w
3 comments
Hmm, I feel like if you included a related image in the metadata of nodes, this could be possible? So that if that node is used to answer a query, show the user the related images?

response = query_engine.query(...)
response.source_nodes[0].metadata["image"]
Yes, I thought about it, but I would have to carefully cut text into pieces, not just chunks of defined length with overlap
Yea exactly, it would have to be pretty custom
Add a reply
Sign up and join the conversation on Discord