Hi everyone, I am having the use case to

I think this should just works out of the box with a website loader. You can find it in llama hub.

You might want to do some additional configuration to add the source URL as metadata. Let me know if you run into specific issues!

Yes, Simon! Currently using the (sitemaps.sitemap_search) method to get the list of urls of the website and using SimpleWebPageReader to index datasets from all the sitemap links, that part is complete. I will brief my use case; it is an e-commerce site. if the user input is like, "Do you have an iPhone 15 Pro Max?"

We need to give the response, and we also need to give the source url or the url and tell the user, Hey! Here is the link: https:// www.ecomerce.com/iphone-15-pro-max, please take a look.

@Navagridhar Ramsait C have you find out how to include the URL?