Find answers from the community

Updated last year

Web Connector

At a glance

The post mentions that recursive calling is not yet supported, but community member @Emanuel Ferreira has built a tool to help with recursive crawling, with a GitHub repo provided. The comments suggest that there are a few options on llama_hub that could also be useful, and that the community members will need to adapt the tools to their specific use cases. Another community member also found a related project on GitHub that seems suitable for their needs.

Useful resources
They don't support recursive calling yet I think, but @Emanuel Ferreira has built something that can help you with recursive crawling.
Here's the GitHub repo: https://github.com/EmanuelCampos/monorepo-llama-index
E
K
3 comments
You'll just need to adapt to your use case, but all these works
Thanks !! I also found https://github.com/emptycrown/llama-hub/tree/main/llama_hub/web/sitemap that seems to be good for my particular use-case.
Add a reply
Sign up and join the conversation on Discord