Find answers from the community

Updated 4 months ago

Llama Hub

At a glance

The community member is asking for recommendations on the best webpage loader from https://llamahub.ai/ for scraping all the text from a URL, or one that can convert a web page to PDF format before scraping/loading it. Another community member suggests beautiful soup or unstructured as potential options, but there is no explicitly marked answer.

Useful resources

BBP

hey everyone, out of all the webpage loaders from here: https://llamahub.ai/ which one is the best at scraping all the text from a URL?

Alternatively, is there one that can convert a web page to its pdf format before scraping/loading it?

Many thanks 🙏

2 comments

LLogan M

probably beautiful soup or unstructured

BBP

thank you! ❤️

Add a reply