LlamaIndex
Log in

Find answers from the community

Updated 6 months ago

Hello @Logan M , @WhiteFang_Jr .

ppavan._01
·
Hello @Logan M , @WhiteFang_Jr .

I'm building a RAG system and looking for the best URL reader in LlamaIndex to load URLs and extract text for vector storage. Any suggestions?
W
a
p
4 comments
WWhiteFang_Jr
You can check https://llamahub.ai/ and type url and the list will show url readers that are present in llamaindex.

LlamaIndex recently added Firecrawl: https://docs.llamaindex.ai/en/latest/examples/data_connectors/WebPageDemo/?h=firecrawl#using-firecrawl-reader

This looks pretty neat! You can give this a try as well
aandysingal
i have worked with it ... also check Scrapefly
ppavan._01
@WhiteFang_Jr Thank you !
ppavan._01
Sure , @andysingal .
Add a reply
Sign up and join the conversation on Discord