Find answers from the community

Updated 3 months ago

Scrape

Hi Everyone, is there a tool or abstraction in llama index with which i could get details scraped from the internet for example:

"Im a buyer at Walmart. Im looking for suppliers for: Carton boxes with window for Pizzas in North America: The US, Mexico and Canada. I need a list of 200 suppliers. Just the suppliers and their website."

6 comments

LLogan M

I know firecrawl just added a search mode

llancerninja

perplexity api do this natively i think, but i was thinking if i could do this with openai

llancerninja

ChatGPT also connect with internet now by default but api still doesn't support yet

LLogan M

It'd be pretty complex -- you need to prompt the llm to navigate a website, follow links, go back, etc

LLogan M

Essentially and agent with tools

llancerninja

hopefully openai release some tool to surf in api

Add a reply