Building a local parser similar to llama-parse

Question

Are there any good resources for building a parser similar to Llama-Parse? My issue is that, due to data safety, we cannot use any cloud providers and must rely on a local LLM and embedding model. I'm watching Jerry Liu's Ray Summit 2024 video and am considering how I might replicate at least some of the basics. Cheers!

WhiteFang_Jr · Answer

You can check Unstructured it is good

WhiteFang_Jr · Answer

in terms of Open-source, but it wont be able to match llama-parse

LoLiPoPMaN · Answer

UnstructuredElementNodeParser ?

WhiteFang_Jr · Answer

Yes, this would work

Logan M · Answer

Actually, I think just the normal unstructured reader/loader is what you want

LoLiPoPMaN · Answer

I will take a look! Thanks to both of you! Cheers!

Find answers from the community

Building a local parser similar to llama-parse