LlamaIndex
Log in

Find answers from the community

Updated 2 months ago

Extensions

ddean
·
What is the default behaviour of load_data() on SimpleDirectoryReader Surprised to see it return 9 items from a directory with just one readme.md file! required_exts is just .md is it auto parsing into markdown nodes?
L
d
3 comments
LLogan M
Every file extension has its own loader. Some loaders make some decision on how to best split into document objects

You can always write your own loader for certain types and use it with simple directory reader
ddean
I see. I did notice a Markdown Loader on the llamahub
LLogan M
https://github.com/run-llama/llama_index/blob/b26112b02be29eed82fc2b808eaf55bc51e472c7/llama-index-core/llama_index/core/readers/file/base.py#L68
Add a reply
Sign up and join the conversation on Discord