LlamaIndex
Log in

Find answers from the community

Updated 3 months ago

is it recommended to pre process data

AAzru
·
is it recommended to pre process data before using it with llamaindex ? Seems I have much better results when parsing everything into a text file and passing it to llamaindex
s
T
A
3 comments
ssansmoraxz
depends on what you are passing it to. Most parsers do have some form of preprocessing viz chunking, annotating and such already defined.
TTeemu
What was the original format of the data?
AAzru
pptx and csv but some have some images so it might be difficult for the parsers to pre process it ?
Add a reply
Sign up and join the conversation on Discord