Find answers from the community

Updated 3 months ago

is it recommended to pre process data

is it recommended to pre process data before using it with llamaindex ? Seems I have much better results when parsing everything into a text file and passing it to llamaindex
s
T
A
3 comments
depends on what you are passing it to. Most parsers do have some form of preprocessing viz chunking, annotating and such already defined.
What was the original format of the data?
pptx and csv but some have some images so it might be difficult for the parsers to pre process it ?
Add a reply
Sign up and join the conversation on Discord