Hello, New here I want to build a search engine like a QnA bot a user can have files like pdf, txt, words etc. Then he/she could question and bot should be able to answer and specify source files etc for more details, how can i achieve this as many users be uploading files a cannot load full index in memory to server if for example each user has 1 GB of data for n number of users.
@hammad Using the SimpleDirectoryReader, most combinations of files will work fine. Just have to save the files to disk temporarily and point the reader to them