I've read through all the docs, but I'm having trouble translating the concepts you describe in terms of the use-cases in general. I'm a datascientist with a good amount of NLP experience but still having some trouble mapping the different concepts into GPT Index. If the source data isn't essay data, will I still benefit a good amount?
@xmalina ooc what's the data source? GPT Index is a general purpose tool over your text data. You can just feed arbitrary text documents into GPT Index, and then feed in an input prompt to get your answer
i think if you have tabular data it is better to put that in a structured DB like SQL and then show columns in the prompt and when a user asks a question like that, you generate the query
There's a TODO for GPT Index to support structured formats by 1) supporting natural language to SQL, and 2) autoinferring schemas. I'm super excited about this direction. @xmalina in the meantime you could try a listindex over your spreadsheet data and seeing if that gives you adequate responses, but admittedly it will be a bit more expensive due to LLM calls