I think you are trying to tackle 2 different problems: 1) search 2) understanding customer needs. You are starting from the former to get to the latter - wouldn't be better to first design an LLM to understand the needs and then query your data store?

The process can be iterative, but at least you narrow down the search at the very beginning.

General question - Has anyone tried to find all the documents that relate to a single document? I was thinking of getting a query prompt from the document and searching the documents by combining multiple indices, but there might be an easier way to solve.