Hi guys
How can I make my Text to SQL pipeline more faster
Currently I am using the llama-index Text-to-SQL query pipeline following the guide here
https://docs.llamaindex.ai/en/stable/examples/pipeline/query_pipeline_sql/I retrieve only the SQL query then execute it myself. Then the result is pass to an llm that synthesis a response.
This takes about 7 seconds to run and return the result to a front end.
The bulk of the time were consumed on the text-to-sql pipeline and the response synthesizer.
Is there a tip on how to make the system more faster