Find answers from the community

c
cincy
Offline, last seen 3 months ago
Joined September 25, 2024
how to use query with question answer prompt with chat open ai?
3 comments
k
c
cincy
·

Sql langchain

Hi, how to use langchain SQLDatabase Chain with embedded table schema index? Llamaindex provide option to store embedded table schema index from service context. Then how to use similar one from Langchain?
9 comments
L
c
c
cincy
·

Length cutoff

Hi I'm using summary prompt, and calling LLM(prompt) to generate a summary based on user query and context. However, when I tried to print the summary response, seems the response does not show fully. Only shows partial response. Is there anything I'm missing? Or there are length rescrict?
22 comments
c
L
Hi, I'm using Langchain SQLDatabase to wrap with actual SQL database connection, but creating SQLDatabase object takes long time, over 2m sometimes. Is there any way to make it faster? Seems only creating SQLDatabase object takes a long time. Without creating this object, just create SQLAlchemy engine to connect to db is really fast. Why creating Langchain SQLDatabase object takes such a long time? Is there any way to faster it?
6 comments
j
c
Hi, have question regarding using LlamaIndex GPTSqlIndex to call LLM and generate SQL query. 1. By using text to sql prompt, sometimes SQL query generated by LLM is still not accurate. In order to guarantee accuracy, can refine prompte be added with text to sql prompt? Will that be more accurate? 2. And is there any way to add some SQL validator after LLM generate SQL, but before it actually executes it? 3. In order to build SQL index and use for query, need to wrap LLM with SQL Database, which takes a long time. Is there any way to let it once connected, connected for a long time?
15 comments
c
L
Thanks Logan. And one more question, what is the difference actually for the text-to-sql prompt template included in GPTSqlStoreIndex, and the table_context_prompt included in SQLContextContainer? I assume table_context_prompt is to put template for table schema selection, and text-to-sql is more for sql query based on selected table schema from context container. However, sometimes even though I add some context_str in table_schema_context like "if usage query amount, it means RevenueTotal column", it still does not select this RevenueTotal column from table schema, so later SQL query failed.
20 comments
c
L
M