Find answers from the community

Updated last year

Hello Hope you all are doing great

Hello, Hope you all are doing great.

How to improve response time? I have used GPTList Index, and output result was good, but it took 8mins for getting answer.

can you please advice me how to impove response time?
o
k
L
5 comments
@Logan M , are you there?
response time from a LLM?
ohhhh, don't use listIndex. Use VectorStoreIndex, speeds things up by a mile
Yea, only use list index if you need to read an entire index. This is usually only useful for summaries.

But you need the LLM to read the whole index for a proper summary, so there's no way to get around this fact lol

The fastest list response will be from list_index.as_query_engine(response_mode="tree_summarize", use_async=True)
As I need to create summary, need to read an entire index
Add a reply
Sign up and join the conversation on Discord