Find answers from the community

Updated 2 months ago

Graph index

my code looks liek this: for text in texts:
if self.find_matching_keyword(text, key_words_for_remove_unneeded_text):
dc = GPTListIndex.from_documents([Document(text)])
tree_index_list.append(dc)
tree_index_summary.append(str(text))

loop_time = time.time()
print("Loop time: {:.6f} seconds".format(loop_time - filter_time))
L
J
4 comments
So your graph is a bunch of list indexes with a tree index on top?
does it help to chunk them into smaller ones?
So, with a list index, it will check EVERY node in that list index. So if there are a lot of documents in there, it will take some time

Typically a list index is best for generating summaries. Maybe you'd have more luck using vector indexes instead?
Add a reply
Sign up and join the conversation on Discord