Find answers from the community

C
CamBoy
Offline, last seen 3 months ago
Joined September 25, 2024
C
CamBoy
·

Indexing

Help with creating a vector store. TQDM progress bar sits at 0% until it completes (if it completes). Perhaps I'm going about this incorrectly somehow. Creating a VectorStoreIndex.from_documents is taking a monumental long time.
Plain Text
llm = Ollama(model="llama3", request_timeout=360.0)
Settings.llm = llm

num_workers = 2
transformations = [
    SentenceSplitter(chunk_size=512, chunk_overlap=25),
    SummaryExtractor(llm=llm, num_workers=num_workers),
    QuestionsAnsweredExtractor(llm=llm, num_workers=num_workers)
]
10 comments
L
C
W