Find answers from the community

D
Dove
Offline, last seen 3 months ago
Joined September 25, 2024
D
Dove
·

```

Plain Text
import logging
import tqdm
import sys
from importlib import reload

reload(logging)
logging.basicConfig(format='%(asctime)s %(levelname)s:%(message)s', stream=sys.stdout, level=logging.DEBUG, datefmt='%I:%M:%S')
logging.getLogger().addHandler(logging.StreamHandler(stream=sys.stdout))

response_synthesizer = get_response_synthesizer(
    service_context=service_context,
    response_mode='compact'
)
response = response_synthesizer.synthesize(
  prompt,
  nodes=retrieved_nodes
)
display_response(response)


Nothing gets printed to the logger. Could you please help me figure out the issue here?
11 comments
D
L
What is the fastest way to build vector index from nodes with precomputed embeddings?

Is it just index = VectorStoreIndex(nodes)?

It still seems to take a long time (20mins for 400k nodes), considering that the embeddings for nodes are already computed.
12 comments
L
D
Hello, what is the proper way to unload HuggingFaceLLMPredictor, LangchainEmbedding and ServiceContext to release GPU memory? Thanks
3 comments
D