Find answers from the community

Home
Members
TheMightyBono
T
TheMightyBono
Offline, last seen 3 months ago
Joined September 25, 2024
Hi , i m using a custom embedding , when updating the index is there a way to intiate using the gpu ?
cause ive a large data and updating the embedding in the documentstore using cpu takes really long :

Index the documents using the Llama index and the custom embedding

index = VectorStoreIndex.from_documents(documents,storage_context=storage_context,service_context=service_context)
10 comments
L
T
W
Hi , i m using a custom embedding , when updating the index is there a way to intiate using the gpu ?
cause ive a large data and updating the embedding in the documentstore using cpu takes really long :
# Index the documents using the Llama index and the custom embedding index = VectorStoreIndex.from_documents(documents,storage_context=storage_context,service_context=service_context)
4 comments
T
L
hello guys ive been trying to use awsbedrock with llamaindex but its triggring this error
"botocore.exceptions.NoRegionError:" You must specify a region.
while when i m using boto directely its working smoothly
i m following the documentation still generating the error , so it must be related to the boto package in llamaindex ?
i m looking to use the chat compeletion of llamaindex with whatever bedrock is providing from claude to meta etc etc .. can someone check and see if it needs a fix or i m doing something wrong from my side
2 comments
T
L
yes that one , but i want to understand something , whats the role of service_context in a llama index rag pipeline , when the tutorial set the gpt4 as service_contest.predictor, will we be using the custom embedding or open ai embedding when we are retreiving the document during the query decomposition ?
4 comments
T
Hi guys i m trying to use the LLama index Single-Step Query Decomposition,i read the documentation but it still a lil bit blurry , when the question is decomposed using gpt , is there a communication to the retreiver ? or is the decomposition is just using the GPT ? ( i m following this notebook example you guys posted https://github.com/run-llama/llama_index/blob/main/docs/examples/composable_indices/city_analysis/City_Analysis-Decompose.ipynb)
5 comments
W
T