LlamaIndex
Log in

Find answers from the community

Home
Members
jagadeeshj
j
jagadeeshj
Offline, last seen 3 months ago
Joined September 25, 2024
jjagadeeshj
·

Node parers

Hi all i am using simplenodeparser to split document to nodes and the document is split into 6 nodes. Is there any way the split the document into much smaller nodes
Plain Text
documents = SimpleDirectoryReader('/home/ubuntu/llama_index/examples/paul_graham_essay/data').load_data()

parser = SimpleNodeParser()

nodes = parser.get_nodes_from_documents(documents)
index = GPTSimpleKeywordTableIndex(nodes, service_context=service_context)
3 comments
L
j
jjagadeeshj
·

Hi all I am trying to run a query from

Hi all, I am trying to run a query from examples and it is taking more than 30 mins. I am using 4 A10 GPUs to load model

Plain Text
max_input_size = 1024
num_output = 64
max_chunk_overlap = 20
prompt_helper = PromptHelper(max_input_size, num_output, max_chunk_overlap)
llm_predictor = LLMPredictor(llm=CustomLLM())
embed_model = LangchainEmbedding(HuggingFaceEmbeddings())
service_context = ServiceContext.from_defaults(llm_predictor=llm_predictor, prompt_helper=prompt_helper, embed_model=embed_model)
documents = SimpleDirectoryReader('/home/ubuntu/llama_index/examples/paul_graham_essay/data').load_data()
parser = SimpleNodeParser()
nodes = parser.get_nodes_from_documents(documents)
index = GPTSimpleVectorIndex(nodes, service_context=service_context)
response = index.query("What did the author do growing up?", service_context=service_context, optimizer=SentenceEmbeddingOptimizer(percentile_cutoff=0.5))
24 comments
j
L