Find answers from the community

Home
Members
joao_pt
j
joao_pt
Offline, last seen 3 months ago
Joined September 25, 2024
Hello everyone, I'm doing a simple QA using below structure:
0) "Context text: (45,000 characters)"

1) Indexing context text using:
-- -- llama_index.indices.list.base.ListIndex (GPTListIndex)
-- -- service_context: OpenAI("GPT-3.5-Turbo") + callback_manager(LlamaDebugHandler)
-- -- Creating a query engine with QuestionAnswerPrompt + RefinePrompt

2) With the created Query Engine on point 1):
-- performing a query

The response is not working as well as I wished in some cases.
In order to understand better I tried to dig into the structure and debug. One of the things that jumped into my attention is that the response has the nodes sent to the GPT (14 nodes) and they don't have any score on any of the nodes.
So the question is... is it normal that (llama_index NodeWithScore) doesn't contain any score in any of the nodes returned?
8 comments
j
L
Hi guys quick question...
Is Llama Index able to transform between Unstructured data (ex: raw text) --- into ---> Structured Data (ex: JSON) ?
2 comments
j
L
j
joao_pt
·

Saving

Is there any way to save a llama_index.indices.vector_store.base.VectorStoreIndex ?
I don't seem to find any method for it... I could always try pickle or joblib... but not sure it will workout.
5 comments
j
L