Find answers from the community

Updated 10 months ago

llama_parse/examples/demo_advanced.ipynb...

This is probably a very stupid question, my apology in advance.

If I follow any of these two guides:
https://docs.llamaindex.ai/en/stable/examples/usecases/10q_sub_question.html
https://github.com/run-llama/llama_parse/blob/main/examples/demo_advanced.ipynb
And I use say Anthropic for llm, and OpenAI for embedding. Is my data accessible only to OpenAI and Anthropic? Or does it get shared with Llama-index too?
L
M
a
13 comments
Only with openai and anthropic
oh wait, theres a llama-parse notebook
so with llama-parse/llama-index as well
oh wait , i do?
i seem to be getting good results with this guide https://docs.llamaindex.ai/en/stable/examples/usecases/10q_sub_question.html
no use of llama-parse
what are the benefits of using llama-parse vs this one?
llama-parse is just more advanced document parsing, especially around tables
yea, calling llama-parse API
pls accelerate the TOS drafting if possible. i have a client (a law firm) that needs to analyze a set of documents that contain confidential data, i 'd like to review the TOS first before proceeding.
Hey @Logan M ,
I'm reviewing this notebook as well https://github.com/run-llama/llama_parse/blob/main/examples/demo_advanced.ipynb.

And there are 2 things I don't get:
  1. The nodes list basically contains raw text (=TextNodes without parent), table definition (= IndexNodes) and table content (=TextNodes with an IndexNode as parent). And when doing base_nodes, objects = node_parser.get_nodes_and_objects(nodes), we basically disregard the table content as we keep only the TextNodes without parents (=base_nodes) and the IndexNodes (=objects).. So how come the query engine is able to answer questions about the table content while it does not have access to it ?
  1. I don't understand why the index built as VectorStoreIndex(nodes=base_nodes+objects) is called recursive while the one built as VectorStoreIndex.from_documents(documents) is called raw (hence, not recursive). They are both of the same type. What makes the first one recursive ?
Attachment
image.png
  1. The index nodes contain the table summary (node.text) + table content (node.obj.text)
  1. Its recursive because if you index an index node, and its retrieved, its replaced with its object
Amazing. Thanks @Logan M. Given the fast evolution of the lib and the variety of integrations you have and the usecases you address, navigating through LlamaIndex is not easy despite all the example notebooks, even as a seasoned developer. Is there any way to pay to get more in-depth support to address complex usecase and make sure we make the right choices ?
Best thing is probably just asking on discord lol

I find the best way to figure how stuff works is reading the source code (not ideal, but tbh is usually my go-to for most open source packages lol)
Add a reply
Sign up and join the conversation on Discord