Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 2 months ago
0
Follow
Otherwise, what's the point?
Otherwise, what's the point?
Inactive
0
Follow
b
bin4ry_d3struct0r
9 months ago
Β·
Otherwise, what's the point?
a
b
11 comments
Share
Open in Discord
a
andrei
9 months ago
if using
from_documents
then there is further processing in the form of chunking and encoding to get it as a node.
a
andrei
9 months ago
if using
nodes
then that it typically means those processing as happened already
b
bin4ry_d3struct0r
9 months ago
I see ... so everything ultimately gets rendered into a node.
b
bin4ry_d3struct0r
9 months ago
In that case, pre-processing nodes may indeed help optimize embedding.
b
bin4ry_d3struct0r
9 months ago
Thanks!
a
andrei
9 months ago
π
a
andrei
9 months ago
FYI, you can also go the ingestion pipeline route!
a
andrei
9 months ago
https://docs.llamaindex.ai/en/stable/module_guides/loading/ingestion_pipeline/root.html
b
bin4ry_d3struct0r
9 months ago
I'm not at all familiar with this, but I'll be sure to check into it.
b
bin4ry_d3struct0r
9 months ago
Thanks again π
a
andrei
9 months ago
no problem!
Add a reply
Sign up and join the conversation on Discord
Join on Discord