Log in
Log into community
Find answers from the community
s
F
Y
a
P
3,278
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated last month
0
Follow
Otherwise, what's the point?
Otherwise, what's the point?
0
Follow
b
bin4ry_d3struct0r
8 months ago
Β·
Otherwise, what's the point?
n
b
11 comments
Share
Open in Discord
n
nerdai
8 months ago
if using
from_documents
then there is further processing in the form of chunking and encoding to get it as a node.
n
nerdai
8 months ago
if using
nodes
then that it typically means those processing as happened already
b
bin4ry_d3struct0r
8 months ago
I see ... so everything ultimately gets rendered into a node.
b
bin4ry_d3struct0r
8 months ago
In that case, pre-processing nodes may indeed help optimize embedding.
b
bin4ry_d3struct0r
8 months ago
Thanks!
n
nerdai
8 months ago
π
n
nerdai
8 months ago
FYI, you can also go the ingestion pipeline route!
n
nerdai
8 months ago
https://docs.llamaindex.ai/en/stable/module_guides/loading/ingestion_pipeline/root.html
b
bin4ry_d3struct0r
8 months ago
I'm not at all familiar with this, but I'll be sure to check into it.
b
bin4ry_d3struct0r
8 months ago
Thanks again π
n
nerdai
8 months ago
no problem!
Add a reply
Sign up and join the conversation on Discord
Join on Discord