Log in
Log into community
Find answers from the community
s
F
Y
a
P
3,278
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated last month
0
Follow
Semantic
Semantic
0
Follow
d
doughboy
8 months ago
Β·
Is it possible to integrate a semantic text splitter with LlamaIndex?
https://pypi.org/project/semantic-text-splitter/
L
d
M
13 comments
Share
Open in Discord
L
Logan M
8 months ago
Llama index already has a semantic splitter
d
doughboy
8 months ago
oh! thanks π
L
Logan M
8 months ago
https://docs.llamaindex.ai/en/stable/examples/node_parsers/semantic_chunking.html
d
doughboy
8 months ago
So why isn't this the default splitter? Is it that much slower?
L
Logan M
8 months ago
It's slower, maybe a tad unproven
M
Maverick
8 months ago
even I've been thinking of this for a (long) while ... how good are the results @Logan M ?
L
Logan M
8 months ago
eh, I think they are alright. But I also have done a deep evaluation on it
M
Maverick
8 months ago
would this get better response when doing a query as compared to the sentence splitter approach?
L
Logan M
8 months ago
I do not know π Maybe lol
M
Maverick
8 months ago
let me chk ... thx
M
Maverick
8 months ago
I thot that it's part of
v0.10.xx
... oops so many changes in there, and I couldn't even locate
SimpleDirectoryReader
and many others ... wondering if the doc is updated
L
Logan M
8 months ago
The documentation is updated. But if you upgraded from v0.9.x, it's best to start with a clean/fresh/new venv
M
Maverick
8 months ago
hmm, let me try that over the wknd ... for now hanging on to v0.9.x
Add a reply
Sign up and join the conversation on Discord
Join on Discord