Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
😞
😐
😃
Powered by
Hall
Inactive
Updated 6 months ago
0
Follow
Is there any reason for chunk sizes to
Is there any reason for chunk sizes to
Inactive
0
Follow
k
kush2861
6 months ago
·
Is there any reason for chunk sizes to be powers of 2?
L
k
L
7 comments
Share
Open in Discord
L
Logan M
6 months ago
programmers like powers of 2 🙂
L
Logan M
6 months ago
(And generally, the max size for embeddings or llms is some power of 2)
L
Logan M
6 months ago
but you can definitely make it whatever you want tbh
k
kush2861
6 months ago
Does this have anything to do with effective data storage?
k
kush2861
6 months ago
Like say 512 is preffered over 500?
L
LunarShadow
6 months ago
@kush2861 Good question.
I think you’re correct in assuming that it is because of how data is stored (& therefore retrieved i.e. memory alignment) .
We can use any chunk size though. But I imagine that power of 2s might be more optimal on average
k
kush2861
6 months ago
Thanks for the response @LunarShadow
Add a reply
Sign up and join the conversation on Discord
Join on Discord