LlamaIndex
Log in

Find answers from the community

Updated 2 months ago

SentenceEmbeddingOptimizer works by

bbmax
·
SentenceEmbeddingOptimizer works by literally cutting off a % of input text?
L
1 comment
LLogan M
Kind of? But it uses embeddings to figure out which parts of the text to remove (at least, that's my take after reading the source code)

https://github.com/jerryjliu/llama_index/blob/main/llama_index/optimization/optimizer.py
Add a reply
Sign up and join the conversation on Discord