Find answers from the community

Updated 4 months ago

SentenceEmbeddingOptimizer works by

At a glance
The community member who posted the original question is asking whether the SentenceEmbeddingOptimizer literally cuts off a percentage of the input text. In the comments, another community member suggests that the optimizer instead uses embeddings to determine which parts of the text to remove, based on their reading of the source code. However, there is no explicitly marked answer to the original question.
Useful resources
SentenceEmbeddingOptimizer works by literally cutting off a % of input text?
L
1 comment
Kind of? But it uses embeddings to figure out which parts of the text to remove (at least, that's my take after reading the source code)

https://github.com/jerryjliu/llama_index/blob/main/llama_index/optimization/optimizer.py
Add a reply
Sign up and join the conversation on Discord