Find answers from the community

Updated 5 months ago

Hello, are we able to use LLMLingua in

At a glance
Hello, are we able to use LLMLingua in LlamaIndex with OpenRouter or LiteLLM to reduce costs?
L
J
7 comments
Sadly you are limited by whatever models the llmlingua library supports
Attachment
image.png
Thanks for the help.
Are there alternative compression methods like it that work with LlamaIndex?
sadly I'm not aware of anything. You could always try and implement the paper yourself too with other LLMs
that's not for everyone though lol
I tried, got about 200 errors, so I think I am not fit for it...
Add a reply
Sign up and join the conversation on Discord