Log in
Log into community
Find answers from the community
View all posts
Related posts
Was this helpful?
π
π
π
Powered by
Hall
Inactive
Updated 5 months ago
0
Follow
Hello, are we able to use LLMLingua in
Hello, are we able to use LLMLingua in
Inactive
0
Follow
At a glance
J
Ji-Ha
last year
Β·
Hello, are we able to use LLMLingua in LlamaIndex with OpenRouter or LiteLLM to reduce costs?
L
J
7 comments
Share
Open in Discord
L
Logan M
last year
Sadly you are limited by whatever models the llmlingua library supports
Attachment
J
Ji-Ha
last year
:(
J
Ji-Ha
last year
Thanks for the help.
J
Ji-Ha
last year
Are there alternative compression methods like it that work with LlamaIndex?
L
Logan M
last year
sadly I'm not aware of anything. You could always try and implement the paper yourself too with other LLMs
L
Logan M
last year
that's not for everyone though lol
J
Ji-Ha
last year
I tried, got about 200 errors, so I think I am not fit for it...
Add a reply
Sign up and join the conversation on Discord
Join on Discord