LlamaIndex
Log in

Find answers from the community

Updated 2 years ago

Token cost

SSimonas
·
To retrieve one question cost around 1000 tokens, is there a way to reduce the token usage? I already using optimiser
L
1 comment
LLogan M
Tbh 1000 tokens is not bad for an LLM call, I'm not sure if it will get much lower 🤔

If you have the resources, you could consider running a local LLM?
Add a reply
Sign up and join the conversation on Discord