LlamaIndex
Log in

Find answers from the community

Updated last month

Llm.complete getting failed with value error: chat response object has no field usage while using ollama #17035

TTech explorer
·
[Bug]: llm.complete getting failed with Value error: Chat response object has no field usage while using ollama #17035

Raised a bug. If that is not a bug let me know will close immediately
L
T
11 comments
LLogan M
I can't reproduce 🤔
LLogan M
pip freeze | grep llama -- what versions of things do you have?
LLogan M
ah oh, I think ollama 4.0 broke this
TTech explorer
Will setup venv with minimal packages
TTech explorer
I am running docker ollama , should I downgrade to 3.x and try ?
LLogan M
I would give it a shot. I tried it, was working, updated, it broke
TTech explorer
Ok downgraded it's working. So it's nothing to do inference engine ? We need to change pip installation of ollama only ?
TTech explorer
Shall I close the bug ?
LLogan M
nah keep the issue open. I can update to work with 4.0
TTech explorer
Ok Thanks.
LLogan M
https://github.com/run-llama/llama_index/pull/17036
Add a reply
Sign up and join the conversation on Discord