Find answers from the community

Updated 3 months ago

Unexpected Keyword Argument 'use_beam_search'

At a glance

A community member reported encountering a TypeError with use_beam_search being an unexpected keyword argument while using vllm. Through discussion, it was revealed that this issue likely stems from a breaking change in a recent vllm version that removed certain parameters.

While the exact version couldn't be confirmed as the user was testing on run pod and had closed the kernel, another community member indicated that a patch would be needed and shared a link to a relevant pull request in the llama_index repository.

Useful resources
using vllm and getting some issues
TypeError: Unexpected keyword argument 'use_beam_search'
L
d
7 comments
What version of vllm do you have installed?
@Logan M i guess the latest one? Just did pip install vllm
pip show vllm ?
oh i already closed down the kernal lol. Was on run pod testing
hmmm, I installed the latest myself. Looks like vllm had a breaking change at some point and removed some params
Will need a patch
Add a reply
Sign up and join the conversation on Discord