Attributeerror: 'anthropic' object has no attribute 'get_tokenizer'
Attributeerror: 'anthropic' object has no attribute 'get_tokenizer'
At a glance
The community members are discussing an issue with the Anthropic library, where the get_tokenizer method is not available. It seems that this method was never implemented by Anthropic, and they do not provide a tokenizer. The community members reference an example in the LlamaIndex documentation that suggests using this method, which is causing confusion. They also discuss the different versions of the Anthropic library and whether downgrading or updating the library might resolve the issue. The community members conclude that the get_tokenizer method has been removed from the Anthropic library, and they are exploring alternative ways to work with the new API.
@Logan M also AttributeError: 'Anthropic' object has no attribute 'get_tokenizer' do we have fix for this or do we not use tokziner for anthropic anymore