Attributeerror: 'anthropic' object has no attribute 'get_tokenizer'

this method was never implemented 👀 Anthropic doesn't provide a tokenizer afaik

LOL why does the example say to use it

which example?

@Logan M

oh spooky

that actually works for me

what version of anthropic do you have? I have v0.36.0

0.39.0

do i need to downgrade lol worried about compatible issue with latest claude model

Hmm i guess anthropic removed or renamed that method? Will try updating and see where it went

For now if you need the tokenizer, just downgrade, should be fine

Looks like its removed

they closed they tokens too

The new API is pretty nice though if you use it directly. Allows for counting tools, images, etc.

The API in llama-index is limited to string in, int out though. Updating the class in any case right now

ooo thanks