Find answers from the community

Updated 2 years ago

Tokenizer

At a glance

The community member is trying to use ChatMemoryBuffer and is unsure about what tokenizer_fn to pass. A comment from another community member suggests that the default tokenizer_fn should be fine and that it is entirely optional.

I am trying to use ChatMemoryBuffer, I am not sure what tokenizer_fn should I pass here
L
1 comment
It's entirely optional. The default should be fine tbh
Add a reply
Sign up and join the conversation on Discord