Find answers from the community

Updated last year

Warning

anyone know where does this error come from?

2 comments

It comes from using python3.8. It uses a gpt2 tokenizer from transformers instead of tiktoken for that version

It shouldn't stop execution though right, it's just benign

zzhozho

thank you

Add a reply