오류
ValueError : Couldn't instantiate the backend tokenizer from one of:
(1) a `tokenizers` library serialization file,
(2) a slow tokenizer instance to convert or
(3) an equivalent slow tokenizer class to instantiate and convert.
You need to have sentencepiece installed to convert a slow tokenizer to a fast one.
이미지와 같은 오류가 발생했을 땐, sentencepiece 를 설치하면 해결됩니다.
해결법
pip install sentencepiece이 코드를 작성하면 오류가 해결됩니다!
