Refactor GPT2BPETokenizer #4034
Description
The GPT2BPETokenizer is using torchtext. We want to remove torchtext as a dependency so this Tokenizer has to be refactored not using it.
{{ message }}
The GPT2BPETokenizer is using torchtext. We want to remove torchtext as a dependency so this Tokenizer has to be refactored not using it.