Tokenizer for fine tuning RWKV-v5 world model

[mathewchris96]

Can someone help with what tokenizer to use here:- tokenizer = PreTrainedTokenizerFast(tokenizer_file=f'{repo_dir}/20B_tokenizer.json')
for RWKV v5 world mode. I'm trying to finetune the model here.

[BlinkDL]

see https://huggingface.co/RWKV/v5-Eagle-7B-HF for a HF-compatible tokenizer