rce-trust-remote-code / tokenizer_config.json

Upload tokenizer_config.json with huggingface_hub

7856755 verified 6 months ago

117 Bytes

{"tokenizer_class": "XitroRCETokenizer", "auto_map": {"AutoTokenizer": ["tokenizer_custom.XitroRCETokenizer", null]}}