BPE tokenizer
This is a BPE counterpart to alisawuffles/superbpe-tokenizer-128k, trained on the same data with the same vocabulary size.
You can experiment with this tokenizer on our tokenizer playground by entering a custom HF repository ID.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support