Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
mjbommar
/
magic-bert-tokenizer-16k
like
0
Transformers
English
tokenizer
bpe
binary-analysis
file-type-detection
magic-bert
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
magic-bert-tokenizer-16k
/
tokenizer.json
Commit History
Upload Magic-BERT tokenizer
801d3ab
verified
mjbommar
commited on
17 days ago