hf-internal-testing
/

test_dynamic_processor

Model card Files Files and versions

test_dynamic_processor / tokenization.py

sgugger's picture

Initial commit

24b4f96 almost 4 years ago

history blame contribute delete

113 Bytes

	from transformers import BertTokenizer


	class NewTokenizer(BertTokenizer):
	special_attribute_present = True