make sp_model init before __init__ to compat with transformer>=4.34
#2
by
ariwaranosai - opened
AttributeError: 'BaichuanTokenizer' object has no attribute 'sp_model' will be raised if sp_model would be set properly, since PreTrainedTokenizer' init func will call _add_tokens which need get_vocab.
这个pr还没通过？？Baichuan彻底摆烂了？
GradientGuru changed pull request status to
merged