strange tokenizer
#2
by
chgrdj
- opened
Hello,
As this model is a reasoning one i expected it to have a tokenizer that contains of tokens to mark the process of reasoning. I see it does not , and is actually different from Phi-4-reasoning tokenizer (which contains tokens) is it something normal? If so ,how is the model reasoning?
Thx