value error, The checkpoint you are trying to load has model type `qwen3_5`

#3
by cesinsingapore - opened

I'm using vllm to run this qwen3.5-9B, but got

Mar 03 01:14:38 CES-AI vllm[3250530]: (APIServer pid=3250530) pydantic_core._pydantic_core.ValidationError: 1 validation error for ModelConfig
Mar 03 01:14:38 CES-AI vllm[3250530]: (APIServer pid=3250530) Value error, The checkpoint you are trying to load has model type qwen3_5 but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
Mar 03 01:14:38 CES-AI vllm[3250530]: (APIServer pid=3250530)
Mar 03 01:14:38 CES-AI vllm[3250530]: (APIServer pid=3250530) You can update Transformers with the command pip install --upgrade transformers. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command pip install git+https://github.com/huggingface/transformers.git [type=value_error, input_value=ArgsKwargs((), {'model': ...rocessor_plugin': None}), input_type=ArgsKwargs]
Mar 03 01:14:38 CES-AI vllm[3250530]: (APIServer pid=3250530) For further information visit https://errors.pydantic.dev/2.12/v/value_error

I also did pip install git+https://github.com/huggingface/transformers.git , but nothing improved

Sign up or log in to comment