runtime error
Exit code: 1. Reason: parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) module._load_from_state_dict( /usr/local/lib/python3.11/site-packages/torch/nn/modules/module.py:2586: UserWarning: for base_model.model.model.layers.31.mlp.down_proj.lora_B.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) module._load_from_state_dict( Traceback (most recent call last): File "/app/app.py", line 59, in <module> model = PeftModel.from_pretrained(base_model, ADAPTER_MODEL) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/peft/peft_model.py", line 586, in from_pretrained model.load_adapter( File "/usr/local/lib/python3.11/site-packages/peft/peft_model.py", line 1181, in load_adapter load_result = set_peft_model_state_dict( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/peft/utils/save_and_load.py", line 464, in set_peft_model_state_dict load_result = model.load_state_dict(peft_model_state_dict, strict=False) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/torch/nn/modules/module.py", line 2635, in load_state_dict raise RuntimeError( RuntimeError: Error(s) in loading state_dict for PeftModelForCausalLM: size mismatch for base_model.model.model.embed_tokens.weight: copying a param with shape torch.Size([32806, 4096]) from checkpoint, the shape in current model is torch.Size([32768, 4096]). size mismatch for base_model.model.lm_head.weight: copying a param with shape torch.Size([32806, 4096]) from checkpoint, the shape in current model is torch.Size([32768, 4096]).
Container logs:
Fetching error logs...