zai-org
/

chatglm-6b

Model card Files Files and versions

Qingsong Lv commited on Apr 10, 2023

Commit

8e68ce0

·

1 Parent(s): e06f497

Update modeling_chatglm.py

Files changed (1) hide show

modeling_chatglm.py +1 -1

modeling_chatglm.py CHANGED Viewed

@@ -1114,7 +1114,7 @@ class ChatGLMForConditionalGeneration(ChatGLMPreTrainedModel):
                     input_ids,
                     device=input_ids.device
                 )
-                attention_mask[:, :, -1:]
             if position_ids is not None:
                 position_ids = position_ids[..., -1:]
             else:

                     input_ids,
                     device=input_ids.device
                 )
+                attention_mask = attention_mask[:, :, -1:]
             if position_ids is not None:
                 position_ids = position_ids[..., -1:]
             else: