Hugging Face's logo

winglian
/
reasoning-llama-3.1-70b-stratos-cold-start-v2

Text Generation
Transformers
Safetensors
llama
Generated from Trainer
conversational
text-generation-inference
Model card Files
xet
Community
winglian commited on
Commit
c86d316
·
verified ·
1 Parent(s): 9452454

Add files using upload-large-folder tool

Browse files
Files changed (33) hide show
  1. README.md +153 -0
  2. axolotl/stratos.yaml +83 -0
  3. model-00001-of-00030.safetensors +1 -1
  4. model-00002-of-00030.safetensors +1 -1
  5. model-00003-of-00030.safetensors +1 -1
  6. model-00004-of-00030.safetensors +1 -1
  7. model-00005-of-00030.safetensors +1 -1
  8. model-00006-of-00030.safetensors +1 -1
  9. model-00007-of-00030.safetensors +1 -1
  10. model-00008-of-00030.safetensors +1 -1
  11. model-00009-of-00030.safetensors +1 -1
  12. model-00010-of-00030.safetensors +1 -1
  13. model-00011-of-00030.safetensors +1 -1
  14. model-00012-of-00030.safetensors +1 -1
  15. model-00013-of-00030.safetensors +1 -1
  16. model-00014-of-00030.safetensors +1 -1
  17. model-00015-of-00030.safetensors +1 -1
  18. model-00016-of-00030.safetensors +1 -1
  19. model-00017-of-00030.safetensors +1 -1
  20. model-00018-of-00030.safetensors +1 -1
  21. model-00019-of-00030.safetensors +1 -1
  22. model-00020-of-00030.safetensors +1 -1
  23. model-00021-of-00030.safetensors +1 -1
  24. model-00022-of-00030.safetensors +1 -1
  25. model-00023-of-00030.safetensors +1 -1
  26. model-00024-of-00030.safetensors +1 -1
  27. model-00025-of-00030.safetensors +1 -1
  28. model-00026-of-00030.safetensors +1 -1
  29. model-00027-of-00030.safetensors +1 -1
  30. model-00028-of-00030.safetensors +1 -1
  31. model-00029-of-00030.safetensors +1 -1
  32. model-00030-of-00030.safetensors +1 -1
  33. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,153 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: llama3.1
4
+ base_model: meta-llama/Llama-3.1-70B
5
+ tags:
6
+ - generated_from_trainer
7
+ datasets:
8
+ - bespokelabs/Bespoke-Stratos-17k
9
+ model-index:
10
+ - name: outputs/out/reasoning-70b-stratos
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ [<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
18
+ <details><summary>See axolotl config</summary>
19
+
20
+ axolotl version: `0.8.0.dev0`
21
+ ```yaml
22
+ base_model: meta-llama/Llama-3.1-70B
23
+ # Automatically upload checkpoint and final model to HF
24
+ # hub_model_id: username/custom_model_name
25
+ #
26
+
27
+ plugins:
28
+ - axolotl.integrations.liger.LigerPlugin
29
+ - axolotl.integrations.spectrum.SpectrumPlugin
30
+ spectrum_top_fraction: 0.5
31
+ spectrum_model_name: meta-llama/Meta-Llama-3.1-70B
32
+ liger_rope: true
33
+ liger_rms_norm: true
34
+ liger_glu_activation: true
35
+ liger_fused_linear_cross_entropy: true
36
+
37
+ strict: false
38
+
39
+ chat_template: llama3
40
+ datasets:
41
+ - path: bespokelabs/Bespoke-Stratos-17k
42
+ field_messages: conversations
43
+ message_property_mappings:
44
+ content: value
45
+ role: from
46
+ split: train
47
+ type: chat_template
48
+ dataset_prepared_path: last_run_prepared
49
+ val_set_size: 0.0
50
+ output_dir: ./outputs/out/reasoning-70b-stratos
51
+ save_safetensors: true
52
+
53
+ wandb_project: reasoning-70b-stratos
54
+ wandb_entity: axolotl-ai
55
+ wandb_watch:
56
+ wandb_name:
57
+ wandb_log_model:
58
+
59
+ sequence_len: 16384
60
+ sample_packing: true
61
+ pad_to_sequence_len: true
62
+
63
+ gradient_accumulation_steps: 1
64
+ micro_batch_size: 4
65
+ num_epochs: 3
66
+ optimizer: adamw_torch_fused
67
+ lr_scheduler: rex
68
+ learning_rate: 5.0e-6
69
+ embedding_lr: 1.0e-5
70
+ max_grad_norm: 1.0
71
+
72
+ train_on_inputs: false
73
+ group_by_length: false
74
+ bf16: true
75
+ tf32: true
76
+
77
+ gradient_checkpointing: offload
78
+ gradient_checkpointing_kwargs:
79
+ use_reentrant: true
80
+ logging_steps: 1
81
+ flash_attention: true
82
+
83
+ warmup_steps: 20
84
+ evals_per_epoch: 4
85
+ saves_per_epoch: 1
86
+ weight_decay: 0.01
87
+ deepspeed: deepspeed_configs/zero3_bf16_cpuoffload_params.json
88
+ special_tokens:
89
+ pad_token: <|finetune_right_pad_id|>
90
+ eos_token: <|eot_id|>
91
+ added_tokens_overrides:
92
+ 128011: <think>
93
+ 128012: </think>
94
+ 128013: <|begin_of_thought|>
95
+ 128014: <|end_of_thought|>
96
+ 128015: <|begin_of_solution|>
97
+ 128016: <|end_of_solution|>
98
+ fix_untrained_tokens:
99
+ - 128011
100
+ - 128012
101
+ - 128013
102
+ - 128014
103
+ - 128015
104
+ - 128016
105
+
106
+ ```
107
+
108
+ </details><br>
109
+
110
+ # outputs/out/reasoning-70b-stratos
111
+
112
+ This model is a fine-tuned version of [meta-llama/Llama-3.1-70B](https://huggingface.co/meta-llama/Llama-3.1-70B) on the bespokelabs/Bespoke-Stratos-17k dataset.
113
+
114
+ ## Model description
115
+
116
+ More information needed
117
+
118
+ ## Intended uses & limitations
119
+
120
+ More information needed
121
+
122
+ ## Training and evaluation data
123
+
124
+ More information needed
125
+
126
+ ## Training procedure
127
+
128
+ ### Training hyperparameters
129
+
130
+ The following hyperparameters were used during training:
131
+ - learning_rate: 5e-06
132
+ - train_batch_size: 4
133
+ - eval_batch_size: 4
134
+ - seed: 42
135
+ - distributed_type: multi-GPU
136
+ - num_devices: 16
137
+ - total_train_batch_size: 64
138
+ - total_eval_batch_size: 64
139
+ - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
140
+ - lr_scheduler_type: rex
141
+ - lr_scheduler_warmup_steps: 20
142
+ - num_epochs: 3.0
143
+
144
+ ### Training results
145
+
146
+
147
+
148
+ ### Framework versions
149
+
150
+ - Transformers 4.49.0
151
+ - Pytorch 2.5.1+cu124
152
+ - Datasets 3.2.0
153
+ - Tokenizers 0.21.0
axolotl/stratos.yaml ADDED
@@ -0,0 +1,83 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ base_model: meta-llama/Llama-3.1-70B
2
+ # Automatically upload checkpoint and final model to HF
3
+ # hub_model_id: username/custom_model_name
4
+ #
5
+
6
+ plugins:
7
+ - axolotl.integrations.liger.LigerPlugin
8
+ - axolotl.integrations.spectrum.SpectrumPlugin
9
+ spectrum_top_fraction: 0.5
10
+ spectrum_model_name: meta-llama/Meta-Llama-3.1-70B
11
+ liger_rope: true
12
+ liger_rms_norm: true
13
+ liger_glu_activation: true
14
+ liger_fused_linear_cross_entropy: true
15
+
16
+ strict: false
17
+
18
+ chat_template: llama3
19
+ datasets:
20
+ - path: bespokelabs/Bespoke-Stratos-17k
21
+ field_messages: conversations
22
+ message_property_mappings:
23
+ content: value
24
+ role: from
25
+ split: train
26
+ type: chat_template
27
+ dataset_prepared_path: last_run_prepared
28
+ val_set_size: 0.0
29
+ output_dir: ./outputs/out/reasoning-70b-stratos
30
+ save_safetensors: true
31
+
32
+ wandb_project: reasoning-70b-stratos
33
+ wandb_entity: axolotl-ai
34
+ wandb_watch:
35
+ wandb_name:
36
+ wandb_log_model:
37
+
38
+ sequence_len: 16384
39
+ sample_packing: true
40
+ pad_to_sequence_len: true
41
+
42
+ gradient_accumulation_steps: 1
43
+ micro_batch_size: 4
44
+ num_epochs: 3
45
+ optimizer: adamw_torch_fused
46
+ lr_scheduler: rex
47
+ learning_rate: 5.0e-6
48
+ embedding_lr: 1.0e-5
49
+ max_grad_norm: 1.0
50
+
51
+ train_on_inputs: false
52
+ group_by_length: false
53
+ bf16: true
54
+ tf32: true
55
+
56
+ gradient_checkpointing: offload
57
+ gradient_checkpointing_kwargs:
58
+ use_reentrant: true
59
+ logging_steps: 1
60
+ flash_attention: true
61
+
62
+ warmup_steps: 20
63
+ evals_per_epoch: 4
64
+ saves_per_epoch: 1
65
+ weight_decay: 0.01
66
+ deepspeed: deepspeed_configs/zero3_bf16_cpuoffload_params.json
67
+ special_tokens:
68
+ pad_token: <|finetune_right_pad_id|>
69
+ eos_token: <|eot_id|>
70
+ added_tokens_overrides:
71
+ 128011: <think>
72
+ 128012: </think>
73
+ 128013: <|begin_of_thought|>
74
+ 128014: <|end_of_thought|>
75
+ 128015: <|begin_of_solution|>
76
+ 128016: <|end_of_solution|>
77
+ fix_untrained_tokens:
78
+ - 128011
79
+ - 128012
80
+ - 128013
81
+ - 128014
82
+ - 128015
83
+ - 128016
model-00001-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d4db8f40a4ce09727d73149688e86ed3cce858dbd02fb0303fe63e3f09c5e3dc
3
  size 4584408808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ca80e1a754978eb9a37681a4f56a6cd4e1dd0daf1ecac0217e4e5974547df4c
3
  size 4584408808
model-00002-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:75f1f5b729e4e0aaa8cd3c7dccb149b39c73a5432d5da4826593d722c4faad59
3
  size 4664167376
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1fea0db1a47fefcde9cb301d901060a6f54dd8fc0a64923f0bd906a6a2964a3c
3
  size 4664167376
model-00003-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2b5ee71bf64cb531801175114296152fb46442c35c3b27df8821a35bf9246108
3
  size 4999711704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0ead33ec88995dd2c9a52ec6687c88bc4f2f12341534e08bdba6205c3968170
3
  size 4999711704
model-00004-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:57f93a00320a8ccfc4ff3047b482665798e76a1aef272d491c02610e668df603
3
  size 4966157032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90d0dbe4c6e6f84c0fd63848ae81caf543a2c6dca47e331181988b64b02b1b99
3
  size 4966157032
model-00005-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2d2e63eda4ecf0d4b10d504cf61684dcdb75b8f5b026ebaca70750801e1f43f8
3
  size 4664134408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc06f5d1c5a6172c02f302e542d606999102ad7d0443a5767be283f5254daf8d
3
  size 4664134408
model-00006-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2dc85746c8b1bcd87c14b16f18370f051a8558074a2ce35f4cf1f2570ca89027
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a284b9fb811ea933d4d12cf68d7f148887c2b75616e88f86a4037c35992d698
3
  size 4664167408
model-00007-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:60869a2d57bec1ca347e0084d318f5c786ef64af1e3b9fe33c83b717a84c86c2
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:315217971749a21d8bf1e29c1a35465ebd79cb83a551aa2ae22bf610d7914e2b
3
  size 4664167408
model-00008-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1c27115ecbf1acd4331772cfa12d65cf9e9cbe294736dfc0ba439adca787d82
3
  size 4999711728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ece7f3b69386b701c284fb94e8f1449836c970b824ba6dca9dae218c532d289e
3
  size 4999711728
model-00009-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:99cf6a25c42eb54ef95c7a0de05e45c51ad69f80991345ecd00c30ad790e4065
3
  size 4966157056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f61de6c416a8fa6f3997320a18c40fd7771bd490bb1d5cf8e4e50801ff92c083
3
  size 4966157056
model-00010-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cfefebdd7077b2bb51a803e29d87c13b3edf055931fa464da5e99c9d79d96d07
3
  size 4664134408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a79e72a7989ec996f544e3df9e29f472c74bd59dcc58f17abb5dbc9328e8be6d
3
  size 4664134408
model-00011-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:52e6eacc03cf033535f5202fe9f967147cee214792b7ff355ce17712dd9fbede
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b8a766a649ead5ba9c118ee25dd12c4fcdb96d15d04283a8161160c84f8f0e7
3
  size 4664167408
model-00012-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:75cee956056a25b830ede992feb638919f4567e517f537d5ca77485a8424d7e5
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:254cd55d1512b2dc1969492a9029978bb3262ea4e373e87130c93a286f070d82
3
  size 4664167408
model-00013-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8105bc43e195dbac5a6bd9fcadbfda375f61fb31d331b6abfa6c960398703b93
3
  size 4999711728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:085a29f24ba4379f3fddcb799342ab6f8f5770c17d150ff477b99b5289034743
3
  size 4999711728
model-00014-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:18da2a6db362c05fc0fab4d49662e7c223a75ef54e4f3fb8a9f8b5384fb8f8e3
3
  size 4966157056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e19e9c5fcd524342acdfdb5ed05de0e5c7f62e9209324b5856df29aa376019f
3
  size 4966157056
model-00015-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0c6e54f2f97562d5f7a8a21d5c0fe95bdcf7ac30c5dc4cc667c243ab40e92a35
3
  size 4664134408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:141bc4a331009edfb197b808644a6aaba06c1ac0ecd088235b63469edc224291
3
  size 4664134408
model-00016-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a5f8f9e2dfad75c1806dd8054ff50a367edd1cc31baad4d87cd498a19bb328d7
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4198a40ca7ea153774800d9a55593d05d77a3b0768097090376c77b3406b03eb
3
  size 4664167408
model-00017-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1813480b64571208e16a975ba3a817de5711a073732ef2d60ec3fb4abaf9d187
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:059331741bdf055b6774796222b86e295f504074807093614f163e38bf26f209
3
  size 4664167408
model-00018-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f7bff86d5f01505d7e5cff14b6051faea006cdd3c0e7e598e4a6f4b6ce0de6c1
3
  size 4999711728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edf8c97b86f3e23df8879b95b684fa8b34f44475060d41d442e762b5aa6c2657
3
  size 4999711728
model-00019-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:626c689ad0113548d287cf181d1fd9f51bdd35d04bc7f7dcd96f0ef741fe899d
3
  size 4966157056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67bf7d65922c77f190b5833a85355de7358e4aed65b9c46ac7c57cd3fe6c7b21
3
  size 4966157056
model-00020-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5102e63eceda0c66a9a333489c542d66bdc7941afadaa40ba76f8282ba57f46d
3
  size 4664134408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66d3264812cbe8c4693c96a0414e9ffa7904cefbd15e6b41966ff6f2d6bf9c6c
3
  size 4664134408
model-00021-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2ee927b162600086c55de61090302c53f79e943a9849871b42de73406137592c
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be1bf6ca9dcc681dd25edcafd06e775b4da447e1278ed2465e0282dd122aa84b
3
  size 4664167408
model-00022-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ffa571b3890158ee201674f1937883934b1798a093d0cb3371b403d58b0166b9
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19bc99461172d38bad0cd16094642cdb02db91efd9ba9c4fb453afc7bb006932
3
  size 4664167408
model-00023-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:01639e2f1ab9117bab357e157e2f4d012252c572d2cd6ab2756b9978466e91fa
3
  size 4999711728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d3eba96aaf2ea0404a4fbc6c3b8f49da08b0990100680c222676c3ee65e5beb
3
  size 4999711728
model-00024-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b12dfce2f5c6c48d1a5e7fa3fe34e52b67541662f3aa97523b23873adb0c1d08
3
  size 4966157056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ed2ebf355638c0c2b4935bc14dda01c04d0adaa6529a02975592829ad6285b1
3
  size 4966157056
model-00025-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:80b3ba6ed3f327b5108c183fbeca7271ad67b0cba5e5b91af634e62dd95a6bc1
3
  size 4664134408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc0edc2579a2a778be76dfc1909d8e866a04feea25b0719f0552ba9b12005c51
3
  size 4664134408
model-00026-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a9951073773183da6e3195d9074094ca7ce33b2c1ad7e0db6d38c6383d4d3310
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25d2fe21ccca26a214df47e3f87c1c1d19a62d6ebe09a4eb2013fed6a4b18fb2
3
  size 4664167408
model-00027-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:882e444277d54574cdac4eb7ecbade9f0c7ad80dc65087bdd2de0766ee358bad
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3557b153f9f0a17f07bf2cc051ffbf0991983ddcbc85e73fb9ed095a585ecd59
3
  size 4664167408
model-00028-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d51c219c82d2ff8085cf27a8a99be72bff3f2b6287b3eaac98532b1f6f67f906
3
  size 4999711728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23e0e49f71bce1c50286d9921d12b2bcc3123a3f369933449da9f5493c8a8cc4
3
  size 4999711728
model-00029-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a18f01c95dc02ac63a8a9e6a2f4996d327a4a6085d8d1caa1b3a59f51625db7
3
  size 4966173536
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b05d091c7b850cb3ad201613b048cb667eedf35970c70b16f0d2d866c49eec08
3
  size 4966173536
model-00030-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:275b0bd384f1a37f4653cf3e61d3879dd3731cbd8e079568ea9aa88bc295ebed
3
  size 2101346432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66e448c41a9cf0e8da3e10ab0af40ea28951f00f74e6272ffd2efed162ba1124
3
  size 2101346432
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ac9bb2315889e2fba1ad65048b7750130f6a0625e3a8fba402553337fc9ca8c
3
+ size 9144