Model save
Browse files
README.md
CHANGED
|
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 18 |
|
| 19 |
This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on the None dataset.
|
| 20 |
It achieves the following results on the evaluation set:
|
| 21 |
-
- Loss:
|
| 22 |
-
- F1: 0.
|
| 23 |
|
| 24 |
## Model description
|
| 25 |
|
|
@@ -50,21 +50,21 @@ The following hyperparameters were used during training:
|
|
| 50 |
|
| 51 |
| Training Loss | Epoch | Step | Validation Loss | F1 |
|
| 52 |
|:-------------:|:-----:|:----:|:---------------:|:------:|
|
| 53 |
-
|
|
| 54 |
-
|
|
| 55 |
-
|
|
| 56 |
-
|
|
| 57 |
-
| 0.
|
| 58 |
-
| 0.
|
| 59 |
-
| 0.
|
| 60 |
-
| 0.
|
| 61 |
-
| 0.
|
| 62 |
-
| 0.
|
| 63 |
|
| 64 |
|
| 65 |
### Framework versions
|
| 66 |
|
| 67 |
-
- Transformers 4.48.0
|
| 68 |
-
- Pytorch 2.
|
| 69 |
-
- Datasets 3.
|
| 70 |
- Tokenizers 0.21.0
|
|
|
|
| 18 |
|
| 19 |
This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on the None dataset.
|
| 20 |
It achieves the following results on the evaluation set:
|
| 21 |
+
- Loss: 0.9750
|
| 22 |
+
- F1: 0.8671
|
| 23 |
|
| 24 |
## Model description
|
| 25 |
|
|
|
|
| 50 |
|
| 51 |
| Training Loss | Epoch | Step | Validation Loss | F1 |
|
| 52 |
|:-------------:|:-----:|:----:|:---------------:|:------:|
|
| 53 |
+
| 0.4161 | 1.0 | 300 | 0.3895 | 0.8468 |
|
| 54 |
+
| 0.2737 | 2.0 | 600 | 0.3850 | 0.8483 |
|
| 55 |
+
| 0.1507 | 3.0 | 900 | 0.4366 | 0.8527 |
|
| 56 |
+
| 0.101 | 4.0 | 1200 | 0.4940 | 0.8651 |
|
| 57 |
+
| 0.0613 | 5.0 | 1500 | 0.6864 | 0.8578 |
|
| 58 |
+
| 0.029 | 6.0 | 1800 | 0.7927 | 0.8602 |
|
| 59 |
+
| 0.0263 | 7.0 | 2100 | 0.8139 | 0.8581 |
|
| 60 |
+
| 0.0059 | 8.0 | 2400 | 0.8550 | 0.8669 |
|
| 61 |
+
| 0.0028 | 9.0 | 2700 | 0.9667 | 0.8648 |
|
| 62 |
+
| 0.001 | 10.0 | 3000 | 0.9750 | 0.8671 |
|
| 63 |
|
| 64 |
|
| 65 |
### Framework versions
|
| 66 |
|
| 67 |
+
- Transformers 4.48.0.dev0
|
| 68 |
+
- Pytorch 2.6.0+cu124
|
| 69 |
+
- Datasets 3.1.0
|
| 70 |
- Tokenizers 0.21.0
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 598445936
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b5567691f5090b5668b3f4328518b8e856fd6cecb1a771c7a0dd3dcbcdb60270
|
| 3 |
size 598445936
|
runs/Feb24_13-38-43_vapratux/events.out.tfevents.1740400723.vapratux.103021.4
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3a34f7fe6076d6f96cffde5de75f789cee0516bd669a1052ee3f8597eb0a9485
|
| 3 |
+
size 15878
|