Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@
|
|
| 7 |
## ์ํคํ
์ฒ
|
| 8 |
- **๋ชจ๋ธ ์ ํ**: RoBERTa
|
| 9 |
- **์ํคํ
์ฒ**: RobertaForMaskedLM
|
| 10 |
-
- **๋ชจ๋ธ ํฌ๊ธฐ**:
|
| 11 |
- **max_position_embeddings**: 514
|
| 12 |
- **intermediate_size**: 2048
|
| 13 |
- **vocab_size**: 1428
|
|
|
|
| 7 |
## ์ํคํ
์ฒ
|
| 8 |
- **๋ชจ๋ธ ์ ํ**: RoBERTa
|
| 9 |
- **์ํคํ
์ฒ**: RobertaForMaskedLM
|
| 10 |
+
- **๋ชจ๋ธ ํฌ๊ธฐ**: 512 hidden size, 8 hidden layers, 8 attention heads
|
| 11 |
- **max_position_embeddings**: 514
|
| 12 |
- **intermediate_size**: 2048
|
| 13 |
- **vocab_size**: 1428
|