Text Generation
Safetensors
gpt_neox
Files changed (1) hide show
  1. README.md +58 -46
README.md CHANGED
@@ -1,47 +1,59 @@
1
- ---
2
- license: mit
3
- language:
4
- - en
5
- base_model:
6
- - Qwen/Qwen2.5-0.5B-Instruct
7
- pipeline_tag: text-generation
8
- ---
9
-
10
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/667e7043f6fa6fb03b220f9c/lYY8N3OPJo6yLTay8g0qN.png)
11
-
12
- # Zeta 1 - First Step of Zeta Project, This is Epoch.
13
- Zeta 1 is the first step that I, an ordinary person and consumer, have taken in pursuit of my dream as an individual.
14
-
15
- ## About Zeta 1
16
- Zeta 1 is an LLM with about 400 million parameters.
17
-
18
- It might be better to call it an SLM.
19
-
20
- Zeta 1 is an SLM that was painstakingly created on a consumer computer.
21
-
22
- ### Computer Spec
23
-
24
- **Machine:** *Mac Mini (M2 Pro, 32GB RAM, 2023)*
25
-
26
- This is a technical matter, but on a Mac with Apple Silicon you can only choose between CPU or MPS (Apple's proprietary API).
27
-
28
- CPU has some compatibility but is too slow.
29
-
30
- MPS is somewhat faster but doesn't allow the use of optimization systems such as fp16.
31
-
32
- Zeta 1 was built using MPS.
33
-
34
- ### Arguments of Trainer
35
- - **train epochs:** 3
36
- - **warmup steps:** 100
37
-
38
- ### Datasets
39
- Details of the dataset used can be found [here](https://github.com/DiamondGotCat/Zeta-Dataset/releases/tag/zeta-1)
40
-
41
- ## Links
42
- GitHub: [Zeta](https://github.com/DiamondGotCat/Zeta)
43
-
44
- ---
45
-
46
- Zeta is just a small SLM.
 
 
 
 
 
 
 
 
 
 
 
 
47
  But don't forget that it has big dreams inside.
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - zho
5
+ - eng
6
+ - fra
7
+ - spa
8
+ - por
9
+ - deu
10
+ - ita
11
+ - rus
12
+ - jpn
13
+ - kor
14
+ - vie
15
+ - tha
16
+ - ara
17
+ base_model:
18
+ - Qwen/Qwen2.5-0.5B-Instruct
19
+ pipeline_tag: text-generation
20
+ ---
21
+
22
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/667e7043f6fa6fb03b220f9c/lYY8N3OPJo6yLTay8g0qN.png)
23
+
24
+ # Zeta 1 - First Step of Zeta Project, This is Epoch.
25
+ Zeta 1 is the first step that I, an ordinary person and consumer, have taken in pursuit of my dream as an individual.
26
+
27
+ ## About Zeta 1
28
+ Zeta 1 is an LLM with about 400 million parameters.
29
+
30
+ It might be better to call it an SLM.
31
+
32
+ Zeta 1 is an SLM that was painstakingly created on a consumer computer.
33
+
34
+ ### Computer Spec
35
+
36
+ **Machine:** *Mac Mini (M2 Pro, 32GB RAM, 2023)*
37
+
38
+ This is a technical matter, but on a Mac with Apple Silicon you can only choose between CPU or MPS (Apple's proprietary API).
39
+
40
+ CPU has some compatibility but is too slow.
41
+
42
+ MPS is somewhat faster but doesn't allow the use of optimization systems such as fp16.
43
+
44
+ Zeta 1 was built using MPS.
45
+
46
+ ### Arguments of Trainer
47
+ - **train epochs:** 3
48
+ - **warmup steps:** 100
49
+
50
+ ### Datasets
51
+ Details of the dataset used can be found [here](https://github.com/DiamondGotCat/Zeta-Dataset/releases/tag/zeta-1)
52
+
53
+ ## Links
54
+ GitHub: [Zeta](https://github.com/DiamondGotCat/Zeta)
55
+
56
+ ---
57
+
58
+ Zeta is just a small SLM.
59
  But don't forget that it has big dreams inside.