|
|
--- |
|
|
license: mit |
|
|
language: |
|
|
- zho |
|
|
- eng |
|
|
- fra |
|
|
- spa |
|
|
- por |
|
|
- deu |
|
|
- ita |
|
|
- rus |
|
|
- jpn |
|
|
- kor |
|
|
- vie |
|
|
- tha |
|
|
- ara |
|
|
pipeline_tag: text-generation |
|
|
datasets: |
|
|
- DiamondGotCat/Zeta-2-Dataset |
|
|
--- |
|
|
|
|
|
 |
|
|
|
|
|
# Challenging the limit of 464M params: Zeta 4 |
|
|
|
|
|
**Ollama:** [DiamondGotCat/Zeta-4](https://ollama.com/DiamondGotCat/Zeta-4) |
|
|
|
|
|
## Quantized Model (GGUF) |
|
|
- [Static Quant](https://huggingface.co/mradermacher/Zeta-4-GGUF) |
|
|
- [Weighted/imatrix Quant](https://huggingface.co/mradermacher/Zeta-4-i1-GGUF) |
|
|
|
|
|
## Prompt Template |
|
|
``` |
|
|
{{ if .System }}{{ .System }}{{ end }} |
|
|
{{ if .Prompt }}<USER>{{ .Prompt }}</USER>{{ end }} |
|
|
<ASSISTANT> |
|
|
``` |
|
|
|
|
|
## Stop Token |
|
|
`</ASSISTANT>` |
|
|
|
|
|
## Computer Spec |
|
|
|
|
|
**Machine:** *RunPod VM(GPU, NVIDIA A100 PCIe)* |
|
|
|
|
|
## Dataset |
|
|
Details of the dataset used can be found [here](https://github.com/DiamondGotCat/Zeta-Dataset/releases/tag/zeta-2) |
|
|
|
|
|
## Links |
|
|
GitHub: [Zeta](https://github.com/Zeta-LLM/Zeta/) |
|
|
|
|
|
--- |
|
|
|
|
|
Zeta is just a small SLM. |
|
|
But don't forget that it has big dreams inside. |
