Update README.md
Browse files
README.md
CHANGED
|
@@ -51,15 +51,15 @@ This is multilingual model, with a focus on Arabic.
|
|
| 51 |
|
| 52 |
## Quickstart
|
| 53 |
|
| 54 |
-
You can run the following
|
| 55 |
execute the model.
|
| 56 |
|
| 57 |
```
|
| 58 |
-
wget https://huggingface.co/jartine/aya-23-8B-llamafile/resolve/main/aya-23-8B.
|
| 59 |
-
chmod +x aya-23-8B.
|
| 60 |
-
./aya-23-8B.
|
| 61 |
-
./aya-23-8B.
|
| 62 |
-
./aya-23-8B.
|
| 63 |
```
|
| 64 |
|
| 65 |
Alternatively, you may download an official `llamafile` executable from
|
|
@@ -67,7 +67,7 @@ Mozilla Ocho on GitHub, in which case you can use the Mixtral llamafiles
|
|
| 67 |
as a simple weights data file.
|
| 68 |
|
| 69 |
```
|
| 70 |
-
llamafile -m ./aya-23-8B.
|
| 71 |
```
|
| 72 |
|
| 73 |
For further information, please see the [llamafile
|
|
@@ -82,7 +82,7 @@ of the README.
|
|
| 82 |
Command-line instruction example:
|
| 83 |
|
| 84 |
```
|
| 85 |
-
./aya-23-8B.
|
| 86 |
<|START_OF_TURN_TOKEN|>
|
| 87 |
<|USER_TOKEN|>Who is the president?<|END_OF_TURN_TOKEN|>
|
| 88 |
<|START_OF_TURN_TOKEN|>
|
|
|
|
| 51 |
|
| 52 |
## Quickstart
|
| 53 |
|
| 54 |
+
You can run the following commands which download, concatenate, and
|
| 55 |
execute the model.
|
| 56 |
|
| 57 |
```
|
| 58 |
+
wget https://huggingface.co/jartine/aya-23-8B-llamafile/resolve/main/aya-23-8B.Q6_K.llamafile
|
| 59 |
+
chmod +x aya-23-8B.Q6_K.llamafile
|
| 60 |
+
./aya-23-8B.Q6_K.llamafile --help # view manual
|
| 61 |
+
./aya-23-8B.Q6_K.llamafile # launch web gui + oai api
|
| 62 |
+
./aya-23-8B.Q6_K.llamafile -p ... # cli interface (scriptable)
|
| 63 |
```
|
| 64 |
|
| 65 |
Alternatively, you may download an official `llamafile` executable from
|
|
|
|
| 67 |
as a simple weights data file.
|
| 68 |
|
| 69 |
```
|
| 70 |
+
llamafile -m ./aya-23-8B.Q6_K.llamafile ...
|
| 71 |
```
|
| 72 |
|
| 73 |
For further information, please see the [llamafile
|
|
|
|
| 82 |
Command-line instruction example:
|
| 83 |
|
| 84 |
```
|
| 85 |
+
./aya-23-8B.Q6_K.llamafile --log-disable --silent-prompt -p '<BOS_TOKEN>
|
| 86 |
<|START_OF_TURN_TOKEN|>
|
| 87 |
<|USER_TOKEN|>Who is the president?<|END_OF_TURN_TOKEN|>
|
| 88 |
<|START_OF_TURN_TOKEN|>
|