Update README.md
Browse files
README.md
CHANGED
|
@@ -103,6 +103,25 @@ You then need to fill out the prompt / history template (see below).
|
|
| 103 |
For further information, please see the [llamafile
|
| 104 |
README](https://github.com/mozilla-ocho/llamafile/).
|
| 105 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 106 |
## Context Window
|
| 107 |
|
| 108 |
This model has a max context window size of 8k tokens. By default, a
|
|
|
|
| 103 |
For further information, please see the [llamafile
|
| 104 |
README](https://github.com/mozilla-ocho/llamafile/).
|
| 105 |
|
| 106 |
+
## Troubleshooting
|
| 107 |
+
|
| 108 |
+
Having **trouble?** See the ["Gotchas"
|
| 109 |
+
section](https://github.com/mozilla-ocho/llamafile/?tab=readme-ov-file#gotchas-and-troubleshooting)
|
| 110 |
+
of the README.
|
| 111 |
+
|
| 112 |
+
On Linux, the way to avoid run-detector errors is to install the APE
|
| 113 |
+
interpreter.
|
| 114 |
+
|
| 115 |
+
```sh
|
| 116 |
+
sudo wget -O /usr/bin/ape https://cosmo.zip/pub/cosmos/bin/ape-$(uname -m).elf
|
| 117 |
+
sudo chmod +x /usr/bin/ape
|
| 118 |
+
sudo sh -c "echo ':APE:M::MZqFpD::/usr/bin/ape:' >/proc/sys/fs/binfmt_misc/register"
|
| 119 |
+
sudo sh -c "echo ':APE-jart:M::jartsr::/usr/bin/ape:' >/proc/sys/fs/binfmt_misc/register"
|
| 120 |
+
```
|
| 121 |
+
|
| 122 |
+
On Windows there's a 4GB limit on executable sizes. This means you
|
| 123 |
+
should download the Q6\_K llamafile.
|
| 124 |
+
|
| 125 |
## Context Window
|
| 126 |
|
| 127 |
This model has a max context window size of 8k tokens. By default, a
|