Update README.md
Browse files
README.md
CHANGED
@@ -520,17 +520,6 @@ $ cargo run --example t5 --release -- \
|
|
520 |
--decode --temperature 0
|
521 |
```
|
522 |
|
523 |
-
We also provide a quantized model (1.65 GB vs the original 11.8 GB file):
|
524 |
-
|
525 |
-
```
|
526 |
-
cargo run --example quantized-t5 --release -- \
|
527 |
-
--model-id "jbochi/madlad400-7b-mt-bt" --weight-file "model-q4k.gguf" \
|
528 |
-
--prompt "<2de> How are you, my friend?" \
|
529 |
-
--temperature 0
|
530 |
-
...
|
531 |
-
Wie geht es dir, mein Freund?
|
532 |
-
```
|
533 |
-
|
534 |
</details>
|
535 |
|
536 |
|
|
|
520 |
--decode --temperature 0
|
521 |
```
|
522 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
523 |
</details>
|
524 |
|
525 |
|