Update README.md
Browse files
README.md
CHANGED
|
@@ -1,5 +1,12 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
| 4 |
<h2>Running "Llama-3.3-70B-Instruct" at "IQ1_S" on a 16 GB card at 13-15 t/s</h2>
|
| 5 |
|
|
@@ -556,5 +563,4 @@ As the ship went dark and cold, Jenkins closed her eyes. She felt the creeping n
|
|
| 556 |
|
| 557 |
With heavy heart, Jenkins allowed herself to be consumed by the starry expanse, her thoughts drifting away from the desolate cockpit towards memories of warmth and connection with those now lost.
|
| 558 |
|
| 559 |
-
In the end, Jenkins' message did reach Earth. Though its significance could never be fully understood by those who received it, Jenkins knew that it spoke of a human connection – a bond between herself and her fallen crew – which refused to be severed by the vastness of space, nor by death itself.
|
| 560 |
-
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
tags:
|
| 4 |
+
- llama 3.3
|
| 5 |
+
- IQ1_M
|
| 6 |
+
- IQ1_S
|
| 7 |
+
- 70B models
|
| 8 |
+
- low quants settings
|
| 9 |
+
- guide to low BPW quants
|
| 10 |
---
|
| 11 |
<h2>Running "Llama-3.3-70B-Instruct" at "IQ1_S" on a 16 GB card at 13-15 t/s</h2>
|
| 12 |
|
|
|
|
| 563 |
|
| 564 |
With heavy heart, Jenkins allowed herself to be consumed by the starry expanse, her thoughts drifting away from the desolate cockpit towards memories of warmth and connection with those now lost.
|
| 565 |
|
| 566 |
+
In the end, Jenkins' message did reach Earth. Though its significance could never be fully understood by those who received it, Jenkins knew that it spoke of a human connection – a bond between herself and her fallen crew – which refused to be severed by the vastness of space, nor by death itself.
|
|
|