matchaaaaa
commited on
Commit
•
1a0b022
1
Parent(s):
704254e
Update README.md
Browse files
README.md
CHANGED
@@ -19,9 +19,9 @@ pipeline_tag: text-generation
|
|
19 |
|
20 |
Meet Chaifighter-v3! A flagship frankenmerge blend brewed with love by yours truly!
|
21 |
|
22 |
-
Chaifighter-v3 brings back the hyper-attention of the original, vastly expands on the fixes used to make v2 usable, and is built on a modified [Chunky-Lemon-Cookie-11B](https://huggingface.co/FallenMerick/Chunky-Lemon-Cookie-11B). Moreover, it RoPEs up to 8K perfectly, and should work well
|
23 |
|
24 |
-
*Native Context Length: 4K/4096 (can be extended to
|
25 |
|
26 |
## Prompt Template: Alpaca/Alpaca-based
|
27 |
|
|
|
19 |
|
20 |
Meet Chaifighter-v3! A flagship frankenmerge blend brewed with love by yours truly!
|
21 |
|
22 |
+
Chaifighter-v3 brings back the hyper-attention of the original, vastly expands on the fixes used to make v2 usable, and is built on a modified [Chunky-Lemon-Cookie-11B](https://huggingface.co/FallenMerick/Chunky-Lemon-Cookie-11B). Moreover, it RoPEs up to 8K perfectly, and should work well up to 16K.
|
23 |
|
24 |
+
*Native Context Length: 4K/4096 (can be extended to 16K/16384 with RoPE scaling)*
|
25 |
|
26 |
## Prompt Template: Alpaca/Alpaca-based
|
27 |
|