MrDragonFox
commited on
Commit
•
61100ba
1
Parent(s):
d93e46d
Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
--max_seq_len 8192 --compress_pos_emb 4 --loader exllama_hf
|
2 |
check monkeypatch in ooba ..
|
3 |
|
4 |
-
for 16384 compress_pos_emb
|
5 |
|
6 |
works on 2 a6000 just fine
|
|
|
1 |
--max_seq_len 8192 --compress_pos_emb 4 --loader exllama_hf
|
2 |
check monkeypatch in ooba ..
|
3 |
|
4 |
+
for 16384 compress_pos_emb 8
|
5 |
|
6 |
works on 2 a6000 just fine
|