billatsectorflow
/

Qwen2.5-72B-Instruct-GPTQ-Int4-64K

Text Generation

4-bit precision

Model card Files Files and versions Community

billatsectorflow commited on Sep 25

Commit

58afcc4

•

1 Parent(s): 0209042

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ tags:
 ---
 ---
-## Simple config.json modification of original model to enable 128K context window (rope scaling factor of 4.0), necessary as per: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4#processing-long-texts
 ---

 ---
 ---
+## Simple config.json modification of original model to enable 64K context window (rope scaling factor of 2.0), necessary as per: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4#processing-long-texts
 ---