mobiuslabsgmbh
/

Llama-3.1-8b-instruct_4bitgs64_hqq

Text Generation

Model card Files Files and versions Community

mobicham commited on Jul 29

Commit

2b2d413

•

1 Parent(s): 1064316

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -39,10 +39,10 @@ This is an <a href="https://github.com/mobiusml/hqq/">HQQ</a> all 4-bit (group-s
 ## Usage
 First, install the dependecies:
 ```
-pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu121; #nightly
 pip install git+https://github.com/mobiusml/hqq.git #master branch fix
 pip install bitblas
 ```
 Then you can use the sample code below:
 ``` Python

 ## Usage
 First, install the dependecies:
 ```
 pip install git+https://github.com/mobiusml/hqq.git #master branch fix
 pip install bitblas
 ```
+Also, make sure you use at least torch `2.4.0` or the nightly build.
 Then you can use the sample code below:
 ``` Python