OPEA
/

Falcon3-3B-Base-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

cicdatopea commited on 7 days ago

Commit

142fb79

•

1 Parent(s): a7e419e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -100,7 +100,7 @@ auto-round  \
 --bits 4 \
 --iter 2000 \
 --disable_eval \
---model_type float16 \
 --format 'auto_gptq,auto_round' \
 --output_dir "./tmp_autoround"
 ```

 --bits 4 \
 --iter 2000 \
 --disable_eval \
+--model_dtype float16 \
 --format 'auto_gptq,auto_round' \
 --output_dir "./tmp_autoround"
 ```