bullerwins
/

c4ai-command-r-08-2024-exl2_4.0bpw

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

bullerwins commited on 27 days ago

Commit

8d6cb82

•

1 Parent(s): 1cb3e80

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -274,7 +274,9 @@ extra_gated_fields:
      - No
  I agree to use this model for non-commercial use ONLY: checkbox
 ---
 # Model Card for C4AI Command R 08-2024

      - No
  I agree to use this model for non-commercial use ONLY: checkbox
 ---
+EXL2 quantized model using [exllamav2 0.2.0](https://github.com/turboderp/exllamav2)
+Original model [CohereForAI/c4ai-command-r-08-2024](https://huggingface.co/CohereForAI/c4ai-command-r-08-2024)
 # Model Card for C4AI Command R 08-2024