Hugging Face's logo

dranger003
/
c4ai-command-r-plus-iMat.GGUF

Text Generation
GGUF
Inference Endpoints
Model card Files Community
19
dranger003 commited on
Commit
235149d
•
1 Parent(s): 58e1953

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -6,6 +6,7 @@ base_model: CohereForAI/c4ai-command-r-plus
6
  ---
7
  **2024-04-09**: Support for this model has been merged into the main branch - [`PR #6491`](https://github.com/ggerganov/llama.cpp/pull/6491).
8
  Noeda's fork will not work with these weights, you will need the main branch of llama.cpp.
 
9
 
10
  * GGUF importance matrix (imatrix) quants for https://huggingface.co/CohereForAI/c4ai-command-r-plus
11
  * The importance matrix is trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).
 
6
  ---
7
  **2024-04-09**: Support for this model has been merged into the main branch - [`PR #6491`](https://github.com/ggerganov/llama.cpp/pull/6491).
8
  Noeda's fork will not work with these weights, you will need the main branch of llama.cpp.
9
+ I am currently running perplexity on all the quants posted here, and will update this model page with the results.
10
 
11
  * GGUF importance matrix (imatrix) quants for https://huggingface.co/CohereForAI/c4ai-command-r-plus
12
  * The importance matrix is trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).