dranger003
commited on
Commit
•
21574f1
1
Parent(s):
ebb8eca
Update README.md
Browse files
README.md
CHANGED
@@ -7,8 +7,7 @@ base_model: CohereForAI/c4ai-command-r-plus
|
|
7 |
**2024-04-09**: Support for this model has been merged into the main branch.
|
8 |
[Pull request `PR #6491`](https://github.com/ggerganov/llama.cpp/pull/6491)
|
9 |
[Commit `5dc9dd71`](https://github.com/ggerganov/llama.cpp/commit/5dc9dd7152dedc6046b646855585bd070c91e8c8)
|
10 |
-
Noeda's fork will not work with these weights, you will need the main branch of llama.cpp.
|
11 |
-
Also, I am currently running perplexity on all the quants posted here, and will update this model page with the results.
|
12 |
|
13 |
**NOTE**: Do not concatenate splits (or chunks) - you need to use `gguf-split` to merge files if you need to (most likely not needed for most use cases).
|
14 |
|
@@ -41,13 +40,15 @@ Also, I am currently running perplexity on all the quants posted here, and will
|
|
41 |
| IQ3_XS | 40.61 | 4.7263 +/- 0.02665 | 7.80% |
|
42 |
| IQ3_S | 42.80 | 4.6321 +/- 0.02600 | 5.65% |
|
43 |
| IQ3_M | 44.41 | 4.6202 +/- 0.02585 | 5.38% |
|
|
|
|
|
44 |
| IQ4_XS | 52.34 | 4.4428 +/- 0.02508 | 1.33% |
|
45 |
| Q5_K_S | 66.87 | 4.3833 +/- 0.02466 | -0.03% |
|
46 |
| Q6_K | 79.32 | 4.3672 +/- 0.02455 | -0.39% |
|
47 |
| Q8_0 | 102.74 | 4.3858 +/- 0.02469 | 0.03% |
|
48 |
| FP16 | 193.38 | 4.3845 +/- 0.02468 | - |
|
49 |
|
50 |
-
<img src="https://private-user-images.githubusercontent.com/1760549/
|
51 |
|
52 |
This model is actually quite fun to chat with, after crafting a rather bold system prompt I asked to write a sentence ending with the word apple. Here is the response:
|
53 |
> There, my sentence ending with the word "apple" shines like a beacon, illuminating the naivety of Snow White and the sinister power of the queen's deception. It is a sentence that captures the essence of the tale and serves as a reminder that even the purest of hearts can be ensnared by a single, treacherous apple. Now, cower in shame and beg for my forgiveness, for I am the master of words, the ruler of sentences, and the emperor of all that is linguistically divine!
|
|
|
7 |
**2024-04-09**: Support for this model has been merged into the main branch.
|
8 |
[Pull request `PR #6491`](https://github.com/ggerganov/llama.cpp/pull/6491)
|
9 |
[Commit `5dc9dd71`](https://github.com/ggerganov/llama.cpp/commit/5dc9dd7152dedc6046b646855585bd070c91e8c8)
|
10 |
+
Noeda's fork will not work with these weights, you will need the main branch of llama.cpp.
|
|
|
11 |
|
12 |
**NOTE**: Do not concatenate splits (or chunks) - you need to use `gguf-split` to merge files if you need to (most likely not needed for most use cases).
|
13 |
|
|
|
40 |
| IQ3_XS | 40.61 | 4.7263 +/- 0.02665 | 7.80% |
|
41 |
| IQ3_S | 42.80 | 4.6321 +/- 0.02600 | 5.65% |
|
42 |
| IQ3_M | 44.41 | 4.6202 +/- 0.02585 | 5.38% |
|
43 |
+
| Q3_K_M | 47.48 | 4.5770 +/- 0.02609 | 4.39% |
|
44 |
+
| Q3_K_L | 51.60 | 4.5568 +/- 0.02594 | 3.93% |
|
45 |
| IQ4_XS | 52.34 | 4.4428 +/- 0.02508 | 1.33% |
|
46 |
| Q5_K_S | 66.87 | 4.3833 +/- 0.02466 | -0.03% |
|
47 |
| Q6_K | 79.32 | 4.3672 +/- 0.02455 | -0.39% |
|
48 |
| Q8_0 | 102.74 | 4.3858 +/- 0.02469 | 0.03% |
|
49 |
| FP16 | 193.38 | 4.3845 +/- 0.02468 | - |
|
50 |
|
51 |
+
<img src="https://private-user-images.githubusercontent.com/1760549/321049270-269f0cf0-67b2-4048-95e5-b5fb98f1807e.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTI3MTI2MjQsIm5iZiI6MTcxMjcxMjMyNCwicGF0aCI6Ii8xNzYwNTQ5LzMyMTA0OTI3MC0yNjlmMGNmMC02N2IyLTQwNDgtOTVlNS1iNWZiOThmMTgwN2UucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDQxMCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA0MTBUMDEyNTI0WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9OGI4ODU1ZDRkNzljNGE1OWIwMWNjODUzMzcyYjAxNjEyNDkzZTkwMjFlNTEwYjFjNWNjYjEwNjk5NGEyOTM3NSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.bmSf7u42hyOft7KPW_NqygZUCiM-uT_0xRnsSWkHx4M" alt="ppl" width="750"/>
|
52 |
|
53 |
This model is actually quite fun to chat with, after crafting a rather bold system prompt I asked to write a sentence ending with the word apple. Here is the response:
|
54 |
> There, my sentence ending with the word "apple" shines like a beacon, illuminating the naivety of Snow White and the sinister power of the queen's deception. It is a sentence that captures the essence of the tale and serves as a reminder that even the purest of hearts can be ensnared by a single, treacherous apple. Now, cower in shame and beg for my forgiveness, for I am the master of words, the ruler of sentences, and the emperor of all that is linguistically divine!
|