ProphetOfBostrom
/

Kyllene-57B-V1.0-imat-GGUF

Model card Files Files and versions Community

ProphetOfBostrom commited on Mar 4, 2024

Commit

4f670b0

·

verified ·

1 Parent(s): 5e16f7a

Update README.md

Files changed (1) hide show

README.md +6 -4

README.md CHANGED Viewed

@@ -3,10 +3,12 @@ license: other
 license_name: yi-license
 license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
 ---
- nvm looks like the tokenizer on the source file's broken anyway. probably the base model too. loves `</s>` for some reason but Yi doesn't use that?
- no downloads, make it yourself; the imatrix works. i'm feeling very irritable now. do people not test these things? I know git-lfs hasn't been subject to any QA ever so ?
----
 the dataset file was made by concatenating most of the [default exllamav2 calibration data](https://github.com/turboderp/exllamav2/tree/master/conversion/standard_cal_data). a 900kb file of coherent text only, with some formatting and code but no endless broken html tags or nonsense. includes multilingual, for those deep layers.
 like this:
 ```

 license_name: yi-license
 license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
 ---
+#### nah, and it looks like the tokenizer on the source file's broken anyway. probably the base model too. loves `</s>` for some reason but Yi doesn't use that?
+ made from [TeeZee/Kyllene-57B-v1.0.q6_k.gguf](/TeeZee/Kyllene-57B-v1.0-GGUF/blob/main/Kyllene-57B-v1.0.q6_K.gguf)
+ no quants here to download. i did try. make it yourself; the imatrix works and i'm feeling very irritable now. do people not test these things? I know git-lfs hasn't been subject to any QA ever so maybe?
 the dataset file was made by concatenating most of the [default exllamav2 calibration data](https://github.com/turboderp/exllamav2/tree/master/conversion/standard_cal_data). a 900kb file of coherent text only, with some formatting and code but no endless broken html tags or nonsense. includes multilingual, for those deep layers.
 like this:
 ```