| language: | |
| - en | |
| library_name: transformers | |
| base_model: [] | |
| tags: | |
| - mergekit | |
| - merge | |
| - Yi | |
| license: apache-2.0 | |
| quant of [brucethemoose's](https://huggingface.co/brucethemoose) [Yi-34B-200K-DARE-merge-v7](https://huggingface.co/brucethemoose/Yi-34B-200K-DARE-merge-v7) | |
| ``` | |
| python3 convert.py \ | |
| -i /input/brucethemoose_Yi-34B-200K-DARE-merge-v7/ \ | |
| -c /input/pippa_cleaned/0000.parquet \ | |
| -o /output/temp/ \ | |
| -cf /output/Yi-34B-200K-DARE-merge-v7-4.65bpw-h6-exl2/ \ | |
| -l 8192 \ | |
| -ml 8192 \ | |
| -b 4.65 \ | |
| -hb 6 | |
| ``` |