mpasila
/

LLaMA2-13B-Psyfighter2-exl2-3bpw

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mpasila commited on Feb 4

Commit

e49abda

•

1 Parent(s): 100e09e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,6 +3,6 @@ license: llama2
 language:
 - en
 ---
-This is an EXL2 quantized model in 3bpw of [KoboldAI/LLaMA2-13B-Psyfighter2](https://huggingface.co/KoboldAI/LLaMA2-13B-Psyfighter2) using [PIPPA](https://huggingface.co/datasets/jasonkstevens/pippa-llama2-chat/blob/refs%2Fconvert%2Fparquet/default/train/0000.parquet) as the calibration dataset.
 Alpaca and ChatML prompt templates seem to work fine with this model.

 language:
 - en
 ---
+This is an EXL2 quantized model in 3bpw of [KoboldAI/LLaMA2-13B-Psyfighter2](https://huggingface.co/KoboldAI/LLaMA2-13B-Psyfighter2) using [PIPPA](https://huggingface.co/datasets/jasonkstevens/pippa-llama2-chat/blob/refs%2Fconvert%2Fparquet/default/train/0000.parquet) as the calibration dataset. (I might reupload this or add a new branch with a different version that uses the default calibration dataset instead)
 Alpaca and ChatML prompt templates seem to work fine with this model.