Text Generation
GGUF
Japanese
English
Inference Endpoints
Edit model card

QuantFactory/shisa-gamma-7b-v1-GGUF

This is quantized version of augmxnt/shisa-gamma-7b-v1 created using llama.cpp

Model Description

For more information see our main Shisa 7B model

We applied a version of our fine-tune data set onto Japanese Stable LM Base Gamma 7B and it performed pretty well, just sharing since it might be of interest.

Check out our JA MT-Bench results.

Comparison vs shisa-7b-v1

Comparison vs other recently released JA models

Downloads last month
365
GGUF
Model size
7.24B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples
Unable to determine this model's library. Check the docs .

Model tree for QuantFactory/shisa-gamma-7b-v1-GGUF

Quantized
(6)
this model

Dataset used to train QuantFactory/shisa-gamma-7b-v1-GGUF