File size: 373 Bytes
b69135a
 
 
 
 
 
 
 
 
 
48236f7
b69135a
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
---
license: gemma
language:
- en
pipeline_tag: text-generation
tags:
- google
- gemma
- gguf
- imatrix
base_model: google/gemma-2-27b-it
---

# Quant Infos

- f32 gguf is from the official kaggle repo
- imatrix quants are WIP
- you will need the gemma2 llama.cpp [PR](https://github.com/ggerganov/llama.cpp/pull/8156) applied to your llama.cpp

# Original Model Card

TODO