taranetsdan
commited on
Commit
•
7284cf2
1
Parent(s):
0bf3285
Update README.md
Browse files
README.md
CHANGED
@@ -14,11 +14,13 @@ tags:
|
|
14 |
|
15 |
This repository contains the [`T-pro-it-1.0`](https://huggingface.co/t-tech/T-pro-it-1.0/) model, which has been quantized into the GGUF format using the [`llama.cpp`](https://github.com/ggerganov/llama.cpp) repository.
|
16 |
|
|
|
|
|
17 |
## 📊 Benchmarks
|
18 |
|
19 |
-
| Benchmark | T-pro-it-1.0
|
20 |
-
|
21 |
-
| Arena-Hard-Ru | **90.17**
|
22 |
|
23 |
## Llama.cpp usage
|
24 |
|
|
|
14 |
|
15 |
This repository contains the [`T-pro-it-1.0`](https://huggingface.co/t-tech/T-pro-it-1.0/) model, which has been quantized into the GGUF format using the [`llama.cpp`](https://github.com/ggerganov/llama.cpp) repository.
|
16 |
|
17 |
+
Detailed evaluation results of oringal model can be found in our [habr post](https://habr.com/ru/companies/tbank/articles/865582/).
|
18 |
+
|
19 |
## 📊 Benchmarks
|
20 |
|
21 |
+
| Benchmark | T-pro-it-1.0 | T-pro-it-1.0-Q4_K_M | T-pro-it-1.0-Q5_K_M | T-pro-it-1.0-Q6_K | T-pro-it-1.0-Q8_0 |
|
22 |
+
|------------------------------------------------|--------------------------------------|-----------------------------------|-----------------------------------|------------------------------|------------------------------|
|
23 |
+
| Arena-Hard-Ru | **90.17** (-1.3, 1.5) | 89.0 (-1.5, 1.3) | 89.29 (-1.6, 1.3) | 88.5 (-1.3, 1.3) | 89.35 (-1.2, 1.2) |
|
24 |
|
25 |
## Llama.cpp usage
|
26 |
|