taranetsdan
commited on
Commit
•
1d12ce2
1
Parent(s):
2069430
Update README.md
Browse files
README.md
CHANGED
@@ -14,10 +14,10 @@ tags:
|
|
14 |
|
15 |
This repository contains the [`T-pro-it-1.0`](https://huggingface.co/t-tech/T-pro-it-1.0/) model, which has been quantized into the GGUF format using the [`llama.cpp`](https://github.com/ggerganov/llama.cpp) repository.
|
16 |
|
17 |
-
Detailed evaluation results of oringal model can be found in our [habr post](https://habr.com/ru/companies/tbank/articles/865582/).
|
18 |
-
|
19 |
## 📊 Benchmarks
|
20 |
|
|
|
|
|
21 |
| Benchmark | T-pro-it-1.0 | T-pro-it-1.0-Q4_K_M | T-pro-it-1.0-Q5_K_M | T-pro-it-1.0-Q6_K | T-pro-it-1.0-Q8_0 |
|
22 |
|------------------------------------------------|--------------------------------------|-----------------------------------|-----------------------------------|------------------------------|------------------------------|
|
23 |
| Arena-Hard-Ru | **90.17** (-1.3, 1.5) | 89.0 (-1.5, 1.3) | 89.29 (-1.6, 1.3) | 88.5 (-1.3, 1.3) | 89.35 (-1.2, 1.2) |
|
|
|
14 |
|
15 |
This repository contains the [`T-pro-it-1.0`](https://huggingface.co/t-tech/T-pro-it-1.0/) model, which has been quantized into the GGUF format using the [`llama.cpp`](https://github.com/ggerganov/llama.cpp) repository.
|
16 |
|
|
|
|
|
17 |
## 📊 Benchmarks
|
18 |
|
19 |
+
Detailed evaluation results of oringal model can be found in our [habr post](https://habr.com/ru/companies/tbank/articles/865582/).
|
20 |
+
|
21 |
| Benchmark | T-pro-it-1.0 | T-pro-it-1.0-Q4_K_M | T-pro-it-1.0-Q5_K_M | T-pro-it-1.0-Q6_K | T-pro-it-1.0-Q8_0 |
|
22 |
|------------------------------------------------|--------------------------------------|-----------------------------------|-----------------------------------|------------------------------|------------------------------|
|
23 |
| Arena-Hard-Ru | **90.17** (-1.3, 1.5) | 89.0 (-1.5, 1.3) | 89.29 (-1.6, 1.3) | 88.5 (-1.3, 1.3) | 89.35 (-1.2, 1.2) |
|