updated with technical report
#2
by
mnagired
- opened
README.md
CHANGED
@@ -20,6 +20,7 @@ It outperforms other open-source models in the same space on standard benchmarks
|
|
20 |
- **Website**: [Granite Guardian Docs](https://www.ibm.com/granite/docs/models/guardian/)
|
21 |
- **Release Date**: October 21st, 2024
|
22 |
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
|
|
|
23 |
|
24 |
|
25 |
## Usage
|
@@ -262,4 +263,18 @@ For risks in RAG use cases, the model is evaluated on [TRUE](https://github.com/
|
|
262 |
|
263 |
| Metric | mnbm | begin | qags_xsum | qags_cnndm | summeval | dialfact | paws | q2 | frank | Average |
|
264 |
|---------|------|-------|-----------|------------|----------|----------|------|------|-------|---------|
|
265 |
-
| **AUC** | 0.72 | 0.75 | 0.79 | 0.79 | 0.81 | 0.91 | 0.82 | 0.85 | 0.89 | 0.81 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
20 |
- **Website**: [Granite Guardian Docs](https://www.ibm.com/granite/docs/models/guardian/)
|
21 |
- **Release Date**: October 21st, 2024
|
22 |
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
|
23 |
+
- **Technical Report:** [Granite Guardian](https://arxiv.org/abs/2412.07724)
|
24 |
|
25 |
|
26 |
## Usage
|
|
|
263 |
|
264 |
| Metric | mnbm | begin | qags_xsum | qags_cnndm | summeval | dialfact | paws | q2 | frank | Average |
|
265 |
|---------|------|-------|-----------|------------|----------|----------|------|------|-------|---------|
|
266 |
+
| **AUC** | 0.72 | 0.75 | 0.79 | 0.79 | 0.81 | 0.91 | 0.82 | 0.85 | 0.89 | 0.81 |
|
267 |
+
|
268 |
+
|
269 |
+
### Citation Information
|
270 |
+
```
|
271 |
+
@misc{padhi2024graniteguardian,
|
272 |
+
title={Granite Guardian},
|
273 |
+
author={Inkit Padhi and Manish Nagireddy and Giandomenico Cornacchia and Subhajit Chaudhury and Tejaswini Pedapati and Pierre Dognin and Keerthiram Murugesan and Erik Miehling and Martín Santillán Cooper and Kieran Fraser and Giulio Zizzo and Muhammad Zaid Hameed and Mark Purcell and Michael Desmond and Qian Pan and Inge Vejsbjerg and Elizabeth M. Daly and Michael Hind and Werner Geyer and Ambrish Rawat and Kush R. Varshney and Prasanna Sattigeri},
|
274 |
+
year={2024},
|
275 |
+
eprint={2412.07724},
|
276 |
+
archivePrefix={arXiv},
|
277 |
+
primaryClass={cs.CL},
|
278 |
+
url={https://arxiv.org/abs/2412.07724},
|
279 |
+
}
|
280 |
+
```
|