---
library_name: transformers
datasets:
- NamCyan/tesoro-code
base_model:
- codellama/CodeLlama-7b-hf
---

# Improving the detection of technical debt in Java source code with an enriched dataset


## Model Details

### Model Description

This model is the part of Tesoro project, used for detecting technical debt in source code. More information can be found at [Tesoro HomePage](https://github.com/NamCyan/tesoro.git).

- **Developed by:** [Nam Hai Le](https://github.com/NamCyan)
- **Model type:** Decoder-based PLMs
- **Language(s):** Java
- **Finetuned from model:** [Codellama](https://huggingface.co/codellama/CodeLlama-7b-hf)

### Model Sources

- **Repository:** [Tesoro](https://github.com/NamCyan/tesoro.git)
- **Paper:** [To be update]

## How to Get Started with the Model

Use the code below to get started with the model.

```python
from transformers import AutoModelForSequenceClassification, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("NamCyan/CodeLlama-7b-technical-debt-code-tesoro")
model = AutoModelForSequenceClassification.from_pretrained("NamCyan/CodeLlama-7b-technical-debt-code-tesoro")
```


## Training Details

- Training Data: The model is finetuned using [tesoro-code](https://huggingface.co/datasets/NamCyan/tesoro-code)

- Infrastructure: Training process is conducted on two NVIDIA A100 GPUs with 80GB of VRAM. [LoRa](https://arxiv.org/abs/2106.09685) is adopted to train this model.


## Leaderboard
| Model | Model size  | EM            | F1              |
|:-------------|:-----------|:------------------|:------------------|
| **Encoder-based PLMs** |
| [CodeBERT](https://huggingface.co/microsoft/codebert-base)     | 125M       | 38.28             | 43.47             |
| [UniXCoder](https://huggingface.co/microsoft/unixcoder-base)    | 125M       | 38.12             | 42.58             |
| [GraphCodeBERT](https://huggingface.co/microsoft/graphcodebert-base)| 125M       | *39.38*          | *44.21*           |
| [RoBERTa](https://huggingface.co/FacebookAI/roberta-base)      | 125M       | 35.37             | 38.22             |
| [ALBERT](https://huggingface.co/albert/albert-base-v2)       | 11.8M      | 39.32             | 41.99             |
| **Encoder-Decoder-based PLMs** |
| [PLBART](https://huggingface.co/uclanlp/plbart-base)       | 140M       | 36.85             | 39.90             |
| [Codet5](https://huggingface.co/Salesforce/codet5-base)       | 220M       | 32.66             | 35.41             |
| [CodeT5+](https://huggingface.co/Salesforce/codet5p-220m)      | 220M       | 37.91             | 41.96             |
| **Decoder-based PLMs (LLMs)** |
| [TinyLlama](https://huggingface.co/TinyLlama/TinyLlama_v1.1_math_code)    | 1.03B      | 37.05             | 40.05             |
| [DeepSeek-Coder](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base) | 1.28B    | **42.52**         | **46.19**         |
| [OpenCodeInterpreter](https://huggingface.co/m-a-p/OpenCodeInterpreter-DS-1.3B)       | 1.35B             | 38.16             | 41.76             |
| [phi-2](https://huggingface.co/microsoft/phi-2)        | 2.78B      | 37.92             | 41.57             |
| [starcoder2](https://huggingface.co/bigcode/starcoder2-3b)   | 3.03B      | 35.37             | 41.77             |
| [CodeLlama](https://huggingface.co/codellama/CodeLlama-7b-hf)    | 6.74B      | 34.14             | 38.16             |
| [Magicoder](https://huggingface.co/ise-uiuc/Magicoder-S-DS-6.7B)    | 6.74B      | 39.14             | 42.49             |


## Citing us
```bibtex
@article{nam2024tesoro,
  title={Improving the detection of technical debt in Java source code with an enriched dataset},
  author={Hai, Nam Le and Bui, Anh M. T. Bui and Nguyen, Phuong T. and Ruscio, Davide Di and Kazman, Rick},
  journal={},
  year={2024}
}
```