---
library_name: transformers
tags: []
---

Work in progress:

* **Full Fine-Tuning** and
* **PEFT (Parameter-Efficient Fine-Tuning)**, including
  * **LoRA (Low-Rank Adaptation)** and
  * **QLoRA (Quantized Low-Rank Adaptation)**

Example:

* Model [**meta-llama/Meta-Llama-3.1-8B-Instruct**](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) and
* Dataset [**gretelai/synthetic_text_to_sql**](https://huggingface.co/datasets/gretelai/synthetic_text_to_sql)