Update README.md
Browse files
README.md
CHANGED
@@ -3,4 +3,14 @@ library_name: transformers
|
|
3 |
tags: []
|
4 |
---
|
5 |
|
6 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
tags: []
|
4 |
---
|
5 |
|
6 |
+
I am working on:
|
7 |
+
|
8 |
+
* Full Fine-Tuning and
|
9 |
+
* PEFT (Parameter-Efficient Fine-Tuning), including
|
10 |
+
* LoRA (Low-Rank Adaptation) and
|
11 |
+
* QLoRA (Quantized Low-Rank Adaptation)
|
12 |
+
|
13 |
+
Using example:
|
14 |
+
|
15 |
+
* Model [meta-llama/Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) and
|
16 |
+
* Dataset [gretelai/synthetic_text_to_sql](https://huggingface.co/datasets/gretelai/synthetic_text_to_sql).
|