bstraehle commited on
Commit
5683fa1
1 Parent(s): ff1b5b7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -1
README.md CHANGED
@@ -3,4 +3,14 @@ library_name: transformers
3
  tags: []
4
  ---
5
 
6
- This is work in progress. I am experimenting with full Fine-Tuning and PEFT (Parameter-Efficient Fine-Tuning), including LoRA (Low-Rank Adaptation) and QLoRA (Quantized Low-Rank Adaptation), using model [meta-llama/Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) and dataset [gretelai/synthetic_text_to_sql](https://huggingface.co/datasets/gretelai/synthetic_text_to_sql).
 
 
 
 
 
 
 
 
 
 
 
3
  tags: []
4
  ---
5
 
6
+ I am working on:
7
+
8
+ * Full Fine-Tuning and
9
+ * PEFT (Parameter-Efficient Fine-Tuning), including
10
+ * LoRA (Low-Rank Adaptation) and
11
+ * QLoRA (Quantized Low-Rank Adaptation)
12
+
13
+ Using example:
14
+
15
+ * Model [meta-llama/Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) and
16
+ * Dataset [gretelai/synthetic_text_to_sql](https://huggingface.co/datasets/gretelai/synthetic_text_to_sql).