Update finetune_sample/README.md
Browse files
finetune_sample/README.md
CHANGED
@@ -8,12 +8,13 @@ python3 -m venv gptq_finetune
|
|
8 |
source gptq_finetune/bin/activate
|
9 |
|
10 |
|
11 |
-
pip install transformers==4.
|
12 |
pip install datasets
|
13 |
pip install peft==0.5.0
|
14 |
pip install trl
|
15 |
pip install auto-gptq
|
16 |
pip install optimum
|
|
|
17 |
|
18 |
# finetune qlora
|
19 |
python3 finetune.py
|
@@ -30,15 +31,17 @@ ValueError: Target module QuantLinear() is not supported. Currently, only `torch
|
|
30 |
It's because peft old version.
|
31 |
|
32 |
I don't know if it's required, but the version of my running environment.
|
33 |
-
* auto-gptq 0.4.
|
34 |
-
* trl 0.7.
|
35 |
-
* optimum 1.
|
36 |
-
* datasets 2.14.
|
37 |
|
38 |
The official documentation says to install from source, but sometimes that causes errors.
|
39 |
If you can't get it to work, it might be better to wait until the stable version comes out.
|
40 |
Good luck!
|
41 |
|
|
|
|
|
42 |
|
43 |
- finetune.py gptq finetune sample file.
|
44 |
- jawiki3.csv sample data.(Japanese)
|
|
|
8 |
source gptq_finetune/bin/activate
|
9 |
|
10 |
|
11 |
+
pip install transformers==4.34.1
|
12 |
pip install datasets
|
13 |
pip install peft==0.5.0
|
14 |
pip install trl
|
15 |
pip install auto-gptq
|
16 |
pip install optimum
|
17 |
+
pip install torch==2.0.1
|
18 |
|
19 |
# finetune qlora
|
20 |
python3 finetune.py
|
|
|
31 |
It's because peft old version.
|
32 |
|
33 |
I don't know if it's required, but the version of my running environment.
|
34 |
+
* auto-gptq 0.4.2
|
35 |
+
* trl 0.7.2
|
36 |
+
* optimum 1.13.2
|
37 |
+
* datasets 2.14.6
|
38 |
|
39 |
The official documentation says to install from source, but sometimes that causes errors.
|
40 |
If you can't get it to work, it might be better to wait until the stable version comes out.
|
41 |
Good luck!
|
42 |
|
43 |
+
If you encounter "RuntimeError: Unrecognized tensor type ID: AutocastCUDA", chech your torch version.
|
44 |
+
|
45 |
|
46 |
- finetune.py gptq finetune sample file.
|
47 |
- jawiki3.csv sample data.(Japanese)
|