Update README.md
Browse files
README.md
CHANGED
@@ -1,9 +1,45 @@
|
|
1 |
---
|
2 |
library_name: peft
|
|
|
|
|
|
|
3 |
---
|
4 |
## Training procedure
|
5 |
|
6 |
-
|
|
|
|
|
7 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
8 |
|
9 |
-
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
library_name: peft
|
3 |
+
language: tr
|
4 |
+
widget:
|
5 |
+
- text: "Mustafa Kemal Atatürk 19 Mayıs 1919'da Samsun'a çıktı."
|
6 |
---
|
7 |
## Training procedure
|
8 |
|
9 |
+
This is a fine-tuned model of base model "dbmdz/bert-base-turkish-cased" using the Parameter Efficient Fine Tuning (PEFT) with Low-Rank Adaptation (LoRA) technique
|
10 |
+
using a reviewed version of well known Turkish NER dataset
|
11 |
+
(https://github.com/stefan-it/turkish-bert/files/4558187/nerdata.txt).
|
12 |
|
13 |
+
# Fine-tuning parameters:
|
14 |
+
```
|
15 |
+
task = "ner"
|
16 |
+
model_checkpoint = "dbmdz/bert-base-turkish-cased"
|
17 |
+
batch_size = 16
|
18 |
+
label_list = ['O', 'B-PER', 'I-PER', 'B-ORG', 'I-ORG', 'B-LOC', 'I-LOC']
|
19 |
+
max_length = 512
|
20 |
+
learning_rate = 1e-3
|
21 |
+
num_train_epochs = 10
|
22 |
+
weight_decay = 0.01
|
23 |
+
```
|
24 |
+
# PEFT Parameters
|
25 |
+
```
|
26 |
+
inference_mode=False
|
27 |
+
r=16
|
28 |
+
lora_alpha=16
|
29 |
+
lora_dropout=0.1
|
30 |
+
bias="all"
|
31 |
+
```
|
32 |
+
# How to use:
|
33 |
+
```
|
34 |
+
model = AutoModelForTokenClassification.from_pretrained("akdeniz27/bert-base-turkish-cased-ner")
|
35 |
+
tokenizer = AutoTokenizer.from_pretrained("akdeniz27/bert-base-turkish-cased-ner")
|
36 |
+
ner = pipeline('ner', model=model, tokenizer=tokenizer, aggregation_strategy="first")
|
37 |
+
ner("your text here")
|
38 |
+
```
|
39 |
+
Pls refer "https://huggingface.co/transformers/_modules/transformers/pipelines/token_classification.html" for entity grouping with aggregation_strategy parameter.
|
40 |
|
41 |
+
# Reference test results:
|
42 |
+
* accuracy: 0.993104
|
43 |
+
* f1: 0.948413
|
44 |
+
* precision: 0.939789
|
45 |
+
* recall: 0.957196
|