akdeniz27 commited on
Commit
1f56ac4
1 Parent(s): fad6be3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -2
README.md CHANGED
@@ -1,9 +1,45 @@
1
  ---
2
  library_name: peft
 
 
 
3
  ---
4
  ## Training procedure
5
 
6
- ### Framework versions
 
 
7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
 
9
- - PEFT 0.4.0
 
 
 
 
 
1
  ---
2
  library_name: peft
3
+ language: tr
4
+ widget:
5
+ - text: "Mustafa Kemal Atatürk 19 Mayıs 1919'da Samsun'a çıktı."
6
  ---
7
  ## Training procedure
8
 
9
+ This is a fine-tuned model of base model "dbmdz/bert-base-turkish-cased" using the Parameter Efficient Fine Tuning (PEFT) with Low-Rank Adaptation (LoRA) technique
10
+ using a reviewed version of well known Turkish NER dataset
11
+ (https://github.com/stefan-it/turkish-bert/files/4558187/nerdata.txt).
12
 
13
+ # Fine-tuning parameters:
14
+ ```
15
+ task = "ner"
16
+ model_checkpoint = "dbmdz/bert-base-turkish-cased"
17
+ batch_size = 16
18
+ label_list = ['O', 'B-PER', 'I-PER', 'B-ORG', 'I-ORG', 'B-LOC', 'I-LOC']
19
+ max_length = 512
20
+ learning_rate = 1e-3
21
+ num_train_epochs = 10
22
+ weight_decay = 0.01
23
+ ```
24
+ # PEFT Parameters
25
+ ```
26
+ inference_mode=False
27
+ r=16
28
+ lora_alpha=16
29
+ lora_dropout=0.1
30
+ bias="all"
31
+ ```
32
+ # How to use:
33
+ ```
34
+ model = AutoModelForTokenClassification.from_pretrained("akdeniz27/bert-base-turkish-cased-ner")
35
+ tokenizer = AutoTokenizer.from_pretrained("akdeniz27/bert-base-turkish-cased-ner")
36
+ ner = pipeline('ner', model=model, tokenizer=tokenizer, aggregation_strategy="first")
37
+ ner("your text here")
38
+ ```
39
+ Pls refer "https://huggingface.co/transformers/_modules/transformers/pipelines/token_classification.html" for entity grouping with aggregation_strategy parameter.
40
 
41
+ # Reference test results:
42
+ * accuracy: 0.993104
43
+ * f1: 0.948413
44
+ * precision: 0.939789
45
+ * recall: 0.957196