cindyangelira commited on
Commit
7e9d5ee
1 Parent(s): fbe2ae7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +90 -91
README.md CHANGED
@@ -5,7 +5,8 @@ tags: []
5
 
6
  # Model Card for Model ID
7
 
8
- <!-- Provide a quick summary of what the model is/does. -->
 
9
 
10
 
11
 
@@ -17,197 +18,195 @@ tags: []
17
 
18
  This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
19
 
20
- - **Developed by:** [More Information Needed]
21
- - **Funded by [optional]:** [More Information Needed]
22
- - **Shared by [optional]:** [More Information Needed]
23
- - **Model type:** [More Information Needed]
24
- - **Language(s) (NLP):** [More Information Needed]
25
- - **License:** [More Information Needed]
26
- - **Finetuned from model [optional]:** [More Information Needed]
27
 
28
- ### Model Sources [optional]
29
 
30
  <!-- Provide the basic links for the model. -->
31
-
32
  - **Repository:** [More Information Needed]
33
  - **Paper [optional]:** [More Information Needed]
34
- - **Demo [optional]:** [More Information Needed]
35
 
36
- ## Uses
37
 
38
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
 
40
- ### Direct Use
41
 
42
  <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
 
44
- [More Information Needed]
45
 
46
- ### Downstream Use [optional]
47
 
48
  <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
 
50
- [More Information Needed]
51
 
52
- ### Out-of-Scope Use
53
 
54
- <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
 
56
- [More Information Needed]
57
 
58
- ## Bias, Risks, and Limitations
59
 
60
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
 
62
- [More Information Needed]
63
 
64
- ### Recommendations
65
 
66
  <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
 
68
  Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
 
70
- ## How to Get Started with the Model
71
 
72
  Use the code below to get started with the model.
73
 
74
- [More Information Needed]
 
 
75
 
76
- ## Training Details
 
 
 
 
77
 
78
- ### Training Data
79
 
80
  <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
 
82
- [More Information Needed]
83
 
84
- ### Training Procedure
85
 
86
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
 
88
- #### Preprocessing [optional]
89
 
90
- [More Information Needed]
91
 
92
 
93
- #### Training Hyperparameters
94
 
95
- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
 
97
- #### Speeds, Sizes, Times [optional]
98
 
99
  <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
 
101
- [More Information Needed]
102
-
103
- ## Evaluation
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
104
 
105
  <!-- This section describes the evaluation protocols and provides the results. -->
106
 
107
- ### Testing Data, Factors & Metrics
108
 
109
- #### Testing Data
110
 
111
  <!-- This should link to a Dataset Card if possible. -->
112
 
113
- [More Information Needed]
114
 
115
- #### Factors
116
 
117
  <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
 
119
- [More Information Needed]
120
 
121
- #### Metrics
122
- **Training loss epoch:** 0.005518221071622179 \
123
- **Training accuracy epoch:** 0.9964884720585756 \
124
- **Validation Loss:** 0.0042953278648501505 \
125
- **Validation Accuracy:** 0.9976648087554244
126
 
127
- [More Information Needed]
128
 
129
- ### Results
130
 
131
- | Entity | Precision | Recall | F1-Score | Support |
132
- |------------|-----------|--------|----------|---------|
133
- | ACCOUNT | 0.99 | 1.00 | 1.00 | 6000 |
134
- | DOB | 1.00 | 1.00 | 1.00 | 1631 |
135
- | EMAIL | 1.00 | 1.00 | 1.00 | 12169 |
136
- | ID | 1.00 | 0.99 | 0.99 | 4321 |
137
- | LOCATION | 0.99 | 0.99 | 0.99 | 11748 |
138
- | PERSON | 0.99 | 0.98 | 0.99 | 7339 |
139
- | PHONE | 1.00 | 1.00 | 1.00 | 7272 |
140
- | **micro avg** | 0.99 | 0.99 | 0.99 | 50480 |
141
- | **macro avg** | 1.00 | 1.00 | 1.00 | 50480 |
142
- | **weighted avg** | 0.99 | 0.99 | 0.99 | 50480 |
143
 
144
 
145
- #### Summary
 
146
 
147
 
148
-
149
- ## Model Examination [optional]
150
 
151
  <!-- Relevant interpretability work for the model goes here -->
152
 
153
- [More Information Needed]
154
 
155
- ## Environmental Impact
156
 
157
  <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
158
 
159
- Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
160
-
161
  - **Hardware Type:** [More Information Needed]
162
  - **Hours used:** [More Information Needed]
163
  - **Cloud Provider:** [More Information Needed]
164
  - **Compute Region:** [More Information Needed]
165
- - **Carbon Emitted:** [More Information Needed]
166
-
167
- ## Technical Specifications [optional]
168
 
169
- ### Model Architecture and Objective
170
 
171
- [More Information Needed]
172
 
173
- ### Compute Infrastructure
174
 
175
- [More Information Needed]
176
 
177
- #### Hardware
 
 
178
 
179
- [More Information Needed]
180
 
181
- #### Software
182
 
183
- [More Information Needed]
184
 
185
- ## Citation [optional]
186
 
187
  <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
188
 
189
- **BibTeX:**
190
 
191
- [More Information Needed]
192
 
193
- **APA:**
194
 
195
- [More Information Needed]
196
 
197
- ## Glossary [optional]
198
 
199
  <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
200
 
201
- [More Information Needed]
202
 
203
- ## More Information [optional]
204
 
205
- [More Information Needed]
206
 
207
- ## Model Card Authors [optional]
208
 
209
- [More Information Needed]
210
 
211
- ## Model Card Contact
212
 
213
- [More Information Needed]
 
5
 
6
  # Model Card for Model ID
7
 
8
+ This model is a fine-tuned version of [FacebookAI/xlm-roberta-large-finetuned-conll03-english](https://huggingface.co/FacebookAI/xlm-roberta-large-finetuned-conll03-english) on a synthetic Named Entity Recognition (NER) dataset in Bahasa Indonesia.
9
+ The dataset contains 25,000 samples in BIO format with annotations for various entity types.
10
 
11
 
12
 
 
18
 
19
  This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
20
 
21
+ - **Base Model:** Roberta
22
+ - **Model type:** Token Classification
23
+ - **Language(s) (NLP):** Bahasa Indonesia
24
+ - **Finetuned from model [optional]:** xlm-roberta-large-finetuned-conll03-english
 
 
 
25
 
26
+ <!-- ### Model Sources [optional] -->
27
 
28
  <!-- Provide the basic links for the model. -->
29
+ <!--
30
  - **Repository:** [More Information Needed]
31
  - **Paper [optional]:** [More Information Needed]
32
+ - **Demo [optional]:** [More Information Needed] -->
33
 
34
+ <!-- ## Uses
35
 
36
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
37
 
38
+ <!-- ### Direct Use
39
 
40
  <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
41
 
42
+ <!-- [More Information Needed] -->
43
 
44
+ <!-- ### Downstream Use [optional] -->
45
 
46
  <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
47
 
48
+ <!-- [More Information Needed] -->
49
 
50
+ <!-- ### Out-of-Scope Use -->
51
 
52
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. --> --> -->
53
 
54
+ <!-- [More Information Needed] -->
55
 
56
+ <!-- ## Bias, Risks, and Limitations -->
57
 
58
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
59
 
60
+ <!-- [More Information Needed] -->
61
 
62
+ <!-- ### Recommendations -->
63
 
64
  <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
65
 
66
  Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
67
 
68
+ <!-- ## How to Get Started with the Model -->
69
 
70
  Use the code below to get started with the model.
71
 
72
+ <!-- [More Information Needed] -->
73
+
74
+ <!-- ## Training Details -->
75
 
76
+ ### Training Performance
77
+ | Epoch | Training Loss | Training Accuracy |
78
+ |-------|------------------------|---------------------------|
79
+ | 1 | 0.012390273481311305 | 0.9912830868740373 |
80
+ | 2 | 0.002953063364330592 | 0.9979232802183077 |
81
 
 
82
 
83
  <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
84
 
85
+ <!-- [More Information Needed] -->
86
 
87
+ <!-- ### Training Procedure -->
88
 
89
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
90
 
91
+ <!-- #### Preprocessing [optional] -->
92
 
93
+ <!-- [More Information Needed] -->
94
 
95
 
96
+ <!-- #### Training Hyperparameters -->
97
 
98
+ <!-- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision --> -->
99
 
100
+ <!-- #### Speeds, Sizes, Times [optional] -->
101
 
102
  <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
103
 
104
+ <!-- [More Information Needed] -->
105
+
106
+ ### Performance
107
+ | Entity Type | Precision | Recall | F1-Score | Support |
108
+ |-------------|-----------|--------|----------|---------|
109
+ | DATE_TIME | 1.00 | 0.99 | 0.99 | 1474 |
110
+ | EMAIL | 1.00 | 1.00 | 1.00 | 8936 |
111
+ | GENDER | 1.00 | 1.00 | 1.00 | 1142 |
112
+ | LOC | 1.00 | 0.99 | 1.00 | 8295 |
113
+ | PER | 1.00 | 1.00 | 1.00 | 17005 |
114
+ | PHONE | 1.00 | 1.00 | 1.00 | 5845 |
115
+ | SSN | 1.00 | 1.00 | 1.00 | 16654 |
116
+ | **Micro Avg** | 1.00 | 1.00 | 1.00 | 59351 |
117
+ | **Macro Avg** | 1.00 | 1.00 | 1.00 | 59351 |
118
+ | **Weighted Avg** | 1.00 | 1.00 | 1.00 | 59351 |
119
+
120
+ Validation Loss: 0.0009539824152059737
121
+ Validation Accuracy: 0.999389430961554
122
 
123
  <!-- This section describes the evaluation protocols and provides the results. -->
124
 
125
+ <!-- ### Testing Data, Factors & Metrics -->
126
 
127
+ <!-- #### Testing Data -->
128
 
129
  <!-- This should link to a Dataset Card if possible. -->
130
 
131
+ <!-- [More Information Needed] -->
132
 
133
+ <!-- #### Factors -->
134
 
135
  <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
136
 
137
+ <!-- [More Information Needed] -->
138
 
 
 
 
 
 
139
 
 
140
 
 
141
 
 
 
 
 
 
 
 
 
 
 
 
 
142
 
143
 
144
+ <!-- #### Summary -->
145
+ <!-- -->
146
 
147
 
148
+ <!-- ## Model Examination [optional] -->
 
149
 
150
  <!-- Relevant interpretability work for the model goes here -->
151
 
152
+ <!-- [More Information Needed] -->
153
 
154
+ <!-- ## Environmental Impact
155
 
156
  <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
157
 
158
+ <!-- Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700). -->
159
+ <!--
160
  - **Hardware Type:** [More Information Needed]
161
  - **Hours used:** [More Information Needed]
162
  - **Cloud Provider:** [More Information Needed]
163
  - **Compute Region:** [More Information Needed]
164
+ - **Carbon Emitted:** [More Information Needed] -->
 
 
165
 
166
+ <!-- ## Technical Specifications [optional] -->
167
 
168
+ <!-- ### Model Architecture and Objective -->
169
 
170
+ <!-- [More Information Needed] -->
171
 
172
+ <!-- ### Compute Infrastructure -->
173
 
174
+ <!-- [More Information Needed] -->
175
+ <!-- -->
176
+ <!-- #### Hardware -->
177
 
178
+ <!-- [More Information Needed] -->
179
 
180
+ <!-- #### Software -->
181
 
182
+ <!-- [More Information Needed] -->
183
 
184
+ <!-- ## Citation [optional] -->
185
 
186
  <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
187
 
188
+ <!-- **BibTeX:** -->
189
 
190
+ <!-- [More Information Needed] -->
191
 
192
+ <!-- **APA:** -->
193
 
194
+ <!-- [More Information Needed] -->
195
 
196
+ <!-- ## Glossary [optional] -->
197
 
198
  <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
199
 
200
+ <!-- [More Information Needed] -->
201
 
202
+ <!-- ## More Information [optional] -->
203
 
204
+ <!-- [More Information Needed] -->
205
 
206
+ <!-- ## Model Card Authors [optional] -->
207
 
208
+ <!-- [More Information Needed] -->
209
 
210
+ <!-- ## Model Card Contact -->
211
 
212
+ <!-- [More Information Needed] --> -->