Hugging Face's logo

FarhadMadadzade
/
wav2vec2-large-xlsr-53-english-ser-cosine

Automatic Speech Recognition
Transformers
TensorBoard
Safetensors
wav2vec2
Generated from Trainer
audio
speech
speech-emotion-recognition
audio-classification
Inference Endpoints
Model card Files Metrics Community
1
wav2vec2-large-xlsr-53-english-ser-cosine / README.md
FarhadMadadzade's picture
FarhadMadadzade
Update README.md (#1)
3d56dfe verified
preview code
|
raw
history blame contribute delete
24.6 kB
metadata
license: apache-2.0
base_model: jonatasgrosman/wav2vec2-large-xlsr-53-english
tags:
  - generated_from_trainer
  - audio
  - automatic-speech-recognition
  - speech
  - speech-emotion-recognition
  - audio-classification
widget:
  - example_title: IEMOCAP clip "happy"
    src: >-
      https://cdn-media.huggingface.co/speech_samples/IEMOCAP_Ses01F_impro03_F013.wav
  - example_title: IEMOCAP clip "neutral"
    src: >-
      https://cdn-media.huggingface.co/speech_samples/IEMOCAP_Ses01F_impro04_F000.wav
metrics:
  - accuracy
model-index:
  - name: wav2vec2-large-xlsr-53-english-ser-cosine
    results: []

wav2vec2-large-xlsr-53-english-ser-cosine

This model is a fine-tuned version of jonatasgrosman/wav2vec2-large-xlsr-53-english on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.4677
  • Accuracy: 0.8677

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0001076429938136877
  • train_batch_size: 4
  • eval_batch_size: 4
  • seed: 42
  • gradient_accumulation_steps: 2
  • total_train_batch_size: 8
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: cosine_with_restarts
  • lr_scheduler_warmup_steps: 18
  • num_epochs: 3.0
  • mixed_precision_training: Native AMP

Training results

Training Loss Epoch Step Validation Loss Accuracy
1.7885 0.01 10 1.7963 0.1791
1.7907 0.02 20 1.7973 0.2638
1.8288 0.02 30 1.7546 0.2465
1.7803 0.03 40 1.7500 0.2087
1.7941 0.04 50 1.6953 0.2950
1.7934 0.05 60 1.6342 0.3714
1.6559 0.06 70 1.6199 0.2892
1.6214 0.07 80 1.5400 0.4117
1.5226 0.07 90 1.3802 0.4519
1.4954 0.08 100 1.3506 0.4717
1.4062 0.09 110 1.3328 0.4766
1.4507 0.1 120 1.1985 0.5464
1.2812 0.11 130 1.2826 0.4922
1.1494 0.12 140 1.0960 0.6187
1.1035 0.12 150 1.1925 0.5645
1.2784 0.13 160 1.0955 0.6015
1.0302 0.14 170 1.0418 0.6072
1.0068 0.15 180 0.9261 0.6804
1.112 0.16 190 1.1529 0.5867
1.0308 0.16 200 0.8637 0.7058
1.0464 0.17 210 0.9205 0.6426
0.9531 0.18 220 0.9363 0.6886
1.0228 0.19 230 0.9637 0.6615
1.1446 0.2 240 1.3015 0.5489
1.1146 0.21 250 0.9328 0.6483
0.849 0.21 260 0.8504 0.6746
0.7977 0.22 270 0.9533 0.6697
0.9397 0.23 280 0.9300 0.7083
0.8625 0.24 290 1.1020 0.6401
1.333 0.25 300 0.9816 0.6442
1.0022 0.25 310 0.8472 0.7067
0.8002 0.26 320 0.7866 0.7149
0.8987 0.27 330 0.7979 0.6976
0.9473 0.28 340 0.8600 0.6878
0.9001 0.29 350 0.8141 0.7034
0.9793 0.3 360 0.9872 0.6450
0.9189 0.3 370 0.8561 0.6845
0.9281 0.31 380 0.9055 0.6919
0.7118 0.32 390 0.7937 0.6984
1.0565 0.33 400 0.7339 0.7313
0.8467 0.34 410 0.8262 0.6836
0.9601 0.35 420 0.7464 0.7346
0.8911 0.35 430 0.7229 0.7338
0.9033 0.36 440 0.7393 0.7223
0.8961 0.37 450 0.7272 0.7428
0.7216 0.38 460 0.7183 0.7436
0.6935 0.39 470 0.8003 0.7083
0.7588 0.39 480 0.8471 0.7116
0.8766 0.4 490 0.6976 0.7379
0.6866 0.41 500 0.6806 0.7584
0.6822 0.42 510 0.7669 0.7256
0.7067 0.43 520 0.6885 0.7461
0.6159 0.44 530 0.7020 0.7535
0.8814 0.44 540 0.7478 0.7256
0.7786 0.45 550 0.6302 0.7691
0.6363 0.46 560 0.6745 0.7691
0.8518 0.47 570 0.6242 0.7666
0.8194 0.48 580 0.7154 0.7379
0.6755 0.49 590 0.7056 0.7543
0.7743 0.49 600 0.6823 0.7486
0.6457 0.5 610 0.7160 0.7502
0.4976 0.51 620 0.8222 0.7149
0.929 0.52 630 0.7318 0.7371
0.7981 0.53 640 0.7417 0.7461
0.7243 0.53 650 0.6831 0.7461
0.7332 0.54 660 0.6273 0.7592
0.7827 0.55 670 0.6158 0.7724
0.7733 0.56 680 0.7515 0.7371
0.8527 0.57 690 0.7200 0.7412
0.8355 0.58 700 0.7738 0.7436
0.5383 0.58 710 0.9081 0.7132
1.0851 0.59 720 0.6135 0.7831
0.7345 0.6 730 0.7032 0.7642
0.6648 0.61 740 0.6146 0.7781
0.612 0.62 750 0.6338 0.7732
0.6101 0.62 760 0.6772 0.7740
0.6498 0.63 770 0.7153 0.7601
0.6258 0.64 780 0.7871 0.7329
0.7943 0.65 790 0.6975 0.7691
0.8176 0.66 800 0.7692 0.7313
0.6682 0.67 810 0.5766 0.8012
0.4808 0.67 820 0.5882 0.7847
0.6331 0.68 830 0.5855 0.7896
0.874 0.69 840 0.7082 0.7568
0.8984 0.7 850 0.6078 0.7732
0.5861 0.71 860 0.6469 0.7814
0.6896 0.72 870 0.6997 0.7560
0.8237 0.72 880 0.6279 0.7650
0.5818 0.73 890 0.6763 0.7691
0.4781 0.74 900 0.6867 0.7592
0.6851 0.75 910 0.6142 0.7724
0.455 0.76 920 0.9159 0.7141
0.808 0.76 930 0.7518 0.7617
1.0634 0.77 940 0.6015 0.7839
0.6956 0.78 950 0.5895 0.7872
0.5169 0.79 960 0.6394 0.7773
0.6213 0.8 970 0.6890 0.7699
0.5506 0.81 980 0.7471 0.7560
0.6233 0.81 990 0.6525 0.7872
0.7666 0.82 1000 0.8002 0.7403
0.5644 0.83 1010 0.7067 0.7387
0.6038 0.84 1020 0.6091 0.7823
0.6211 0.85 1030 0.6749 0.7707
0.6758 0.86 1040 0.7102 0.7502
0.7353 0.86 1050 0.6959 0.7560
0.5687 0.87 1060 0.6831 0.7675
0.5606 0.88 1070 0.5945 0.7847
0.7309 0.89 1080 0.6737 0.7412
0.5951 0.9 1090 0.6574 0.7675
0.6062 0.9 1100 0.6740 0.7502
0.9606 0.91 1110 0.5730 0.7839
0.6625 0.92 1120 0.5922 0.7749
0.7908 0.93 1130 0.5652 0.7823
0.6387 0.94 1140 0.5268 0.8118
0.7141 0.95 1150 0.5628 0.7896
0.5587 0.95 1160 0.6479 0.7609
0.4817 0.96 1170 0.5410 0.8044
0.4444 0.97 1180 0.5950 0.8044
0.6776 0.98 1190 0.5993 0.8012
0.5989 0.99 1200 0.5745 0.7987
0.6334 1.0 1210 0.6220 0.7913
0.5216 1.0 1220 0.5936 0.7938
0.5127 1.01 1230 0.6741 0.7839
0.5632 1.02 1240 0.6501 0.7954
0.5335 1.03 1250 0.5721 0.8061
0.511 1.04 1260 0.5630 0.8102
0.5424 1.04 1270 0.5396 0.8135
0.771 1.05 1280 0.5580 0.8012
0.435 1.06 1290 0.5764 0.8036
0.5203 1.07 1300 0.6032 0.7913
0.4689 1.08 1310 0.6431 0.7872
0.481 1.09 1320 0.6019 0.7987
0.5938 1.09 1330 0.6198 0.7938
0.3972 1.1 1340 0.5842 0.8061
0.368 1.11 1350 0.5066 0.8127
0.4644 1.12 1360 0.6058 0.8012
0.6914 1.13 1370 0.5384 0.8217
0.3341 1.13 1380 0.5535 0.8143
0.5301 1.14 1390 0.5916 0.8020
0.5294 1.15 1400 0.6297 0.7938
0.7029 1.16 1410 0.5581 0.8102
0.322 1.17 1420 0.6066 0.7831
0.6871 1.18 1430 0.5141 0.8151
0.4026 1.18 1440 0.6888 0.7716
0.4484 1.19 1450 0.5499 0.8077
0.3767 1.2 1460 0.4825 0.8225
0.4274 1.21 1470 0.4932 0.8274
0.4584 1.22 1480 0.5168 0.8299
0.5741 1.23 1490 0.6384 0.7798
0.3877 1.23 1500 0.5789 0.8044
0.3734 1.24 1510 0.6415 0.7855
0.7986 1.25 1520 0.5575 0.8077
0.5634 1.26 1530 0.5684 0.8143
0.5136 1.27 1540 0.5393 0.8143
0.5331 1.27 1550 0.5203 0.8176
0.2918 1.28 1560 0.5510 0.8151
0.4425 1.29 1570 0.5783 0.8094
0.4245 1.3 1580 0.5433 0.8209
0.3317 1.31 1590 0.5845 0.8085
0.4583 1.32 1600 0.6147 0.7954
0.3298 1.32 1610 0.6249 0.8053
0.5248 1.33 1620 0.5722 0.8094
0.665 1.34 1630 0.5446 0.8217
0.3917 1.35 1640 0.5316 0.8258
0.4321 1.36 1650 0.5598 0.8217
0.3005 1.37 1660 0.6190 0.8151
0.4992 1.37 1670 0.5546 0.8184
0.586 1.38 1680 0.6416 0.7913
0.6481 1.39 1690 0.5324 0.8135
0.4008 1.4 1700 0.5786 0.8012
0.3463 1.41 1710 0.5145 0.8209
0.4994 1.41 1720 0.5650 0.8192
0.4093 1.42 1730 0.5191 0.8365
0.6375 1.43 1740 0.5734 0.8135
0.2303 1.44 1750 0.5447 0.8102
0.4824 1.45 1760 0.5139 0.8250
0.5439 1.46 1770 0.4979 0.8258
0.4751 1.46 1780 0.4896 0.8340
0.534 1.47 1790 0.4656 0.8348
0.4526 1.48 1800 0.5322 0.8316
0.4618 1.49 1810 0.5216 0.8233
0.3825 1.5 1820 0.4792 0.8225
0.4557 1.5 1830 0.5071 0.8118
0.5725 1.51 1840 0.5152 0.8102
0.7004 1.52 1850 0.5080 0.8217
0.4367 1.53 1860 0.4920 0.8357
0.3682 1.54 1870 0.5253 0.8299
0.4411 1.55 1880 0.6186 0.8069
0.5391 1.55 1890 0.5074 0.8283
0.4673 1.56 1900 0.4858 0.8398
0.3542 1.57 1910 0.4767 0.8381
0.6483 1.58 1920 0.4694 0.8373
0.3837 1.59 1930 0.4678 0.8472
0.363 1.6 1940 0.4684 0.8463
0.6446 1.6 1950 0.4696 0.8365
0.5627 1.61 1960 0.4651 0.8472
0.3733 1.62 1970 0.5138 0.8291
0.5972 1.63 1980 0.5244 0.8250
0.2388 1.64 1990 0.5020 0.8266
0.6279 1.64 2000 0.5865 0.8118
0.5827 1.65 2010 0.5717 0.8176
0.4598 1.66 2020 0.4691 0.8439
0.3817 1.67 2030 0.5084 0.8340
0.2973 1.68 2040 0.4568 0.8447
0.4039 1.69 2050 0.4681 0.8505
0.4572 1.69 2060 0.4718 0.8389
0.3481 1.7 2070 0.4849 0.8283
0.4553 1.71 2080 0.4574 0.8414
0.4055 1.72 2090 0.4640 0.8463
0.4384 1.73 2100 0.5049 0.8431
0.5593 1.74 2110 0.5192 0.8513
0.3486 1.74 2120 0.4764 0.8480
0.4698 1.75 2130 0.4858 0.8447
0.211 1.76 2140 0.4976 0.8398
0.5209 1.77 2150 0.4934 0.8472
0.4281 1.78 2160 0.4714 0.8578
0.3902 1.78 2170 0.4863 0.8463
0.3083 1.79 2180 0.4807 0.8431
0.4642 1.8 2190 0.4712 0.8472
0.2382 1.81 2200 0.4641 0.8513
0.4154 1.82 2210 0.4900 0.8447
0.3637 1.83 2220 0.4790 0.8488
0.4864 1.83 2230 0.4742 0.8513
0.5024 1.84 2240 0.4803 0.8529
0.4139 1.85 2250 0.4672 0.8521
0.4131 1.86 2260 0.4895 0.8431
0.4851 1.87 2270 0.4432 0.8529
0.3846 1.88 2280 0.4417 0.8422
0.3778 1.88 2290 0.4477 0.8439
0.4128 1.89 2300 0.4336 0.8513
0.3755 1.9 2310 0.4678 0.8439
0.4672 1.91 2320 0.4740 0.8373
0.5216 1.92 2330 0.4343 0.8472
0.3469 1.92 2340 0.4542 0.8316
0.3283 1.93 2350 0.4587 0.8447
0.3495 1.94 2360 0.5050 0.8348
0.4518 1.95 2370 0.5309 0.8266
0.3023 1.96 2380 0.5113 0.8332
0.4014 1.97 2390 0.4989 0.8332
0.4963 1.97 2400 0.4539 0.8505
0.3421 1.98 2410 0.4889 0.8455
0.4126 1.99 2420 0.4696 0.8463
0.479 2.0 2430 0.4498 0.8513
0.3319 2.01 2440 0.4686 0.8488
0.2787 2.01 2450 0.4650 0.8447
0.2105 2.02 2460 0.4665 0.8505
0.4944 2.03 2470 0.4667 0.8488
0.2236 2.04 2480 0.4678 0.8463
0.3076 2.05 2490 0.4621 0.8513
0.2813 2.06 2500 0.4451 0.8562
0.2207 2.06 2510 0.4559 0.8562
0.3693 2.07 2520 0.4634 0.8513
0.3682 2.08 2530 0.4390 0.8562
0.2618 2.09 2540 0.4417 0.8529
0.3139 2.1 2550 0.4618 0.8529
0.1739 2.11 2560 0.4938 0.8488
0.4258 2.11 2570 0.4574 0.8496
0.2136 2.12 2580 0.4495 0.8529
0.2625 2.13 2590 0.4555 0.8570
0.3161 2.14 2600 0.4696 0.8537
0.2515 2.15 2610 0.4649 0.8661
0.3097 2.15 2620 0.4474 0.8685
0.3544 2.16 2630 0.4458 0.8603
0.2967 2.17 2640 0.4555 0.8669
0.4015 2.18 2650 0.4486 0.8652
0.079 2.19 2660 0.4624 0.8620
0.1754 2.2 2670 0.4805 0.8587
0.1854 2.2 2680 0.4803 0.8628
0.3181 2.21 2690 0.4792 0.8595
0.0808 2.22 2700 0.4740 0.8628
0.2027 2.23 2710 0.4846 0.8587
0.3211 2.24 2720 0.5074 0.8505
0.2448 2.25 2730 0.5276 0.8414
0.3618 2.25 2740 0.5133 0.8488
0.1822 2.26 2750 0.5002 0.8578
0.3095 2.27 2760 0.4827 0.8603
0.0762 2.28 2770 0.4792 0.8644
0.187 2.29 2780 0.4897 0.8644
0.5779 2.29 2790 0.4901 0.8652
0.292 2.3 2800 0.4764 0.8603
0.1865 2.31 2810 0.4798 0.8644
0.3594 2.32 2820 0.4837 0.8620
0.421 2.33 2830 0.4812 0.8562
0.1173 2.34 2840 0.4708 0.8603
0.278 2.34 2850 0.4693 0.8685
0.2294 2.35 2860 0.4724 0.8628
0.243 2.36 2870 0.4749 0.8620
0.3979 2.37 2880 0.4633 0.8628
0.4518 2.38 2890 0.4603 0.8669
0.2739 2.38 2900 0.4625 0.8685
0.1782 2.39 2910 0.4652 0.8677
0.3536 2.4 2920 0.4613 0.8644
0.0904 2.41 2930 0.4642 0.8611
0.2315 2.42 2940 0.4613 0.8661
0.1236 2.43 2950 0.4628 0.8652
0.1842 2.43 2960 0.4706 0.8620
0.2414 2.44 2970 0.4683 0.8652
0.3419 2.45 2980 0.4645 0.8677
0.2877 2.46 2990 0.4657 0.8636
0.2524 2.47 3000 0.4701 0.8652
0.1731 2.48 3010 0.4733 0.8644
0.1731 2.48 3020 0.4830 0.8595
0.0921 2.49 3030 0.4904 0.8603
0.1593 2.5 3040 0.4836 0.8595
0.467 2.51 3050 0.4706 0.8628
0.4225 2.52 3060 0.4598 0.8644
0.1251 2.52 3070 0.4511 0.8694
0.2181 2.53 3080 0.4487 0.8735
0.2247 2.54 3090 0.4452 0.8767
0.3722 2.55 3100 0.4469 0.8759
0.1069 2.56 3110 0.4536 0.8735
0.2174 2.57 3120 0.4571 0.8710
0.2586 2.57 3130 0.4626 0.8685
0.2803 2.58 3140 0.4665 0.8677
0.4484 2.59 3150 0.4581 0.8694
0.3104 2.6 3160 0.4539 0.8735
0.2411 2.61 3170 0.4531 0.8726
0.2157 2.62 3180 0.4565 0.8694
0.2342 2.62 3190 0.4549 0.8694
0.2921 2.63 3200 0.4570 0.8677
0.1988 2.64 3210 0.4590 0.8677
0.2142 2.65 3220 0.4601 0.8661
0.1666 2.66 3230 0.4652 0.8661
0.2296 2.66 3240 0.4709 0.8611
0.3847 2.67 3250 0.4676 0.8636
0.4149 2.68 3260 0.4654 0.8636
0.2602 2.69 3270 0.4614 0.8661
0.3786 2.7 3280 0.4605 0.8661
0.3509 2.71 3290 0.4590 0.8661
0.2254 2.71 3300 0.4564 0.8677
0.1775 2.72 3310 0.4553 0.8694
0.2269 2.73 3320 0.4546 0.8669
0.1792 2.74 3330 0.4549 0.8644
0.1107 2.75 3340 0.4580 0.8661
0.2062 2.75 3350 0.4598 0.8636
0.1641 2.76 3360 0.4621 0.8652
0.18 2.77 3370 0.4651 0.8652
0.0959 2.78 3380 0.4673 0.8661
0.217 2.79 3390 0.4672 0.8652
0.3293 2.8 3400 0.4673 0.8644
0.2691 2.8 3410 0.4669 0.8644
0.1945 2.81 3420 0.4659 0.8652
0.2712 2.82 3430 0.4660 0.8677
0.2287 2.83 3440 0.4663 0.8677
0.2103 2.84 3450 0.4661 0.8669
0.2713 2.85 3460 0.4663 0.8669
0.3182 2.85 3470 0.4665 0.8677
0.1698 2.86 3480 0.4668 0.8669
0.2663 2.87 3490 0.4669 0.8677
0.2091 2.88 3500 0.4670 0.8685
0.1406 2.89 3510 0.4677 0.8669
0.16 2.89 3520 0.4682 0.8661
0.1413 2.9 3530 0.4686 0.8661
0.3499 2.91 3540 0.4690 0.8661
0.205 2.92 3550 0.4688 0.8661
0.3849 2.93 3560 0.4684 0.8661
0.209 2.94 3570 0.4680 0.8669
0.1985 2.94 3580 0.4678 0.8677
0.1989 2.95 3590 0.4678 0.8677
0.2031 2.96 3600 0.4677 0.8677
0.2401 2.97 3610 0.4677 0.8677
0.2717 2.98 3620 0.4678 0.8677
0.2821 2.99 3630 0.4678 0.8677
0.1735 2.99 3640 0.4677 0.8677

Framework versions

  • Transformers 4.40.0.dev0
  • Pytorch 2.2.1+cu121
  • Datasets 2.18.1.dev0
  • Tokenizers 0.15.2