Hugging Face's logo

ArmanAsq
/
AYA-CLM-DSM-NoOerlap

Text Generation
Transformers
Safetensors
cohere
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
ArmanAsq commited on
Commit
6914eed
•
1 Parent(s): 048a6c0

Training in progress, epoch 1

Browse files
Files changed (6) hide show
  1. README.md +13 -6
  2. model-00001-of-00004.safetensors +1 -1
  3. model-00002-of-00004.safetensors +1 -1
  4. model-00003-of-00004.safetensors +1 -1
  5. model-00004-of-00004.safetensors +1 -1
  6. training_args.bin +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [CohereForAI/aya-23-8B](https://huggingface.co/CohereForAI/aya-23-8B) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 2.1005
19
 
20
  ## Model description
21
 
@@ -35,20 +35,27 @@ More information needed
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 2e-05
38
- - train_batch_size: 22
39
  - eval_batch_size: 16
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 3
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | No log | 1.0 | 5 | 2.1842 |
50
- | No log | 2.0 | 10 | 2.1059 |
51
- | No log | 3.0 | 15 | 2.1013 |
 
 
 
 
 
 
 
52
 
53
 
54
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [CohereForAI/aya-23-8B](https://huggingface.co/CohereForAI/aya-23-8B) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.0400
19
 
20
  ## Model description
21
 
 
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 2e-05
38
+ - train_batch_size: 16
39
  - eval_batch_size: 16
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 10
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | No log | 1.0 | 6 | 2.1193 |
50
+ | No log | 2.0 | 12 | 2.0827 |
51
+ | No log | 3.0 | 18 | 2.0405 |
52
+ | No log | 4.0 | 24 | 2.1257 |
53
+ | No log | 5.0 | 30 | 2.1739 |
54
+ | No log | 6.0 | 36 | 2.2213 |
55
+ | No log | 7.0 | 42 | 2.3027 |
56
+ | No log | 8.0 | 48 | 2.3649 |
57
+ | No log | 9.0 | 54 | 2.3658 |
58
+ | No log | 10.0 | 60 | 2.3670 |
59
 
60
 
61
  ### Framework versions
model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ae34aecd0b745d38d071006d1227d7588a0a3ee2992fee0f5e0fa03e122cf267
3
  size 4907825264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3b9d84d155734111e8c35c4cd9c8c5d691aed4d5e07462a59365c53972aa964
3
  size 4907825264
model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:72564e30a77691204d5a4bc96856935572903e33d38bd7c07a2d3eee8df3ef46
3
  size 4915824704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:533a16bc1ffcdb7746760997fa6988e719038f340cf91ec3560b089834913d37
3
  size 4915824704
model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5d4c0432b079c3a21ce8c3866670e7d02aa4a79505c37c1446fc51bc09ab7b32
3
  size 4999719592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a8a5a7a5a52b8dffa45ac5951547bca0ef8625633d872cc842e16fb8f9fb95c
3
  size 4999719592
model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cc1bb6fcb125b720c7d95f844a2362fe38b8e382e41871b90c47b431d32db9b8
3
  size 1224771944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af21749134b3e7414eea78eff72449da0d8838e5d05d440941b286644ebb6e18
3
  size 1224771944
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:774a7d7f140978b3382ab7f23b74efeaad0379c27fd333fee7dd40668d6bddcf
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34b08e5399fdf6a8c03ff6a52b74345ca32ecd141acb3cc58ab30ea25afddc11
3
  size 5112