Hugging Face's logo

ArmanAsq
/
AYA-CLM-DSM-NoOerlap

Text Generation
Transformers
Safetensors
cohere
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
ArmanAsq commited on
Commit
84eed08
•
1 Parent(s): 6914eed

Training in progress, epoch 1

Browse files
Files changed (6) hide show
  1. README.md +13 -12
  2. model-00001-of-00004.safetensors +1 -1
  3. model-00002-of-00004.safetensors +1 -1
  4. model-00003-of-00004.safetensors +1 -1
  5. model-00004-of-00004.safetensors +1 -1
  6. training_args.bin +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [CohereForAI/aya-23-8B](https://huggingface.co/CohereForAI/aya-23-8B) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 2.0400
19
 
20
  ## Model description
21
 
@@ -34,28 +34,29 @@ More information needed
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
- - learning_rate: 2e-05
38
  - train_batch_size: 16
39
  - eval_batch_size: 16
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
 
43
  - num_epochs: 10
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | No log | 1.0 | 6 | 2.1193 |
50
- | No log | 2.0 | 12 | 2.0827 |
51
- | No log | 3.0 | 18 | 2.0405 |
52
- | No log | 4.0 | 24 | 2.1257 |
53
- | No log | 5.0 | 30 | 2.1739 |
54
- | No log | 6.0 | 36 | 2.2213 |
55
- | No log | 7.0 | 42 | 2.3027 |
56
- | No log | 8.0 | 48 | 2.3649 |
57
- | No log | 9.0 | 54 | 2.3658 |
58
- | No log | 10.0 | 60 | 2.3670 |
59
 
60
 
61
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [CohereForAI/aya-23-8B](https://huggingface.co/CohereForAI/aya-23-8B) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.8404
19
 
20
  ## Model description
21
 
 
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
+ - learning_rate: 1e-06
38
  - train_batch_size: 16
39
  - eval_batch_size: 16
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - lr_scheduler_warmup_steps: 10
44
  - num_epochs: 10
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | No log | 1.0 | 6 | 2.8962 |
51
+ | No log | 2.0 | 12 | 2.8825 |
52
+ | No log | 3.0 | 18 | 2.8692 |
53
+ | No log | 4.0 | 24 | 2.8596 |
54
+ | No log | 5.0 | 30 | 2.8520 |
55
+ | No log | 6.0 | 36 | 2.8449 |
56
+ | No log | 7.0 | 42 | 2.8432 |
57
+ | No log | 8.0 | 48 | 2.8417 |
58
+ | No log | 9.0 | 54 | 2.8399 |
59
+ | No log | 10.0 | 60 | 2.8411 |
60
 
61
 
62
  ### Framework versions
model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c3b9d84d155734111e8c35c4cd9c8c5d691aed4d5e07462a59365c53972aa964
3
  size 4907825264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c72cfe6f436ee1fd1e3947a302a8fe8daee12d580924462de4f7d92a3a7a9dcc
3
  size 4907825264
model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:533a16bc1ffcdb7746760997fa6988e719038f340cf91ec3560b089834913d37
3
  size 4915824704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3032e00f54ae7456853f9b64848a680b83f276f88893962c0c753a217aac057b
3
  size 4915824704
model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2a8a5a7a5a52b8dffa45ac5951547bca0ef8625633d872cc842e16fb8f9fb95c
3
  size 4999719592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:503985bec890eab3c3fe6d454ff7cae991b222686e40f20303d5d04b91c803aa
3
  size 4999719592
model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:af21749134b3e7414eea78eff72449da0d8838e5d05d440941b286644ebb6e18
3
  size 1224771944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b8788fd4c5204442b28cd2ec0f3e2a499147de3c009bcf2da22d114498c77a9
3
  size 1224771944
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:34b08e5399fdf6a8c03ff6a52b74345ca32ecd141acb3cc58ab30ea25afddc11
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2945fc1d0b14f94671236e903b6a10ffcdf6b6478b024b8d91ce9e2bb50710dc
3
  size 5112