kody0525 commited on
Commit
823418b
1 Parent(s): 7566ecb

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ tags:
6
+ - SOLAR-10.7B-v1.0
7
+ - Open-platypus-Commercial
8
+ pipeline_tag: text-generation
9
+ datasets:
10
+ - kyujinpy/Open-platypus-Commercial
11
+ base_model: upstage/SOLAR-10.7B-v1.0
12
+ model-index:
13
+ - name: Open-platypus-Commercial-SOLAR-10.7B-v1.0
14
+ results: []
15
+ ---
16
+
17
+ Update @ 2024.03.05
18
+
19
+ # Open-platypus-Commercial-SOLAR-10.7B-v1.0
20
+
21
+ This model is a fine-tuned version of upstage/SOLAR-10.7B-v1.0
22
+
23
+
24
+ ## Training hyperparameters
25
+
26
+ The following hyperparameters were used during training:
27
+ - batch_size = 16
28
+ - num_epochs = 1
29
+ - micro_batch = 1
30
+ - cutoff_len = 4096
31
+ - learning_rate = 4e-4
32
+
33
+
34
+ ### Framework versions
35
+
36
+ - Transformers 4.34.1
37
+ - Pytorch 2.1.0+cu121
38
+ - Datasets 2.14.7
39
+ - Tokenizers 0.14.1