rombodawg commited on
Commit
3272926
·
verified ·
1 Parent(s): a225369

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -42
README.md CHANGED
@@ -1,42 +1,15 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # Rombo-LLM-2.7-gemma-2-9b
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_gemma-2-9b as a base.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_gemma-2-9b-it
22
-
23
- ### Configuration
24
-
25
- The following YAML configuration was used to produce this model:
26
-
27
- ```yaml
28
- models:
29
- - model: E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_gemma-2-9b-it
30
- parameters:
31
- weight: 1
32
- density: 1
33
- merge_method: ties
34
- base_model: E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_gemma-2-9b
35
- parameters:
36
- weight: 1
37
- density: 1
38
- normalize: true
39
- int8_mask: false
40
- dtype: bfloat16
41
-
42
- ```
 
1
+ ---
2
+ library_name: transformers
3
+ base_model:
4
+ - google/gemma-2-9b-it
5
+ license: gemma
6
+ ---
7
+ # Rombo-LLM-2.7-gemma-2-9b
8
+
9
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642cc1c253e76b4c2286c58e/oL_yvvRsWj2C4niGgkT2A.jpeg)
10
+
11
+ Rombo-LLM-2.7-gemma-2-9b is an combined pretrained and instruct tuned model based on (gemma-2-9b) and (gemma-2-9b-it) giving the benefits of both versions all in 1 model.
12
+
13
+ This model can be used to furter finetune, or right out of the box for inference.
14
+
15
+ Quants: (coming soon)