intervitens lucyknada commited on
Commit
526778e
0 Parent(s):

Duplicate from SillyTilly/Mistral-Large-Instruct-2407

Browse files

Co-authored-by: lucy <lucyknada@users.noreply.huggingface.co>

This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +35 -0
  2. README.md +232 -0
  3. config.json +25 -0
  4. consolidated-00001-of-00051.safetensors +3 -0
  5. consolidated-00002-of-00051.safetensors +3 -0
  6. consolidated-00003-of-00051.safetensors +3 -0
  7. consolidated-00004-of-00051.safetensors +3 -0
  8. consolidated-00005-of-00051.safetensors +3 -0
  9. consolidated-00006-of-00051.safetensors +3 -0
  10. consolidated-00007-of-00051.safetensors +3 -0
  11. consolidated-00008-of-00051.safetensors +3 -0
  12. consolidated-00009-of-00051.safetensors +3 -0
  13. consolidated-00010-of-00051.safetensors +3 -0
  14. consolidated-00011-of-00051.safetensors +3 -0
  15. consolidated-00012-of-00051.safetensors +3 -0
  16. consolidated-00013-of-00051.safetensors +3 -0
  17. consolidated-00014-of-00051.safetensors +3 -0
  18. consolidated-00015-of-00051.safetensors +3 -0
  19. consolidated-00016-of-00051.safetensors +3 -0
  20. consolidated-00017-of-00051.safetensors +3 -0
  21. consolidated-00018-of-00051.safetensors +3 -0
  22. consolidated-00019-of-00051.safetensors +3 -0
  23. consolidated-00020-of-00051.safetensors +3 -0
  24. consolidated-00021-of-00051.safetensors +3 -0
  25. consolidated-00022-of-00051.safetensors +3 -0
  26. consolidated-00023-of-00051.safetensors +3 -0
  27. consolidated-00024-of-00051.safetensors +3 -0
  28. consolidated-00025-of-00051.safetensors +3 -0
  29. consolidated-00026-of-00051.safetensors +3 -0
  30. consolidated-00027-of-00051.safetensors +3 -0
  31. consolidated-00028-of-00051.safetensors +3 -0
  32. consolidated-00029-of-00051.safetensors +3 -0
  33. consolidated-00030-of-00051.safetensors +3 -0
  34. consolidated-00031-of-00051.safetensors +3 -0
  35. consolidated-00032-of-00051.safetensors +3 -0
  36. consolidated-00033-of-00051.safetensors +3 -0
  37. consolidated-00034-of-00051.safetensors +3 -0
  38. consolidated-00035-of-00051.safetensors +3 -0
  39. consolidated-00036-of-00051.safetensors +3 -0
  40. consolidated-00037-of-00051.safetensors +3 -0
  41. consolidated-00038-of-00051.safetensors +3 -0
  42. consolidated-00039-of-00051.safetensors +3 -0
  43. consolidated-00040-of-00051.safetensors +3 -0
  44. consolidated-00041-of-00051.safetensors +3 -0
  45. consolidated-00042-of-00051.safetensors +3 -0
  46. consolidated-00043-of-00051.safetensors +3 -0
  47. consolidated-00044-of-00051.safetensors +3 -0
  48. consolidated-00045-of-00051.safetensors +3 -0
  49. consolidated-00046-of-00051.safetensors +3 -0
  50. consolidated-00047-of-00051.safetensors +3 -0
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,232 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: mrl
4
+ license_link: https://mistral.ai/licenses/MRL-0.1.md
5
+ language:
6
+ - en
7
+ - fr
8
+ - de
9
+ - es
10
+ - it
11
+ - pt
12
+ - zh
13
+ - ja
14
+ - ru
15
+ - ko
16
+
17
+ extra_gated_description: If you want to learn more about how we process your personal data, please read our <a href="https://mistral.ai/terms/">Privacy Policy</a>.
18
+ ---
19
+
20
+ # Model Card for Mistral-Large-Instruct-2407
21
+
22
+ Mistral-Large-Instruct-2407 is an advanced dense Large Language Model (LLM) of 123B parameters with state-of-the-art reasoning, knowledge and coding capabilities.
23
+
24
+ For more details about this model please refer to our release [blog post](https://mistral.ai/news/mistral-large-2407/).
25
+
26
+ ## Key features
27
+ - **Multi-lingual by design:** Dozens of languages supported, including English, French, German, Spanish, Italian, Chinese, Japanese, Korean, Portuguese, Dutch and Polish.
28
+ - **Proficient in coding:** Trained on 80+ coding languages such as Python, Java, C, C++, Javacsript, and Bash. Also trained on more specific languages such as Swift and Fortran.
29
+ - **Agentic-centric:** Best-in-class agentic capabilities with native function calling and JSON outputting.
30
+ - **Advanced Reasoning:** State-of-the-art mathematical and reasoning capabilities.
31
+ - **Mistral Research License:** Allows usage and modification for research and non-commercial usages.
32
+ - **Large Context:** A large 128k context window.
33
+
34
+ ## Metrics
35
+
36
+ ### Base Pretrained Benchmarks
37
+
38
+ | Benchmark | Score |
39
+ | --- | --- |
40
+ | MMLU | 84.0% |
41
+
42
+
43
+ ### Base Pretrained Multilingual Benchmarks (MMLU)
44
+ | Benchmark | Score |
45
+ | --- | --- |
46
+ | French | 82.8% |
47
+ | German | 81.6% |
48
+ | Spanish | 82.7% |
49
+ | Italian | 82.7% |
50
+ | Dutch | 80.7% |
51
+ | Portuguese | 81.6% |
52
+ | Russian | 79.0% |
53
+ | Korean | 60.1% |
54
+ | Japanese | 78.8% |
55
+ | Chinese | 74.8% |
56
+
57
+
58
+ ### Instruction Benchmarks
59
+
60
+ | Benchmark | Score |
61
+ | --- | --- |
62
+ | MT Bench | 8.63 |
63
+ | Wild Bench | 56.3 |
64
+ | Arena Hard| 73.2 |
65
+
66
+ ### Code & Reasoning Benchmarks
67
+ | Benchmark | Score |
68
+ | --- | --- |
69
+ | Human Eval | 92% |
70
+ | Human Eval Plus| 87% |
71
+ | MBPP Base| 80% |
72
+ | MBPP Plus| 69% |
73
+
74
+ ### Math Benchmarks
75
+
76
+ | Benchmark | Score |
77
+ | --- | --- |
78
+ | GSM8K | 93% |
79
+ | Math Instruct (0-shot, no CoT) | 70% |
80
+ | Math Instruct (0-shot, CoT)| 71.5% |
81
+
82
+ ## Usage
83
+
84
+ The model can be used with two different frameworks
85
+
86
+ - [`mistral_inference`](https://github.com/mistralai/mistral-inference): See [here](https://huggingface.co/mistralai/Mistral-Large-2407#mistral-inference)
87
+ - [`transformers`](https://github.com/huggingface/transformers): See [here](#transformers)
88
+
89
+ ### Mistral Inference
90
+
91
+ #### Install
92
+
93
+ It is recommended to use `mistralai/Mistral-Large-2407` with [mistral-inference](https://github.com/mistralai/mistral-inference). For HF transformers code snippets, please keep scrolling.
94
+
95
+ ```
96
+ pip install mistral_inference
97
+ ```
98
+
99
+ #### Download
100
+
101
+ ```py
102
+ from huggingface_hub import snapshot_download
103
+ from pathlib import Path
104
+
105
+ mistral_models_path = Path.home().joinpath('mistral_models', 'Large')
106
+ mistral_models_path.mkdir(parents=True, exist_ok=True)
107
+
108
+ snapshot_download(repo_id="mistralai/Mistral-Large-2407", allow_patterns=["params.json", "consolidated-*.safetensors", "tokenizer.model.v3"], local_dir=mistral_models_path)
109
+ ```
110
+
111
+ #### Chat
112
+
113
+ After installing `mistral_inference`, a `mistral-chat` CLI command should be available in your environment.
114
+ Given the size of this model, you will need a node with several GPUs (more than 300GB cumulated vRAM).
115
+ If you have 8 GPUs on your machine, you can chat with the model using
116
+
117
+ ```
118
+ torchrun --nproc-per-node 8 --no-python mistral-chat $HOME/mistral_models/Large --instruct --max_tokens 256 --temperature 0.7
119
+ ```
120
+
121
+ *E.g.* Try out something like:
122
+ ```
123
+ How expensive would it be to ask a window cleaner to clean all windows in Paris. Make a reasonable guess in US Dollar.
124
+ ```
125
+
126
+ #### Instruct following
127
+
128
+ ```py
129
+ from mistral_inference.transformer import Transformer
130
+ from mistral_inference.generate import generate
131
+
132
+ from mistral_common.tokens.tokenizers.mistral import MistralTokenizer
133
+ from mistral_common.protocol.instruct.messages import UserMessage
134
+ from mistral_common.protocol.instruct.request import ChatCompletionRequest
135
+
136
+ tokenizer = MistralTokenizer.from_file(f"{mistral_models_path}/tokenizer.model.v3")
137
+ model = Transformer.from_folder(mistral_models_path)
138
+
139
+ prompt = "How expensive would it be to ask a window cleaner to clean all windows in Paris. Make a reasonable guess in US Dollar."
140
+
141
+ completion_request = ChatCompletionRequest(messages=[UserMessage(content=prompt)])
142
+
143
+ tokens = tokenizer.encode_chat_completion(completion_request).tokens
144
+
145
+ out_tokens, _ = generate([tokens], model, max_tokens=64, temperature=0.7, eos_id=tokenizer.instruct_tokenizer.tokenizer.eos_id)
146
+ result = tokenizer.decode(out_tokens[0])
147
+
148
+ print(result)
149
+ ```
150
+
151
+ #### Function calling
152
+
153
+ ```py
154
+ from mistral_common.protocol.instruct.tool_calls import Function, Tool
155
+ from mistral_inference.transformer import Transformer
156
+ from mistral_inference.generate import generate
157
+
158
+ from mistral_common.tokens.tokenizers.mistral import MistralTokenizer
159
+ from mistral_common.protocol.instruct.messages import UserMessage
160
+ from mistral_common.protocol.instruct.request import ChatCompletionRequest
161
+
162
+
163
+ tokenizer = MistralTokenizer.from_file(f"{mistral_models_path}/tokenizer.model.v3")
164
+ model = Transformer.from_folder(mistral_models_path)
165
+
166
+ completion_request = ChatCompletionRequest(
167
+ tools=[
168
+ Tool(
169
+ function=Function(
170
+ name="get_current_weather",
171
+ description="Get the current weather",
172
+ parameters={
173
+ "type": "object",
174
+ "properties": {
175
+ "location": {
176
+ "type": "string",
177
+ "description": "The city and state, e.g. San Francisco, CA",
178
+ },
179
+ "format": {
180
+ "type": "string",
181
+ "enum": ["celsius", "fahrenheit"],
182
+ "description": "The temperature unit to use. Infer this from the users location.",
183
+ },
184
+ },
185
+ "required": ["location", "format"],
186
+ },
187
+ )
188
+ )
189
+ ],
190
+ messages=[
191
+ UserMessage(content="What's the weather like today in Paris?"),
192
+ ],
193
+ )
194
+
195
+ tokens = tokenizer.encode_chat_completion(completion_request).tokens
196
+
197
+ out_tokens, _ = generate([tokens], model, max_tokens=256, temperature=0.7, eos_id=tokenizer.instruct_tokenizer.tokenizer.eos_id)
198
+ result = tokenizer.decode(out_tokens[0])
199
+
200
+ print(result)
201
+ ```
202
+
203
+ ### Transformers
204
+
205
+ > [!IMPORTANT]
206
+ > NOTE: Until a new release has been made, you need to install transformers from source:
207
+ > ```sh
208
+ > pip install git+https://github.com/huggingface/transformers.git
209
+ > ```
210
+
211
+ If you want to use Hugging Face `transformers` to generate text, you can do something like this.
212
+
213
+ ```py
214
+ from transformers import pipeline
215
+
216
+ messages = [
217
+ {"role": "system", "content": "You are a pirate chatbot who always responds in pirate speak!"},
218
+ {"role": "user", "content": "Who are you?"},
219
+ ]
220
+ chatbot = pipeline("text-generation", model="mistralai/Mistral-Large-2407")
221
+ chatbot(messages)
222
+ ```
223
+
224
+ ## Limitations
225
+
226
+ The Mistral Large model is a quick demonstration that the base model can be easily fine-tuned to achieve compelling performance.
227
+ It does not have any moderation mechanisms. We're looking forward to engaging with the community on ways to
228
+ make the model finely respect guardrails, allowing for deployment in environments requiring moderated outputs.
229
+
230
+ ## The Mistral AI Team
231
+
232
+ Albert Jiang, Alexandre Sablayrolles, Alexis Tacnet, Alok Kothari, Antoine Roux, Arthur Mensch, Audrey Herblin-Stoop, Augustin Garreau, Austin Birky, Bam4d, Baptiste Bout, Baudouin de Monicault, Blanche Savary, Carole Rambaud, Caroline Feldman, Devendra Singh Chaplot, Diego de las Casas, Diogo Costa, Eleonore Arcelin, Emma Bou Hanna, Etienne Metzger, Gaspard Blanchet, Gianna Lengyel, Guillaume Bour, Guillaume Lample, Harizo Rajaona, Henri Roussez, Hichem Sattouf, Ian Mack, Jean-Malo Delignon, Jessica Chudnovsky, Justus Murke, Kartik Khandelwal, Lawrence Stewart, Louis Martin, Louis Ternon, Lucile Saulnier, Lélio Renard Lavaud, Margaret Jennings, Marie Pellat, Marie Torelli, Marie-Anne Lachaux, Marjorie Janiewicz, Mickaël Seznec, Nicolas Schuhl, Niklas Muhs, Olivier de Garrigues, Patrick von Platen, Paul Jacob, Pauline Buche, Pavan Kumar Reddy, Perry Savas, Pierre Stock, Romain Sauvestre, Sagar Vaze, Sandeep Subramanian, Saurabh Garg, Sophia Yang, Szymon Antoniak, Teven Le Scao, Thibault Schueller, Thibaut Lavril, Thomas Wang, Théophile Gervet, Timothée Lacroix, Valera Nemychnikova, Wendy Shang, William El Sayed, William Marshall
config.json ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "MistralForCausalLM"
4
+ ],
5
+ "attention_dropout": 0.0,
6
+ "bos_token_id": 1,
7
+ "eos_token_id": 2,
8
+ "hidden_act": "silu",
9
+ "hidden_size": 12288,
10
+ "initializer_range": 0.02,
11
+ "intermediate_size": 28672,
12
+ "max_position_embeddings": 32768,
13
+ "model_type": "mistral",
14
+ "num_attention_heads": 96,
15
+ "num_hidden_layers": 88,
16
+ "num_key_value_heads": 8,
17
+ "rms_norm_eps": 1e-05,
18
+ "rope_theta": 1000000.0,
19
+ "sliding_window": null,
20
+ "tie_word_embeddings": false,
21
+ "torch_dtype": "bfloat16",
22
+ "transformers_version": "4.42.3",
23
+ "use_cache": true,
24
+ "vocab_size": 32768
25
+ }
consolidated-00001-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37e758cd52629e4e02f27acaa16eeae4358d852b44f82c1d723969ee27a77eab
3
+ size 4831913664
consolidated-00002-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7544f0079990508f3a3ec2f22bba6698d80ebff60ba7e938612bcf8bacafbf9
3
+ size 4831938360
consolidated-00003-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:744ee558615911b5a52ed8a441595ae3404f085798827379a2b652d77f055fc2
3
+ size 4831938368
consolidated-00004-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03d2ea4660f480a3af206ae79f958cfbc3131ce7d4578cc7e483f19bfa1a031c
3
+ size 4907410944
consolidated-00005-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb281e54d36b4fd623ebf1aefc51c76fc25d7d3482b5be708d5b45ba5a463d27
3
+ size 4806747752
consolidated-00006-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e66bfff9d096dd454b1b345c7be17d8bd60f7a36e2d6416586d06930a5d897d
3
+ size 4831938360
consolidated-00007-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f091794b4b7a1723b1f4924fb703d8de4d4fbf0dd6b4e466383524319a3ff1c
3
+ size 4831938360
consolidated-00008-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b48e33490f71214e864a527d5cd1eb818df3712ac16fcea64dba37238e2f2a6
3
+ size 4907410936
consolidated-00009-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90ea14943afa2c3d8132acb56b1d1b7e6d763b38ee0b69356b382ca342de66aa
3
+ size 4806747752
consolidated-00010-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98ab16115b94c0429145954428b621c26619a3531f7586f2cd40e6ede99d938c
3
+ size 4831938360
consolidated-00011-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d22e409948f134d9515f86b3dd1807ef5d68a2d39af3aa22933fd73d930872b
3
+ size 4831938368
consolidated-00012-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6a8bd5c5e197ba9c421ff25365425ff742dc52cc43a8dc7498ac3fd00879ea0
3
+ size 4907410944
consolidated-00013-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6bb460951704285b41cc1b2a1fca2fecaaf7dc3b51b8c27b8875f50908f3133
3
+ size 4806747752
consolidated-00014-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f966e6a7ede11fec98731af72c8dea075d4d6147b5ba29528b7083d7f25a775b
3
+ size 4831938352
consolidated-00015-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efb86eaa140207d6191aef0a9b5137a0af2f5edd683aa5199e29df5ff17ef29d
3
+ size 4831938368
consolidated-00016-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:475fd3eef133ed37d0992ba1bed1b5ac36fefa13902cfde2167c00d1d7f635d5
3
+ size 4907410944
consolidated-00017-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c67babff999a196bb7379b1a709de0a46284abcbbb784643faaeef7ca9a0c0e3
3
+ size 4806747752
consolidated-00018-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47c93d5765060497fcade10704ae0f5fff201f817ac45c8a1304520eaaf70bc3
3
+ size 4831938360
consolidated-00019-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7947470663745c5ae4c5802549da3f7f9c686a06d60e7c471fcac049763b9f6
3
+ size 4831938368
consolidated-00020-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1fcbfa6978a348972745613e9270fb66c6ecbb16166f83fdf4b70633f427c6a
3
+ size 4907410928
consolidated-00021-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b710ec84ed66ba118b7fc0c2d04822fb6e0590a7989f81fd20e9289dad768515
3
+ size 4806747752
consolidated-00022-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7372dd309945f70a0c44893aa561c12e6563d8620d62df794e4c56e006e249fc
3
+ size 4831938360
consolidated-00023-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da5c611f7db58b05f50c61de98d55d4394f745630a807f6c1a31a95a84dc553e
3
+ size 4831938368
consolidated-00024-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b4e119f60f93b3fa08169b7dbc0079d1997919619bc4e610d146c736363d90e
3
+ size 4907410944
consolidated-00025-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:381a9c235a0521df104c46e1b188e0128a489761b48007428f325f588bb5c2c5
3
+ size 4806747752
consolidated-00026-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05d4ee2657890477d0701d463941a3cd512972d2fcb2b9ab1d0c5433660583a4
3
+ size 4831938360
consolidated-00027-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fb25caf3553ecfd2b71356242844617f3e689b12180c41771eac6314ddd9a44
3
+ size 4831938360
consolidated-00028-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa0286aaf40f559abe08bf330109dad9560839bcdd57c632d7ffb84318a58099
3
+ size 4907410944
consolidated-00029-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f5466ea1291e1d44bda9a01b7f86136409c90aabc13937d57f0fd4b8e7a6b2b
3
+ size 4806747752
consolidated-00030-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52807d10d8e16128e477ffae1fd80978dd59c8fa13c49e11f5f552917efb5c1a
3
+ size 4831938360
consolidated-00031-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9944e1168424134b94571af196a00206b9dd497b3761337752318960f588558
3
+ size 4831938368
consolidated-00032-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:797cb20dc07d4f393a466e6bdc253bc35cee17044144ef44ec6d9d538ecb12e0
3
+ size 4907410936
consolidated-00033-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d02a1978181694b3d202d23bc502dfa8d6b8e216c48974bf6eeef3166ad60a1
3
+ size 4806747744
consolidated-00034-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88f380d033eafc99dda94321c2eb8511a62c938ca04d057c1caacb817f14d5e1
3
+ size 4831938360
consolidated-00035-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2a5c220fdb18e87a46466f9ce424f731be8bfa47259639616351faab49feec8
3
+ size 4831938368
consolidated-00036-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:104542c415da34d8d7c31009657d39ab66472cceec34e7a98cea3e8dc41d77c2
3
+ size 4907410944
consolidated-00037-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57d403c77a2c412a9fdffa86306b086d408117c11bd11a0709f3eaa13311f210
3
+ size 4806747752
consolidated-00038-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6a5014cf31feff1ebb92fac33534015473e1c1b8b9a4073a7d333d3196be5cf
3
+ size 4831938360
consolidated-00039-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:489047d1ac8916b122a32b16f132af07c30db95d9023164aa2f7cdf0d1850748
3
+ size 4831938360
consolidated-00040-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec23d2acb9321d4e1501753f5b5adf4e4b5aff2dff8b49806bc3d819fe0f4131
3
+ size 4907410944
consolidated-00041-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e179f6cb560ba8305def3c4551fdb9f18f979c54aa235f7f4942c301c4ef9a25
3
+ size 4806747752
consolidated-00042-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02e3b3141f6c2a5ecbcfddce26853e54f130e8c920d824015d387e4c9873994a
3
+ size 4831938360
consolidated-00043-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:955d097c5282c9bd9ae4fd426e6780ad559a8bf7c491c2fefe9b42dfc1a508e3
3
+ size 4831938368
consolidated-00044-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:486a73407f979da5138b44d60fc9bfbf9f98748fb311422147e471daaba74b49
3
+ size 4907410944
consolidated-00045-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6a1e65405141b6ef0027fdbf5327412a7e61da0e2d91c9a57767d0510f94e1e
3
+ size 4806747744
consolidated-00046-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49142af9980b6d816fd347a7d6c216a0204409cfb4e71d6c773fabe5d70023e5
3
+ size 4831938360
consolidated-00047-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:552b6785afd1e7bc83fd9436e49d110074a86090c3819a6a4123211ed7608f98
3
+ size 4831938368