Upload folder using huggingface_hub

LICENSE

@@ -0,0 +1,53 @@
+Tongyi Qianwen LICENSE AGREEMENT
+
+Tongyi Qianwen Release Date: August 3, 2023
+
+By clicking to agree or by using or distributing any portion or element of the Tongyi Qianwen Materials, you will be deemed to have recognized and accepted the content of this Agreement, which is effective immediately.
+
+1. Definitions
+    a. This Tongyi Qianwen LICENSE AGREEMENT (this "Agreement") shall mean the terms and conditions for use, reproduction, distribution and modification of the Materials as defined by this Agreement.
+    b. "We"(or "Us") shall mean Alibaba Cloud.
+    c. "You" (or "Your") shall mean a natural person or legal entity exercising the rights granted by this Agreement and/or using the Materials for any purpose and in any field of use.
+    d. "Third Parties" shall mean individuals or legal entities that are not under common control with Us or You.
+    e. "Tongyi Qianwen" shall mean the large language models (including Qwen model and Qwen-Chat model), and software and algorithms, consisting of trained model weights, parameters (including optimizer states), machine-learning model code, inference-enabling code, training-enabling code, fine-tuning enabling code and other elements of the foregoing distributed by Us.
+    f. "Materials" shall mean, collectively, Alibaba Cloud's proprietary Tongyi Qianwen and Documentation (and any portion thereof) made available under this Agreement.
+    g. "Source" form shall mean the preferred form for making modifications, including but not limited to model source code, documentation source, and configuration files.
+    h. "Object" form shall mean any form resulting from mechanical transformation or translation of a Source form, including but not limited to compiled object code, generated documentation,
+ and conversions to other media types.
+
+2. Grant of Rights
+You are granted a non-exclusive, worldwide, non-transferable and royalty-free limited license under Alibaba Cloud's intellectual property or other rights owned by Us embodied in the Materials to use, reproduce, distribute, copy, create derivative works of, and make modifications to the Materials.
+
+3. Redistribution
+You may reproduce and distribute copies of the Materials or derivative works thereof in any medium, with or without modifications, and in Source or Object form, provided that You meet the following conditions:
+    a. You shall give any other recipients of the Materials or derivative works a copy of this Agreement;
+    b. You shall cause any modified files to carry prominent notices stating that You changed the files;
+    c. You shall retain in all copies of the Materials that You distribute the following attribution notices within a "Notice" text file distributed as a part of such copies: "Tongyi Qianwen is licensed under the Tongyi Qianwen LICENSE AGREEMENT, Copyright (c) Alibaba Cloud. All Rights Reserved."; and
+    d. You may add Your own copyright statement to Your modifications and may provide additional or different license terms and conditions for use, reproduction, or distribution of Your modifications, or for any such derivative works as a whole, provided Your use, reproduction, and distribution of the work otherwise complies with the terms and conditions of this Agreement.
+
+4. Restrictions
+If you are commercially using the Materials, and your product or service has more than 100 million monthly active users, You shall request a license from Us. You cannot exercise your rights under this Agreement without our express authorization.
+
+5. Rules of use
+    a. The Materials may be subject to export controls or restrictions in China, the United States or other countries or regions. You shall comply with applicable laws and regulations in your use of the Materials.
+    b. You can not use the Materials or any output therefrom to improve any other large language model (excluding Tongyi Qianwen or derivative works thereof).
+
+6. Intellectual Property
+    a. We retain ownership of all intellectual property rights in and to the Materials and derivatives made by or for Us. Conditioned upon compliance with the terms and conditions of this Agreement, with respect to any derivative works and modifications of the Materials that are made by you, you are and will be the owner of such derivative works and modifications.
+    b. No trademark license is granted to use the trade names, trademarks, service marks, or product names of Us, except as required to fulfill notice requirements under this Agreement or as required for reasonable and customary use in describing and redistributing the Materials.
+    c. If you commence a lawsuit or other proceedings (including a cross-claim or counterclaim in a lawsuit) against Us or any entity alleging that the Materials or any output therefrom, or any part of the foregoing, infringe any intellectual property or other right owned or licensable by you, then all licences granted to you under this Agreement shall terminate as of the date such lawsuit or other proceeding is commenced or brought.
+
+7. Disclaimer of Warranty and Limitation of Liability
+
+    a. We are not obligated to support, update, provide training for, or develop any further version of the Tongyi Qianwen Materials or to grant any license thereto.
+    b. THE MATERIALS ARE PROVIDED "AS IS" WITHOUT ANY EXPRESS OR IMPLIED WARRANTY OF ANY KIND INCLUDING WARRANTIES OF MERCHANTABILITY, NONINFRINGEMENT, OR FITNESS FOR A PARTICULAR PURPOSE. WE MAKE NO WARRANTY AND ASSUME NO RESPONSIBILITY FOR THE SAFETY OR STABILITY OF THE MATERIALS AND ANY OUTPUT THEREFROM.
+    c. IN NO EVENT SHALL WE BE LIABLE TO YOU FOR ANY DAMAGES, INCLUDING, BUT NOT LIMITED TO ANY DIRECT, OR INDIRECT, SPECIAL OR CONSEQUENTIAL DAMAGES ARISING FROM YOUR USE OR INABILITY TO USE THE MATERIALS OR ANY OUTPUT OF IT, NO MATTER HOW IT’S CAUSED.
+    d. You will defend, indemnify and hold harmless Us from and against any claim by any third party arising out of or related to your use or distribution of the Materials.
+
+8. Survival and Termination.
+    a. The term of this Agreement shall commence upon your acceptance of this Agreement or access to the Materials and will continue in full force and effect until terminated in accordance with the terms and conditions herein.
+    b. We may terminate this Agreement if you breach any of the terms or conditions of this Agreement. Upon termination of this Agreement, you must delete and cease use of the Materials. Sections 7 and 9 shall survive the termination of this Agreement.
+
+9. Governing Law and Jurisdiction.
+    a. This Agreement and any dispute arising out of or relating to it will be governed by the laws of China, without regard to conflict of law principles, and the UN Convention on Contracts for the International Sale of Goods does not apply to this Agreement.
+    b. The People's Courts in Hangzhou City shall have exclusive jurisdiction over any dispute arising out of this Agreement.

README.md

@@ -0,0 +1,109 @@
+---
+license: other
+license_name: tongyi-qianwen
+license_link: https://huggingface.co/Qwen/Qwen2-Math-72B-Instruct/blob/main/LICENSE
+language:
+- en
+pipeline_tag: text-generation
+tags:
+- chat
+---
+
+
+# Qwen2-Math-72B-Instruct
+
+> [!Warning]
+> <div align="center">
+> <b>
+> 🚨 Temporarily this model mainly supports English. We will release bilingual (English & Chinese) models soon!
+> </b>
+> </div>
+
+## Introduction
+
+Over the past year, we have dedicated significant effort to researching and enhancing the reasoning capabilities of large language models, with a particular focus on their ability to solve arithmetic and mathematical problems. Today, we are delighted to introduce a serise of math-specific large language models of our Qwen2 series,  Qwen2-Math and Qwen2-Math-Instruct-1.5B/7B/72B. Qwen2-Math is a series of specialized math language models built upon the Qwen2 LLMs, which significantly outperforms the mathematical capabilities of open-source models and even closed-source models (e.g., GPT4o). We hope that Qwen2-Math can contribute to the scientific community for solving advanced mathematical problems that require complex, multi-step logical reasoning.
+
+
+## Model Details
+
+
+For more details, please refer to our [blog post](https://qwenlm.github.io/blog/qwen2-math/) and [GitHub repo](https://github.com/QwenLM/Qwen2-Math).
+
+
+## Requirements
+* `transformers>=4.40.0` for Qwen2-Math models. The latest version is recommended.
+
+> [!Warning]
+> <div align="center">
+> <b>
+> 🚨 This is a must because `transformers` integrated Qwen2 codes since `4.37.0`.
+> </b>
+> </div>
+
+For requirements on GPU memory and the respective throughput, see similar results of Qwen2 [here](https://qwen.readthedocs.io/en/latest/benchmark/speed_benchmark.html).
+
+## Quick Start
+
+> [!Important]
+>
+> **Qwen2-Math-72B-Instruct** is an instruction model for chatting;
+>
+> **Qwen2-Math-72B** is a base model typically used for completion and few-shot inference, serving as a better starting point for fine-tuning.
+> 
+
+### 🤗 Hugging Face Transformers
+
+Qwen2-Math can be deployed and infered in the same way as [Qwen2](https://github.com/QwenLM/Qwen2). Here we show a code snippet to show you how to use the chat model with `transformers`:
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+model_name = "Qwen/Qwen2-Math-72B-Instruct"
+device = "cuda" # the device to load the model onto
+
+model = AutoModelForCausalLM.from_pretrained(
+    model_name,
+    torch_dtype="auto",
+    device_map="auto"
+)
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+
+prompt = "Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$."
+messages = [
+    {"role": "system", "content": "You are a helpful assistant."},
+    {"role": "user", "content": prompt}
+]
+text = tokenizer.apply_chat_template(
+    messages,
+    tokenize=False,
+    add_generation_prompt=True
+)
+model_inputs = tokenizer([text], return_tensors="pt").to(device)
+
+generated_ids = model.generate(
+    **model_inputs,
+    max_new_tokens=512
+)
+generated_ids = [
+    output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
+]
+
+response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
+```
+
+### 🤖 ModelScope
+We strongly advise users especially those in mainland China to use ModelScope. `snapshot_download` can help you solve issues concerning downloading checkpoints.
+
+
+## Citation
+
+If you find our work helpful, feel free to give us a citation.
+
+```
+@article{yang2024qwen2,
+  title={Qwen2 technical report},
+  author={Yang, An and Yang, Baosong and Hui, Binyuan and Zheng, Bo and Yu, Bowen and Zhou, Chang and Li, Chengpeng and Li, Chengyuan and Liu, Dayiheng and Huang, Fei and others},
+  journal={arXiv preprint arXiv:2407.10671},
+  year={2024}
+}
+```

config.json

@@ -0,0 +1,28 @@
+{
+  "architectures": [
+    "Qwen2ForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 151643,
+  "eos_token_id": 151645,
+  "hidden_act": "silu",
+  "hidden_size": 8192,
+  "initializer_range": 0.02,
+  "intermediate_size": 29568,
+  "max_position_embeddings": 4096,
+  "max_window_layers": 70,
+  "model_type": "qwen2",
+  "num_attention_heads": 64,
+  "num_hidden_layers": 80,
+  "num_key_value_heads": 8,
+  "rms_norm_eps": 1e-06,
+  "rope_theta": 10000.0,
+  "sliding_window": 32768,
+  "tie_word_embeddings": false,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.43.1",
+  "use_cache": true,
+  "use_mrope": false,
+  "use_sliding_window": false,
+  "vocab_size": 152064
+}

generation_config.json

@@ -0,0 +1,12 @@
+{
+  "bos_token_id": 151643,
+  "pad_token_id": 151643,
+  "do_sample": true,
+  "eos_token_id": [
+    151645,
+    151643
+  ],
+  "top_p": 1.0,
+  "temperature": 0.0,
+  "transformers_version": "4.37.0"
+}

model-00001-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:19f485ac809ed4aaa0314a1f236c71531a6d9c37d8b0544839bba835fe6636d7
+size 3762345336

model-00002-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bbef8a1fdb188d1a9cb60900f06608351bbf6d5e8777e4abc5bbf137b34fb5d6
+size 3995200440

model-00003-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71c77b789a39ef75f1758995863dd756db5421412a151a9041309d524610b951
+size 3812769392

model-00004-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:17ecfc884836e37f6b3a6006113c15555c677283dd41d29dc55828293e2f38df
+size 3995183944

model-00005-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7da525b7e758d723f452054ba361f15b9596926a93b0c9439e10e4fbdcebc436
+size 3995183944

model-00006-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2ad72d7de3a2fd53a7ec4ae41b53881724148e78ae5970afc599007ab8cea30f
+size 3995200456

model-00007-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bad39a43ce1cd86fe8f8e22f9ded8c38d35ddce82fcd31989ee174a5f1ed8987
+size 3812769424

model-00008-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a3cccc8e59825d1ac3b0edeedc074806d75a39d49958aa3880b2f4115145fec1
+size 3995183968

model-00009-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee401d3b6e724f093600b2640ee710d955341046c0b4a91a18d0a2a9cba6dfea
+size 3995183968

model-00010-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6d7d38805905802b4056745fb1015128460d83c2e479b914bdea94b2fa86934e
+size 3995200464

model-00011-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89d509112dd3b13bf90a4308ab34333e6a5688b90a92f184a48cf9c97fded617
+size 3812769424

model-00012-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c66713bf7e4b160c042a79563e4f76e8af87265f78c10a6599edbf4a34e360e
+size 3995183968

model-00013-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8925145ae7229d39254c8ca5dc792062a301b066a2c936bcb5ab1bf17840ec93
+size 3995183968

model-00014-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:daf322bfeb964af01ece331509edef29e04a5a751aa4d14e35254cfc52149991
+size 3995200464

model-00015-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89dd9615a4698778ec89480ecc4d06aeabca5969a0ab60cfc1622ca97d0d4661
+size 3812769424

model-00016-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f6a8287159336b6bbe9d952eb1e8101197bf7689b5105156d0a584d1b29e04f1
+size 3995183968

model-00017-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:224dafdf6c313d4deed0278e8044319d82f89329f24863e3be8e04d75b2921e1
+size 3995183968

model-00018-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aae8b245bfd082f08d4ab31a316d07ff0e5a7f678f3325e385bed96929bff644
+size 3995200464

model-00019-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c70a38a83819ecbc338f2b24f5ea2ff08554c68cc7dfb568dd0a544dabfd452
+size 3812769424

model-00020-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e38b0e89235bb5466be72fdf7dd505feb2586a65b627f08d294612dec0f87f32
+size 3995183968

model-00021-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f2f105188d343304b5856da560fff21f98e279c1bb5abc03abca9922c94d7d96
+size 3995183968

model-00022-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ffc5cd9616eaca1f601d85aea93913776abdc26fb1ada8f7ae0f5fbf4babe97
+size 3995200464

model-00023-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1c5350d4a7dc0c1d039ee803b513949a4eb709d566ccbf5d7ee4d863f5abb815
+size 3812769424

model-00024-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6cad14ec8a03246e2fc68931a52e3e978305a635fe21ce6d17158e206d6617bf
+size 3995183968

model-00025-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:856280be64b82435f7f98370183594611de802e6da439e89a1e3385a8ae5962b
+size 3995183968

model-00026-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:da44618eb4bc564e180a1432534db64525f3f19541a7fad769b61c4b789aaef4
+size 3995200464

model-00027-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e137bd5ebe0dd13fcadf977ce7f55a32533611d08e9b459c0ad47473b27827cc
+size 3812769424

model-00028-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06ab12bc192dac7d95484382e5ba59d974baf6238b8861153b9f12e50193fbdc
+size 3995183968

model-00029-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b86e6892dd1584c0407ad7da3d9b189cc92d80488693606a358343c23fa8e20
+size 3995183968

model-00030-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:74efbf69c03cfaecea1ed9f9d5b9554c4691767cad673be93f9fdf48e1818bc5
+size 3995200464

model-00031-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cac46b57293a1b9f4f104a2adbd684880a53657d8ea2ff98ec46ad6297be3a1e
+size 3812769424

model-00032-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5cc30ea0ab552cd9f901254d00538f3f7bede0e24f2ba7dfa5d19343bf4c3fa5
+size 3995183968

model-00033-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:351911219e801f62b733c31dd3660359f182dd1f550f37338db44300c66fb73d
+size 3995183968

model-00034-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c3cd9c862accdeb096396f93b6042c47062f7545f5013ce652a5310eaa919834
+size 3995200464

model-00035-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d79e58a0ed72f8a2ac83c6d37fc1f0bfa08f613f33335cea6767c9906a0e481f
+size 3812769424

model-00036-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d19db02f91978535c6b9cef907c09311877a15bccc8351851c468a17655cd48c
+size 3995183968

model-00037-of-00037.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62f9ed65e2cc48f2a4af01ea2bdf7427392442eb7ddb6cbcac69362ed1e9f0b1
+size 3460317640

model.safetensors.index.json

@@ -0,0 +1,970 @@
+{
+  "metadata": {
+    "total_size": 145412407296
+  },
+  "weight_map": {
+    "lm_head.weight": "model-00037-of-00037.safetensors",
+    "model.embed_tokens.weight": "model-00001-of-00037.safetensors",
+    "model.layers.0.input_layernorm.weight": "model-00001-of-00037.safetensors",
+    "model.layers.0.mlp.down_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.0.mlp.gate_proj.weight": "model-00001-of-00037.safetensors",
+    "model.layers.0.mlp.up_proj.weight": "model-00001-of-00037.safetensors",
+    "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00037.safetensors",
+    "model.layers.0.self_attn.k_proj.bias": "model-00001-of-00037.safetensors",
+    "model.layers.0.self_attn.k_proj.weight": "model-00001-of-00037.safetensors",
+    "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00037.safetensors",
+    "model.layers.0.self_attn.q_proj.bias": "model-00001-of-00037.safetensors",
+    "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00037.safetensors",
+    "model.layers.0.self_attn.v_proj.bias": "model-00001-of-00037.safetensors",
+    "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00037.safetensors",
+    "model.layers.1.input_layernorm.weight": "model-00002-of-00037.safetensors",
+    "model.layers.1.mlp.down_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.1.mlp.gate_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.1.mlp.up_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.1.post_attention_layernorm.weight": "model-00002-of-00037.safetensors",
+    "model.layers.1.self_attn.k_proj.bias": "model-00002-of-00037.safetensors",
+    "model.layers.1.self_attn.k_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.1.self_attn.o_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.1.self_attn.q_proj.bias": "model-00002-of-00037.safetensors",
+    "model.layers.1.self_attn.q_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.1.self_attn.v_proj.bias": "model-00002-of-00037.safetensors",
+    "model.layers.1.self_attn.v_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.10.input_layernorm.weight": "model-00006-of-00037.safetensors",
+    "model.layers.10.mlp.down_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.10.mlp.gate_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.10.mlp.up_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.10.post_attention_layernorm.weight": "model-00006-of-00037.safetensors",
+    "model.layers.10.self_attn.k_proj.bias": "model-00006-of-00037.safetensors",
+    "model.layers.10.self_attn.k_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.10.self_attn.o_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.10.self_attn.q_proj.bias": "model-00006-of-00037.safetensors",
+    "model.layers.10.self_attn.q_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.10.self_attn.v_proj.bias": "model-00006-of-00037.safetensors",
+    "model.layers.10.self_attn.v_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.11.input_layernorm.weight": "model-00006-of-00037.safetensors",
+    "model.layers.11.mlp.down_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.11.mlp.gate_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.11.mlp.up_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.11.post_attention_layernorm.weight": "model-00006-of-00037.safetensors",
+    "model.layers.11.self_attn.k_proj.bias": "model-00006-of-00037.safetensors",
+    "model.layers.11.self_attn.k_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.11.self_attn.o_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.11.self_attn.q_proj.bias": "model-00006-of-00037.safetensors",
+    "model.layers.11.self_attn.q_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.11.self_attn.v_proj.bias": "model-00006-of-00037.safetensors",
+    "model.layers.11.self_attn.v_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.12.input_layernorm.weight": "model-00006-of-00037.safetensors",
+    "model.layers.12.mlp.down_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.12.mlp.gate_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.12.mlp.up_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.12.post_attention_layernorm.weight": "model-00007-of-00037.safetensors",
+    "model.layers.12.self_attn.k_proj.bias": "model-00007-of-00037.safetensors",
+    "model.layers.12.self_attn.k_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.12.self_attn.o_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.12.self_attn.q_proj.bias": "model-00007-of-00037.safetensors",
+    "model.layers.12.self_attn.q_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.12.self_attn.v_proj.bias": "model-00007-of-00037.safetensors",
+    "model.layers.12.self_attn.v_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.13.input_layernorm.weight": "model-00007-of-00037.safetensors",
+    "model.layers.13.mlp.down_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.13.mlp.gate_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.13.mlp.up_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.13.post_attention_layernorm.weight": "model-00007-of-00037.safetensors",
+    "model.layers.13.self_attn.k_proj.bias": "model-00007-of-00037.safetensors",
+    "model.layers.13.self_attn.k_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.13.self_attn.o_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.13.self_attn.q_proj.bias": "model-00007-of-00037.safetensors",
+    "model.layers.13.self_attn.q_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.13.self_attn.v_proj.bias": "model-00007-of-00037.safetensors",
+    "model.layers.13.self_attn.v_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.14.input_layernorm.weight": "model-00007-of-00037.safetensors",
+    "model.layers.14.mlp.down_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.14.mlp.gate_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.14.mlp.up_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.14.post_attention_layernorm.weight": "model-00007-of-00037.safetensors",
+    "model.layers.14.self_attn.k_proj.bias": "model-00007-of-00037.safetensors",
+    "model.layers.14.self_attn.k_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.14.self_attn.o_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.14.self_attn.q_proj.bias": "model-00007-of-00037.safetensors",
+    "model.layers.14.self_attn.q_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.14.self_attn.v_proj.bias": "model-00007-of-00037.safetensors",
+    "model.layers.14.self_attn.v_proj.weight": "model-00007-of-00037.safetensors",
+    "model.layers.15.input_layernorm.weight": "model-00008-of-00037.safetensors",
+    "model.layers.15.mlp.down_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.15.mlp.gate_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.15.mlp.up_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.15.post_attention_layernorm.weight": "model-00008-of-00037.safetensors",
+    "model.layers.15.self_attn.k_proj.bias": "model-00008-of-00037.safetensors",
+    "model.layers.15.self_attn.k_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.15.self_attn.o_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.15.self_attn.q_proj.bias": "model-00008-of-00037.safetensors",
+    "model.layers.15.self_attn.q_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.15.self_attn.v_proj.bias": "model-00008-of-00037.safetensors",
+    "model.layers.15.self_attn.v_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.16.input_layernorm.weight": "model-00008-of-00037.safetensors",
+    "model.layers.16.mlp.down_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.16.mlp.gate_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.16.mlp.up_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.16.post_attention_layernorm.weight": "model-00008-of-00037.safetensors",
+    "model.layers.16.self_attn.k_proj.bias": "model-00008-of-00037.safetensors",
+    "model.layers.16.self_attn.k_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.16.self_attn.o_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.16.self_attn.q_proj.bias": "model-00008-of-00037.safetensors",
+    "model.layers.16.self_attn.q_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.16.self_attn.v_proj.bias": "model-00008-of-00037.safetensors",
+    "model.layers.16.self_attn.v_proj.weight": "model-00008-of-00037.safetensors",
+    "model.layers.17.input_layernorm.weight": "model-00009-of-00037.safetensors",
+    "model.layers.17.mlp.down_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.17.mlp.gate_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.17.mlp.up_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.17.post_attention_layernorm.weight": "model-00009-of-00037.safetensors",
+    "model.layers.17.self_attn.k_proj.bias": "model-00009-of-00037.safetensors",
+    "model.layers.17.self_attn.k_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.17.self_attn.o_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.17.self_attn.q_proj.bias": "model-00009-of-00037.safetensors",
+    "model.layers.17.self_attn.q_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.17.self_attn.v_proj.bias": "model-00009-of-00037.safetensors",
+    "model.layers.17.self_attn.v_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.18.input_layernorm.weight": "model-00009-of-00037.safetensors",
+    "model.layers.18.mlp.down_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.18.mlp.gate_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.18.mlp.up_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.18.post_attention_layernorm.weight": "model-00009-of-00037.safetensors",
+    "model.layers.18.self_attn.k_proj.bias": "model-00009-of-00037.safetensors",
+    "model.layers.18.self_attn.k_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.18.self_attn.o_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.18.self_attn.q_proj.bias": "model-00009-of-00037.safetensors",
+    "model.layers.18.self_attn.q_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.18.self_attn.v_proj.bias": "model-00009-of-00037.safetensors",
+    "model.layers.18.self_attn.v_proj.weight": "model-00009-of-00037.safetensors",
+    "model.layers.19.input_layernorm.weight": "model-00010-of-00037.safetensors",
+    "model.layers.19.mlp.down_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.19.mlp.gate_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.19.mlp.up_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.19.post_attention_layernorm.weight": "model-00010-of-00037.safetensors",
+    "model.layers.19.self_attn.k_proj.bias": "model-00010-of-00037.safetensors",
+    "model.layers.19.self_attn.k_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.19.self_attn.o_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.19.self_attn.q_proj.bias": "model-00010-of-00037.safetensors",
+    "model.layers.19.self_attn.q_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.19.self_attn.v_proj.bias": "model-00010-of-00037.safetensors",
+    "model.layers.19.self_attn.v_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.2.input_layernorm.weight": "model-00002-of-00037.safetensors",
+    "model.layers.2.mlp.down_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.2.mlp.gate_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.2.mlp.up_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.2.post_attention_layernorm.weight": "model-00002-of-00037.safetensors",
+    "model.layers.2.self_attn.k_proj.bias": "model-00002-of-00037.safetensors",
+    "model.layers.2.self_attn.k_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.2.self_attn.o_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.2.self_attn.q_proj.bias": "model-00002-of-00037.safetensors",
+    "model.layers.2.self_attn.q_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.2.self_attn.v_proj.bias": "model-00002-of-00037.safetensors",
+    "model.layers.2.self_attn.v_proj.weight": "model-00002-of-00037.safetensors",
+    "model.layers.20.input_layernorm.weight": "model-00010-of-00037.safetensors",
+    "model.layers.20.mlp.down_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.20.mlp.gate_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.20.mlp.up_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.20.post_attention_layernorm.weight": "model-00010-of-00037.safetensors",
+    "model.layers.20.self_attn.k_proj.bias": "model-00010-of-00037.safetensors",
+    "model.layers.20.self_attn.k_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.20.self_attn.o_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.20.self_attn.q_proj.bias": "model-00010-of-00037.safetensors",
+    "model.layers.20.self_attn.q_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.20.self_attn.v_proj.bias": "model-00010-of-00037.safetensors",
+    "model.layers.20.self_attn.v_proj.weight": "model-00010-of-00037.safetensors",
+    "model.layers.21.input_layernorm.weight": "model-00010-of-00037.safetensors",
+    "model.layers.21.mlp.down_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.21.mlp.gate_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.21.mlp.up_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.21.post_attention_layernorm.weight": "model-00011-of-00037.safetensors",
+    "model.layers.21.self_attn.k_proj.bias": "model-00011-of-00037.safetensors",
+    "model.layers.21.self_attn.k_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.21.self_attn.o_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.21.self_attn.q_proj.bias": "model-00011-of-00037.safetensors",
+    "model.layers.21.self_attn.q_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.21.self_attn.v_proj.bias": "model-00011-of-00037.safetensors",
+    "model.layers.21.self_attn.v_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.22.input_layernorm.weight": "model-00011-of-00037.safetensors",
+    "model.layers.22.mlp.down_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.22.mlp.gate_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.22.mlp.up_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.22.post_attention_layernorm.weight": "model-00011-of-00037.safetensors",
+    "model.layers.22.self_attn.k_proj.bias": "model-00011-of-00037.safetensors",
+    "model.layers.22.self_attn.k_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.22.self_attn.o_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.22.self_attn.q_proj.bias": "model-00011-of-00037.safetensors",
+    "model.layers.22.self_attn.q_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.22.self_attn.v_proj.bias": "model-00011-of-00037.safetensors",
+    "model.layers.22.self_attn.v_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.23.input_layernorm.weight": "model-00011-of-00037.safetensors",
+    "model.layers.23.mlp.down_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.23.mlp.gate_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.23.mlp.up_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.23.post_attention_layernorm.weight": "model-00011-of-00037.safetensors",
+    "model.layers.23.self_attn.k_proj.bias": "model-00011-of-00037.safetensors",
+    "model.layers.23.self_attn.k_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.23.self_attn.o_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.23.self_attn.q_proj.bias": "model-00011-of-00037.safetensors",
+    "model.layers.23.self_attn.q_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.23.self_attn.v_proj.bias": "model-00011-of-00037.safetensors",
+    "model.layers.23.self_attn.v_proj.weight": "model-00011-of-00037.safetensors",
+    "model.layers.24.input_layernorm.weight": "model-00012-of-00037.safetensors",
+    "model.layers.24.mlp.down_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.24.mlp.gate_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.24.mlp.up_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.24.post_attention_layernorm.weight": "model-00012-of-00037.safetensors",
+    "model.layers.24.self_attn.k_proj.bias": "model-00012-of-00037.safetensors",
+    "model.layers.24.self_attn.k_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.24.self_attn.o_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.24.self_attn.q_proj.bias": "model-00012-of-00037.safetensors",
+    "model.layers.24.self_attn.q_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.24.self_attn.v_proj.bias": "model-00012-of-00037.safetensors",
+    "model.layers.24.self_attn.v_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.25.input_layernorm.weight": "model-00012-of-00037.safetensors",
+    "model.layers.25.mlp.down_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.25.mlp.gate_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.25.mlp.up_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.25.post_attention_layernorm.weight": "model-00012-of-00037.safetensors",
+    "model.layers.25.self_attn.k_proj.bias": "model-00012-of-00037.safetensors",
+    "model.layers.25.self_attn.k_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.25.self_attn.o_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.25.self_attn.q_proj.bias": "model-00012-of-00037.safetensors",
+    "model.layers.25.self_attn.q_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.25.self_attn.v_proj.bias": "model-00012-of-00037.safetensors",
+    "model.layers.25.self_attn.v_proj.weight": "model-00012-of-00037.safetensors",
+    "model.layers.26.input_layernorm.weight": "model-00013-of-00037.safetensors",
+    "model.layers.26.mlp.down_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.26.mlp.gate_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.26.mlp.up_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.26.post_attention_layernorm.weight": "model-00013-of-00037.safetensors",
+    "model.layers.26.self_attn.k_proj.bias": "model-00013-of-00037.safetensors",
+    "model.layers.26.self_attn.k_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.26.self_attn.o_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.26.self_attn.q_proj.bias": "model-00013-of-00037.safetensors",
+    "model.layers.26.self_attn.q_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.26.self_attn.v_proj.bias": "model-00013-of-00037.safetensors",
+    "model.layers.26.self_attn.v_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.27.input_layernorm.weight": "model-00013-of-00037.safetensors",
+    "model.layers.27.mlp.down_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.27.mlp.gate_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.27.mlp.up_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.27.post_attention_layernorm.weight": "model-00013-of-00037.safetensors",
+    "model.layers.27.self_attn.k_proj.bias": "model-00013-of-00037.safetensors",
+    "model.layers.27.self_attn.k_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.27.self_attn.o_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.27.self_attn.q_proj.bias": "model-00013-of-00037.safetensors",
+    "model.layers.27.self_attn.q_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.27.self_attn.v_proj.bias": "model-00013-of-00037.safetensors",
+    "model.layers.27.self_attn.v_proj.weight": "model-00013-of-00037.safetensors",
+    "model.layers.28.input_layernorm.weight": "model-00014-of-00037.safetensors",
+    "model.layers.28.mlp.down_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.28.mlp.gate_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.28.mlp.up_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.28.post_attention_layernorm.weight": "model-00014-of-00037.safetensors",
+    "model.layers.28.self_attn.k_proj.bias": "model-00014-of-00037.safetensors",
+    "model.layers.28.self_attn.k_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.28.self_attn.o_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.28.self_attn.q_proj.bias": "model-00014-of-00037.safetensors",
+    "model.layers.28.self_attn.q_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.28.self_attn.v_proj.bias": "model-00014-of-00037.safetensors",
+    "model.layers.28.self_attn.v_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.29.input_layernorm.weight": "model-00014-of-00037.safetensors",
+    "model.layers.29.mlp.down_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.29.mlp.gate_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.29.mlp.up_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.29.post_attention_layernorm.weight": "model-00014-of-00037.safetensors",
+    "model.layers.29.self_attn.k_proj.bias": "model-00014-of-00037.safetensors",
+    "model.layers.29.self_attn.k_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.29.self_attn.o_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.29.self_attn.q_proj.bias": "model-00014-of-00037.safetensors",
+    "model.layers.29.self_attn.q_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.29.self_attn.v_proj.bias": "model-00014-of-00037.safetensors",
+    "model.layers.29.self_attn.v_proj.weight": "model-00014-of-00037.safetensors",
+    "model.layers.3.input_layernorm.weight": "model-00002-of-00037.safetensors",
+    "model.layers.3.mlp.down_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.3.mlp.gate_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.3.mlp.up_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.3.post_attention_layernorm.weight": "model-00003-of-00037.safetensors",
+    "model.layers.3.self_attn.k_proj.bias": "model-00003-of-00037.safetensors",
+    "model.layers.3.self_attn.k_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.3.self_attn.o_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.3.self_attn.q_proj.bias": "model-00003-of-00037.safetensors",
+    "model.layers.3.self_attn.q_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.3.self_attn.v_proj.bias": "model-00003-of-00037.safetensors",
+    "model.layers.3.self_attn.v_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.30.input_layernorm.weight": "model-00014-of-00037.safetensors",
+    "model.layers.30.mlp.down_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.30.mlp.gate_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.30.mlp.up_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.30.post_attention_layernorm.weight": "model-00015-of-00037.safetensors",
+    "model.layers.30.self_attn.k_proj.bias": "model-00015-of-00037.safetensors",
+    "model.layers.30.self_attn.k_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.30.self_attn.o_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.30.self_attn.q_proj.bias": "model-00015-of-00037.safetensors",
+    "model.layers.30.self_attn.q_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.30.self_attn.v_proj.bias": "model-00015-of-00037.safetensors",
+    "model.layers.30.self_attn.v_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.31.input_layernorm.weight": "model-00015-of-00037.safetensors",
+    "model.layers.31.mlp.down_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.31.mlp.gate_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.31.mlp.up_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.31.post_attention_layernorm.weight": "model-00015-of-00037.safetensors",
+    "model.layers.31.self_attn.k_proj.bias": "model-00015-of-00037.safetensors",
+    "model.layers.31.self_attn.k_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.31.self_attn.o_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.31.self_attn.q_proj.bias": "model-00015-of-00037.safetensors",
+    "model.layers.31.self_attn.q_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.31.self_attn.v_proj.bias": "model-00015-of-00037.safetensors",
+    "model.layers.31.self_attn.v_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.32.input_layernorm.weight": "model-00015-of-00037.safetensors",
+    "model.layers.32.mlp.down_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.32.mlp.gate_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.32.mlp.up_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.32.post_attention_layernorm.weight": "model-00015-of-00037.safetensors",
+    "model.layers.32.self_attn.k_proj.bias": "model-00015-of-00037.safetensors",
+    "model.layers.32.self_attn.k_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.32.self_attn.o_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.32.self_attn.q_proj.bias": "model-00015-of-00037.safetensors",
+    "model.layers.32.self_attn.q_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.32.self_attn.v_proj.bias": "model-00015-of-00037.safetensors",
+    "model.layers.32.self_attn.v_proj.weight": "model-00015-of-00037.safetensors",
+    "model.layers.33.input_layernorm.weight": "model-00016-of-00037.safetensors",
+    "model.layers.33.mlp.down_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.33.mlp.gate_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.33.mlp.up_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.33.post_attention_layernorm.weight": "model-00016-of-00037.safetensors",
+    "model.layers.33.self_attn.k_proj.bias": "model-00016-of-00037.safetensors",
+    "model.layers.33.self_attn.k_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.33.self_attn.o_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.33.self_attn.q_proj.bias": "model-00016-of-00037.safetensors",
+    "model.layers.33.self_attn.q_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.33.self_attn.v_proj.bias": "model-00016-of-00037.safetensors",
+    "model.layers.33.self_attn.v_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.34.input_layernorm.weight": "model-00016-of-00037.safetensors",
+    "model.layers.34.mlp.down_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.34.mlp.gate_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.34.mlp.up_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.34.post_attention_layernorm.weight": "model-00016-of-00037.safetensors",
+    "model.layers.34.self_attn.k_proj.bias": "model-00016-of-00037.safetensors",
+    "model.layers.34.self_attn.k_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.34.self_attn.o_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.34.self_attn.q_proj.bias": "model-00016-of-00037.safetensors",
+    "model.layers.34.self_attn.q_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.34.self_attn.v_proj.bias": "model-00016-of-00037.safetensors",
+    "model.layers.34.self_attn.v_proj.weight": "model-00016-of-00037.safetensors",
+    "model.layers.35.input_layernorm.weight": "model-00017-of-00037.safetensors",
+    "model.layers.35.mlp.down_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.35.mlp.gate_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.35.mlp.up_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.35.post_attention_layernorm.weight": "model-00017-of-00037.safetensors",
+    "model.layers.35.self_attn.k_proj.bias": "model-00017-of-00037.safetensors",
+    "model.layers.35.self_attn.k_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.35.self_attn.o_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.35.self_attn.q_proj.bias": "model-00017-of-00037.safetensors",
+    "model.layers.35.self_attn.q_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.35.self_attn.v_proj.bias": "model-00017-of-00037.safetensors",
+    "model.layers.35.self_attn.v_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.36.input_layernorm.weight": "model-00017-of-00037.safetensors",
+    "model.layers.36.mlp.down_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.36.mlp.gate_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.36.mlp.up_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.36.post_attention_layernorm.weight": "model-00017-of-00037.safetensors",
+    "model.layers.36.self_attn.k_proj.bias": "model-00017-of-00037.safetensors",
+    "model.layers.36.self_attn.k_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.36.self_attn.o_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.36.self_attn.q_proj.bias": "model-00017-of-00037.safetensors",
+    "model.layers.36.self_attn.q_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.36.self_attn.v_proj.bias": "model-00017-of-00037.safetensors",
+    "model.layers.36.self_attn.v_proj.weight": "model-00017-of-00037.safetensors",
+    "model.layers.37.input_layernorm.weight": "model-00018-of-00037.safetensors",
+    "model.layers.37.mlp.down_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.37.mlp.gate_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.37.mlp.up_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.37.post_attention_layernorm.weight": "model-00018-of-00037.safetensors",
+    "model.layers.37.self_attn.k_proj.bias": "model-00018-of-00037.safetensors",
+    "model.layers.37.self_attn.k_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.37.self_attn.o_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.37.self_attn.q_proj.bias": "model-00018-of-00037.safetensors",
+    "model.layers.37.self_attn.q_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.37.self_attn.v_proj.bias": "model-00018-of-00037.safetensors",
+    "model.layers.37.self_attn.v_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.38.input_layernorm.weight": "model-00018-of-00037.safetensors",
+    "model.layers.38.mlp.down_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.38.mlp.gate_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.38.mlp.up_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.38.post_attention_layernorm.weight": "model-00018-of-00037.safetensors",
+    "model.layers.38.self_attn.k_proj.bias": "model-00018-of-00037.safetensors",
+    "model.layers.38.self_attn.k_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.38.self_attn.o_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.38.self_attn.q_proj.bias": "model-00018-of-00037.safetensors",
+    "model.layers.38.self_attn.q_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.38.self_attn.v_proj.bias": "model-00018-of-00037.safetensors",
+    "model.layers.38.self_attn.v_proj.weight": "model-00018-of-00037.safetensors",
+    "model.layers.39.input_layernorm.weight": "model-00018-of-00037.safetensors",
+    "model.layers.39.mlp.down_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.39.mlp.gate_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.39.mlp.up_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.39.post_attention_layernorm.weight": "model-00019-of-00037.safetensors",
+    "model.layers.39.self_attn.k_proj.bias": "model-00019-of-00037.safetensors",
+    "model.layers.39.self_attn.k_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.39.self_attn.o_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.39.self_attn.q_proj.bias": "model-00019-of-00037.safetensors",
+    "model.layers.39.self_attn.q_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.39.self_attn.v_proj.bias": "model-00019-of-00037.safetensors",
+    "model.layers.39.self_attn.v_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.4.input_layernorm.weight": "model-00003-of-00037.safetensors",
+    "model.layers.4.mlp.down_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.4.mlp.gate_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.4.mlp.up_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.4.post_attention_layernorm.weight": "model-00003-of-00037.safetensors",
+    "model.layers.4.self_attn.k_proj.bias": "model-00003-of-00037.safetensors",
+    "model.layers.4.self_attn.k_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.4.self_attn.o_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.4.self_attn.q_proj.bias": "model-00003-of-00037.safetensors",
+    "model.layers.4.self_attn.q_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.4.self_attn.v_proj.bias": "model-00003-of-00037.safetensors",
+    "model.layers.4.self_attn.v_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.40.input_layernorm.weight": "model-00019-of-00037.safetensors",
+    "model.layers.40.mlp.down_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.40.mlp.gate_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.40.mlp.up_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.40.post_attention_layernorm.weight": "model-00019-of-00037.safetensors",
+    "model.layers.40.self_attn.k_proj.bias": "model-00019-of-00037.safetensors",
+    "model.layers.40.self_attn.k_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.40.self_attn.o_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.40.self_attn.q_proj.bias": "model-00019-of-00037.safetensors",
+    "model.layers.40.self_attn.q_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.40.self_attn.v_proj.bias": "model-00019-of-00037.safetensors",
+    "model.layers.40.self_attn.v_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.41.input_layernorm.weight": "model-00019-of-00037.safetensors",
+    "model.layers.41.mlp.down_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.41.mlp.gate_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.41.mlp.up_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.41.post_attention_layernorm.weight": "model-00019-of-00037.safetensors",
+    "model.layers.41.self_attn.k_proj.bias": "model-00019-of-00037.safetensors",
+    "model.layers.41.self_attn.k_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.41.self_attn.o_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.41.self_attn.q_proj.bias": "model-00019-of-00037.safetensors",
+    "model.layers.41.self_attn.q_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.41.self_attn.v_proj.bias": "model-00019-of-00037.safetensors",
+    "model.layers.41.self_attn.v_proj.weight": "model-00019-of-00037.safetensors",
+    "model.layers.42.input_layernorm.weight": "model-00020-of-00037.safetensors",
+    "model.layers.42.mlp.down_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.42.mlp.gate_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.42.mlp.up_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.42.post_attention_layernorm.weight": "model-00020-of-00037.safetensors",
+    "model.layers.42.self_attn.k_proj.bias": "model-00020-of-00037.safetensors",
+    "model.layers.42.self_attn.k_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.42.self_attn.o_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.42.self_attn.q_proj.bias": "model-00020-of-00037.safetensors",
+    "model.layers.42.self_attn.q_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.42.self_attn.v_proj.bias": "model-00020-of-00037.safetensors",
+    "model.layers.42.self_attn.v_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.43.input_layernorm.weight": "model-00020-of-00037.safetensors",
+    "model.layers.43.mlp.down_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.43.mlp.gate_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.43.mlp.up_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.43.post_attention_layernorm.weight": "model-00020-of-00037.safetensors",
+    "model.layers.43.self_attn.k_proj.bias": "model-00020-of-00037.safetensors",
+    "model.layers.43.self_attn.k_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.43.self_attn.o_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.43.self_attn.q_proj.bias": "model-00020-of-00037.safetensors",
+    "model.layers.43.self_attn.q_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.43.self_attn.v_proj.bias": "model-00020-of-00037.safetensors",
+    "model.layers.43.self_attn.v_proj.weight": "model-00020-of-00037.safetensors",
+    "model.layers.44.input_layernorm.weight": "model-00021-of-00037.safetensors",
+    "model.layers.44.mlp.down_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.44.mlp.gate_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.44.mlp.up_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.44.post_attention_layernorm.weight": "model-00021-of-00037.safetensors",
+    "model.layers.44.self_attn.k_proj.bias": "model-00021-of-00037.safetensors",
+    "model.layers.44.self_attn.k_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.44.self_attn.o_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.44.self_attn.q_proj.bias": "model-00021-of-00037.safetensors",
+    "model.layers.44.self_attn.q_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.44.self_attn.v_proj.bias": "model-00021-of-00037.safetensors",
+    "model.layers.44.self_attn.v_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.45.input_layernorm.weight": "model-00021-of-00037.safetensors",
+    "model.layers.45.mlp.down_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.45.mlp.gate_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.45.mlp.up_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.45.post_attention_layernorm.weight": "model-00021-of-00037.safetensors",
+    "model.layers.45.self_attn.k_proj.bias": "model-00021-of-00037.safetensors",
+    "model.layers.45.self_attn.k_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.45.self_attn.o_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.45.self_attn.q_proj.bias": "model-00021-of-00037.safetensors",
+    "model.layers.45.self_attn.q_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.45.self_attn.v_proj.bias": "model-00021-of-00037.safetensors",
+    "model.layers.45.self_attn.v_proj.weight": "model-00021-of-00037.safetensors",
+    "model.layers.46.input_layernorm.weight": "model-00022-of-00037.safetensors",
+    "model.layers.46.mlp.down_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.46.mlp.gate_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.46.mlp.up_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.46.post_attention_layernorm.weight": "model-00022-of-00037.safetensors",
+    "model.layers.46.self_attn.k_proj.bias": "model-00022-of-00037.safetensors",
+    "model.layers.46.self_attn.k_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.46.self_attn.o_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.46.self_attn.q_proj.bias": "model-00022-of-00037.safetensors",
+    "model.layers.46.self_attn.q_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.46.self_attn.v_proj.bias": "model-00022-of-00037.safetensors",
+    "model.layers.46.self_attn.v_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.47.input_layernorm.weight": "model-00022-of-00037.safetensors",
+    "model.layers.47.mlp.down_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.47.mlp.gate_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.47.mlp.up_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.47.post_attention_layernorm.weight": "model-00022-of-00037.safetensors",
+    "model.layers.47.self_attn.k_proj.bias": "model-00022-of-00037.safetensors",
+    "model.layers.47.self_attn.k_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.47.self_attn.o_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.47.self_attn.q_proj.bias": "model-00022-of-00037.safetensors",
+    "model.layers.47.self_attn.q_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.47.self_attn.v_proj.bias": "model-00022-of-00037.safetensors",
+    "model.layers.47.self_attn.v_proj.weight": "model-00022-of-00037.safetensors",
+    "model.layers.48.input_layernorm.weight": "model-00022-of-00037.safetensors",
+    "model.layers.48.mlp.down_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.48.mlp.gate_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.48.mlp.up_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.48.post_attention_layernorm.weight": "model-00023-of-00037.safetensors",
+    "model.layers.48.self_attn.k_proj.bias": "model-00023-of-00037.safetensors",
+    "model.layers.48.self_attn.k_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.48.self_attn.o_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.48.self_attn.q_proj.bias": "model-00023-of-00037.safetensors",
+    "model.layers.48.self_attn.q_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.48.self_attn.v_proj.bias": "model-00023-of-00037.safetensors",
+    "model.layers.48.self_attn.v_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.49.input_layernorm.weight": "model-00023-of-00037.safetensors",
+    "model.layers.49.mlp.down_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.49.mlp.gate_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.49.mlp.up_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.49.post_attention_layernorm.weight": "model-00023-of-00037.safetensors",
+    "model.layers.49.self_attn.k_proj.bias": "model-00023-of-00037.safetensors",
+    "model.layers.49.self_attn.k_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.49.self_attn.o_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.49.self_attn.q_proj.bias": "model-00023-of-00037.safetensors",
+    "model.layers.49.self_attn.q_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.49.self_attn.v_proj.bias": "model-00023-of-00037.safetensors",
+    "model.layers.49.self_attn.v_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.5.input_layernorm.weight": "model-00003-of-00037.safetensors",
+    "model.layers.5.mlp.down_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.5.mlp.gate_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.5.mlp.up_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.5.post_attention_layernorm.weight": "model-00003-of-00037.safetensors",
+    "model.layers.5.self_attn.k_proj.bias": "model-00003-of-00037.safetensors",
+    "model.layers.5.self_attn.k_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.5.self_attn.o_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.5.self_attn.q_proj.bias": "model-00003-of-00037.safetensors",
+    "model.layers.5.self_attn.q_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.5.self_attn.v_proj.bias": "model-00003-of-00037.safetensors",
+    "model.layers.5.self_attn.v_proj.weight": "model-00003-of-00037.safetensors",
+    "model.layers.50.input_layernorm.weight": "model-00023-of-00037.safetensors",
+    "model.layers.50.mlp.down_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.50.mlp.gate_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.50.mlp.up_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.50.post_attention_layernorm.weight": "model-00023-of-00037.safetensors",
+    "model.layers.50.self_attn.k_proj.bias": "model-00023-of-00037.safetensors",
+    "model.layers.50.self_attn.k_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.50.self_attn.o_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.50.self_attn.q_proj.bias": "model-00023-of-00037.safetensors",
+    "model.layers.50.self_attn.q_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.50.self_attn.v_proj.bias": "model-00023-of-00037.safetensors",
+    "model.layers.50.self_attn.v_proj.weight": "model-00023-of-00037.safetensors",
+    "model.layers.51.input_layernorm.weight": "model-00024-of-00037.safetensors",
+    "model.layers.51.mlp.down_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.51.mlp.gate_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.51.mlp.up_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.51.post_attention_layernorm.weight": "model-00024-of-00037.safetensors",
+    "model.layers.51.self_attn.k_proj.bias": "model-00024-of-00037.safetensors",
+    "model.layers.51.self_attn.k_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.51.self_attn.o_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.51.self_attn.q_proj.bias": "model-00024-of-00037.safetensors",
+    "model.layers.51.self_attn.q_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.51.self_attn.v_proj.bias": "model-00024-of-00037.safetensors",
+    "model.layers.51.self_attn.v_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.52.input_layernorm.weight": "model-00024-of-00037.safetensors",
+    "model.layers.52.mlp.down_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.52.mlp.gate_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.52.mlp.up_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.52.post_attention_layernorm.weight": "model-00024-of-00037.safetensors",
+    "model.layers.52.self_attn.k_proj.bias": "model-00024-of-00037.safetensors",
+    "model.layers.52.self_attn.k_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.52.self_attn.o_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.52.self_attn.q_proj.bias": "model-00024-of-00037.safetensors",
+    "model.layers.52.self_attn.q_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.52.self_attn.v_proj.bias": "model-00024-of-00037.safetensors",
+    "model.layers.52.self_attn.v_proj.weight": "model-00024-of-00037.safetensors",
+    "model.layers.53.input_layernorm.weight": "model-00025-of-00037.safetensors",
+    "model.layers.53.mlp.down_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.53.mlp.gate_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.53.mlp.up_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.53.post_attention_layernorm.weight": "model-00025-of-00037.safetensors",
+    "model.layers.53.self_attn.k_proj.bias": "model-00025-of-00037.safetensors",
+    "model.layers.53.self_attn.k_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.53.self_attn.o_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.53.self_attn.q_proj.bias": "model-00025-of-00037.safetensors",
+    "model.layers.53.self_attn.q_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.53.self_attn.v_proj.bias": "model-00025-of-00037.safetensors",
+    "model.layers.53.self_attn.v_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.54.input_layernorm.weight": "model-00025-of-00037.safetensors",
+    "model.layers.54.mlp.down_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.54.mlp.gate_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.54.mlp.up_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.54.post_attention_layernorm.weight": "model-00025-of-00037.safetensors",
+    "model.layers.54.self_attn.k_proj.bias": "model-00025-of-00037.safetensors",
+    "model.layers.54.self_attn.k_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.54.self_attn.o_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.54.self_attn.q_proj.bias": "model-00025-of-00037.safetensors",
+    "model.layers.54.self_attn.q_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.54.self_attn.v_proj.bias": "model-00025-of-00037.safetensors",
+    "model.layers.54.self_attn.v_proj.weight": "model-00025-of-00037.safetensors",
+    "model.layers.55.input_layernorm.weight": "model-00026-of-00037.safetensors",
+    "model.layers.55.mlp.down_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.55.mlp.gate_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.55.mlp.up_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.55.post_attention_layernorm.weight": "model-00026-of-00037.safetensors",
+    "model.layers.55.self_attn.k_proj.bias": "model-00026-of-00037.safetensors",
+    "model.layers.55.self_attn.k_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.55.self_attn.o_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.55.self_attn.q_proj.bias": "model-00026-of-00037.safetensors",
+    "model.layers.55.self_attn.q_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.55.self_attn.v_proj.bias": "model-00026-of-00037.safetensors",
+    "model.layers.55.self_attn.v_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.56.input_layernorm.weight": "model-00026-of-00037.safetensors",
+    "model.layers.56.mlp.down_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.56.mlp.gate_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.56.mlp.up_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.56.post_attention_layernorm.weight": "model-00026-of-00037.safetensors",
+    "model.layers.56.self_attn.k_proj.bias": "model-00026-of-00037.safetensors",
+    "model.layers.56.self_attn.k_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.56.self_attn.o_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.56.self_attn.q_proj.bias": "model-00026-of-00037.safetensors",
+    "model.layers.56.self_attn.q_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.56.self_attn.v_proj.bias": "model-00026-of-00037.safetensors",
+    "model.layers.56.self_attn.v_proj.weight": "model-00026-of-00037.safetensors",
+    "model.layers.57.input_layernorm.weight": "model-00026-of-00037.safetensors",
+    "model.layers.57.mlp.down_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.57.mlp.gate_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.57.mlp.up_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.57.post_attention_layernorm.weight": "model-00027-of-00037.safetensors",
+    "model.layers.57.self_attn.k_proj.bias": "model-00027-of-00037.safetensors",
+    "model.layers.57.self_attn.k_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.57.self_attn.o_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.57.self_attn.q_proj.bias": "model-00027-of-00037.safetensors",
+    "model.layers.57.self_attn.q_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.57.self_attn.v_proj.bias": "model-00027-of-00037.safetensors",
+    "model.layers.57.self_attn.v_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.58.input_layernorm.weight": "model-00027-of-00037.safetensors",
+    "model.layers.58.mlp.down_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.58.mlp.gate_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.58.mlp.up_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.58.post_attention_layernorm.weight": "model-00027-of-00037.safetensors",
+    "model.layers.58.self_attn.k_proj.bias": "model-00027-of-00037.safetensors",
+    "model.layers.58.self_attn.k_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.58.self_attn.o_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.58.self_attn.q_proj.bias": "model-00027-of-00037.safetensors",
+    "model.layers.58.self_attn.q_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.58.self_attn.v_proj.bias": "model-00027-of-00037.safetensors",
+    "model.layers.58.self_attn.v_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.59.input_layernorm.weight": "model-00027-of-00037.safetensors",
+    "model.layers.59.mlp.down_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.59.mlp.gate_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.59.mlp.up_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.59.post_attention_layernorm.weight": "model-00027-of-00037.safetensors",
+    "model.layers.59.self_attn.k_proj.bias": "model-00027-of-00037.safetensors",
+    "model.layers.59.self_attn.k_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.59.self_attn.o_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.59.self_attn.q_proj.bias": "model-00027-of-00037.safetensors",
+    "model.layers.59.self_attn.q_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.59.self_attn.v_proj.bias": "model-00027-of-00037.safetensors",
+    "model.layers.59.self_attn.v_proj.weight": "model-00027-of-00037.safetensors",
+    "model.layers.6.input_layernorm.weight": "model-00004-of-00037.safetensors",
+    "model.layers.6.mlp.down_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.6.mlp.gate_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.6.mlp.up_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.6.post_attention_layernorm.weight": "model-00004-of-00037.safetensors",
+    "model.layers.6.self_attn.k_proj.bias": "model-00004-of-00037.safetensors",
+    "model.layers.6.self_attn.k_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.6.self_attn.o_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.6.self_attn.q_proj.bias": "model-00004-of-00037.safetensors",
+    "model.layers.6.self_attn.q_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.6.self_attn.v_proj.bias": "model-00004-of-00037.safetensors",
+    "model.layers.6.self_attn.v_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.60.input_layernorm.weight": "model-00028-of-00037.safetensors",
+    "model.layers.60.mlp.down_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.60.mlp.gate_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.60.mlp.up_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.60.post_attention_layernorm.weight": "model-00028-of-00037.safetensors",
+    "model.layers.60.self_attn.k_proj.bias": "model-00028-of-00037.safetensors",
+    "model.layers.60.self_attn.k_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.60.self_attn.o_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.60.self_attn.q_proj.bias": "model-00028-of-00037.safetensors",
+    "model.layers.60.self_attn.q_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.60.self_attn.v_proj.bias": "model-00028-of-00037.safetensors",
+    "model.layers.60.self_attn.v_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.61.input_layernorm.weight": "model-00028-of-00037.safetensors",
+    "model.layers.61.mlp.down_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.61.mlp.gate_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.61.mlp.up_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.61.post_attention_layernorm.weight": "model-00028-of-00037.safetensors",
+    "model.layers.61.self_attn.k_proj.bias": "model-00028-of-00037.safetensors",
+    "model.layers.61.self_attn.k_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.61.self_attn.o_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.61.self_attn.q_proj.bias": "model-00028-of-00037.safetensors",
+    "model.layers.61.self_attn.q_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.61.self_attn.v_proj.bias": "model-00028-of-00037.safetensors",
+    "model.layers.61.self_attn.v_proj.weight": "model-00028-of-00037.safetensors",
+    "model.layers.62.input_layernorm.weight": "model-00029-of-00037.safetensors",
+    "model.layers.62.mlp.down_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.62.mlp.gate_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.62.mlp.up_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.62.post_attention_layernorm.weight": "model-00029-of-00037.safetensors",
+    "model.layers.62.self_attn.k_proj.bias": "model-00029-of-00037.safetensors",
+    "model.layers.62.self_attn.k_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.62.self_attn.o_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.62.self_attn.q_proj.bias": "model-00029-of-00037.safetensors",
+    "model.layers.62.self_attn.q_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.62.self_attn.v_proj.bias": "model-00029-of-00037.safetensors",
+    "model.layers.62.self_attn.v_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.63.input_layernorm.weight": "model-00029-of-00037.safetensors",
+    "model.layers.63.mlp.down_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.63.mlp.gate_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.63.mlp.up_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.63.post_attention_layernorm.weight": "model-00029-of-00037.safetensors",
+    "model.layers.63.self_attn.k_proj.bias": "model-00029-of-00037.safetensors",
+    "model.layers.63.self_attn.k_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.63.self_attn.o_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.63.self_attn.q_proj.bias": "model-00029-of-00037.safetensors",
+    "model.layers.63.self_attn.q_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.63.self_attn.v_proj.bias": "model-00029-of-00037.safetensors",
+    "model.layers.63.self_attn.v_proj.weight": "model-00029-of-00037.safetensors",
+    "model.layers.64.input_layernorm.weight": "model-00030-of-00037.safetensors",
+    "model.layers.64.mlp.down_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.64.mlp.gate_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.64.mlp.up_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.64.post_attention_layernorm.weight": "model-00030-of-00037.safetensors",
+    "model.layers.64.self_attn.k_proj.bias": "model-00030-of-00037.safetensors",
+    "model.layers.64.self_attn.k_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.64.self_attn.o_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.64.self_attn.q_proj.bias": "model-00030-of-00037.safetensors",
+    "model.layers.64.self_attn.q_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.64.self_attn.v_proj.bias": "model-00030-of-00037.safetensors",
+    "model.layers.64.self_attn.v_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.65.input_layernorm.weight": "model-00030-of-00037.safetensors",
+    "model.layers.65.mlp.down_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.65.mlp.gate_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.65.mlp.up_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.65.post_attention_layernorm.weight": "model-00030-of-00037.safetensors",
+    "model.layers.65.self_attn.k_proj.bias": "model-00030-of-00037.safetensors",
+    "model.layers.65.self_attn.k_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.65.self_attn.o_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.65.self_attn.q_proj.bias": "model-00030-of-00037.safetensors",
+    "model.layers.65.self_attn.q_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.65.self_attn.v_proj.bias": "model-00030-of-00037.safetensors",
+    "model.layers.65.self_attn.v_proj.weight": "model-00030-of-00037.safetensors",
+    "model.layers.66.input_layernorm.weight": "model-00030-of-00037.safetensors",
+    "model.layers.66.mlp.down_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.66.mlp.gate_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.66.mlp.up_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.66.post_attention_layernorm.weight": "model-00031-of-00037.safetensors",
+    "model.layers.66.self_attn.k_proj.bias": "model-00031-of-00037.safetensors",
+    "model.layers.66.self_attn.k_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.66.self_attn.o_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.66.self_attn.q_proj.bias": "model-00031-of-00037.safetensors",
+    "model.layers.66.self_attn.q_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.66.self_attn.v_proj.bias": "model-00031-of-00037.safetensors",
+    "model.layers.66.self_attn.v_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.67.input_layernorm.weight": "model-00031-of-00037.safetensors",
+    "model.layers.67.mlp.down_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.67.mlp.gate_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.67.mlp.up_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.67.post_attention_layernorm.weight": "model-00031-of-00037.safetensors",
+    "model.layers.67.self_attn.k_proj.bias": "model-00031-of-00037.safetensors",
+    "model.layers.67.self_attn.k_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.67.self_attn.o_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.67.self_attn.q_proj.bias": "model-00031-of-00037.safetensors",
+    "model.layers.67.self_attn.q_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.67.self_attn.v_proj.bias": "model-00031-of-00037.safetensors",
+    "model.layers.67.self_attn.v_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.68.input_layernorm.weight": "model-00031-of-00037.safetensors",
+    "model.layers.68.mlp.down_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.68.mlp.gate_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.68.mlp.up_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.68.post_attention_layernorm.weight": "model-00031-of-00037.safetensors",
+    "model.layers.68.self_attn.k_proj.bias": "model-00031-of-00037.safetensors",
+    "model.layers.68.self_attn.k_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.68.self_attn.o_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.68.self_attn.q_proj.bias": "model-00031-of-00037.safetensors",
+    "model.layers.68.self_attn.q_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.68.self_attn.v_proj.bias": "model-00031-of-00037.safetensors",
+    "model.layers.68.self_attn.v_proj.weight": "model-00031-of-00037.safetensors",
+    "model.layers.69.input_layernorm.weight": "model-00032-of-00037.safetensors",
+    "model.layers.69.mlp.down_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.69.mlp.gate_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.69.mlp.up_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.69.post_attention_layernorm.weight": "model-00032-of-00037.safetensors",
+    "model.layers.69.self_attn.k_proj.bias": "model-00032-of-00037.safetensors",
+    "model.layers.69.self_attn.k_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.69.self_attn.o_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.69.self_attn.q_proj.bias": "model-00032-of-00037.safetensors",
+    "model.layers.69.self_attn.q_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.69.self_attn.v_proj.bias": "model-00032-of-00037.safetensors",
+    "model.layers.69.self_attn.v_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.7.input_layernorm.weight": "model-00004-of-00037.safetensors",
+    "model.layers.7.mlp.down_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.7.mlp.gate_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.7.mlp.up_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.7.post_attention_layernorm.weight": "model-00004-of-00037.safetensors",
+    "model.layers.7.self_attn.k_proj.bias": "model-00004-of-00037.safetensors",
+    "model.layers.7.self_attn.k_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.7.self_attn.o_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.7.self_attn.q_proj.bias": "model-00004-of-00037.safetensors",
+    "model.layers.7.self_attn.q_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.7.self_attn.v_proj.bias": "model-00004-of-00037.safetensors",
+    "model.layers.7.self_attn.v_proj.weight": "model-00004-of-00037.safetensors",
+    "model.layers.70.input_layernorm.weight": "model-00032-of-00037.safetensors",
+    "model.layers.70.mlp.down_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.70.mlp.gate_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.70.mlp.up_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.70.post_attention_layernorm.weight": "model-00032-of-00037.safetensors",
+    "model.layers.70.self_attn.k_proj.bias": "model-00032-of-00037.safetensors",
+    "model.layers.70.self_attn.k_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.70.self_attn.o_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.70.self_attn.q_proj.bias": "model-00032-of-00037.safetensors",
+    "model.layers.70.self_attn.q_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.70.self_attn.v_proj.bias": "model-00032-of-00037.safetensors",
+    "model.layers.70.self_attn.v_proj.weight": "model-00032-of-00037.safetensors",
+    "model.layers.71.input_layernorm.weight": "model-00033-of-00037.safetensors",
+    "model.layers.71.mlp.down_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.71.mlp.gate_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.71.mlp.up_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.71.post_attention_layernorm.weight": "model-00033-of-00037.safetensors",
+    "model.layers.71.self_attn.k_proj.bias": "model-00033-of-00037.safetensors",
+    "model.layers.71.self_attn.k_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.71.self_attn.o_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.71.self_attn.q_proj.bias": "model-00033-of-00037.safetensors",
+    "model.layers.71.self_attn.q_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.71.self_attn.v_proj.bias": "model-00033-of-00037.safetensors",
+    "model.layers.71.self_attn.v_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.72.input_layernorm.weight": "model-00033-of-00037.safetensors",
+    "model.layers.72.mlp.down_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.72.mlp.gate_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.72.mlp.up_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.72.post_attention_layernorm.weight": "model-00033-of-00037.safetensors",
+    "model.layers.72.self_attn.k_proj.bias": "model-00033-of-00037.safetensors",
+    "model.layers.72.self_attn.k_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.72.self_attn.o_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.72.self_attn.q_proj.bias": "model-00033-of-00037.safetensors",
+    "model.layers.72.self_attn.q_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.72.self_attn.v_proj.bias": "model-00033-of-00037.safetensors",
+    "model.layers.72.self_attn.v_proj.weight": "model-00033-of-00037.safetensors",
+    "model.layers.73.input_layernorm.weight": "model-00034-of-00037.safetensors",
+    "model.layers.73.mlp.down_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.73.mlp.gate_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.73.mlp.up_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.73.post_attention_layernorm.weight": "model-00034-of-00037.safetensors",
+    "model.layers.73.self_attn.k_proj.bias": "model-00034-of-00037.safetensors",
+    "model.layers.73.self_attn.k_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.73.self_attn.o_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.73.self_attn.q_proj.bias": "model-00034-of-00037.safetensors",
+    "model.layers.73.self_attn.q_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.73.self_attn.v_proj.bias": "model-00034-of-00037.safetensors",
+    "model.layers.73.self_attn.v_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.74.input_layernorm.weight": "model-00034-of-00037.safetensors",
+    "model.layers.74.mlp.down_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.74.mlp.gate_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.74.mlp.up_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.74.post_attention_layernorm.weight": "model-00034-of-00037.safetensors",
+    "model.layers.74.self_attn.k_proj.bias": "model-00034-of-00037.safetensors",
+    "model.layers.74.self_attn.k_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.74.self_attn.o_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.74.self_attn.q_proj.bias": "model-00034-of-00037.safetensors",
+    "model.layers.74.self_attn.q_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.74.self_attn.v_proj.bias": "model-00034-of-00037.safetensors",
+    "model.layers.74.self_attn.v_proj.weight": "model-00034-of-00037.safetensors",
+    "model.layers.75.input_layernorm.weight": "model-00034-of-00037.safetensors",
+    "model.layers.75.mlp.down_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.75.mlp.gate_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.75.mlp.up_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.75.post_attention_layernorm.weight": "model-00035-of-00037.safetensors",
+    "model.layers.75.self_attn.k_proj.bias": "model-00035-of-00037.safetensors",
+    "model.layers.75.self_attn.k_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.75.self_attn.o_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.75.self_attn.q_proj.bias": "model-00035-of-00037.safetensors",
+    "model.layers.75.self_attn.q_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.75.self_attn.v_proj.bias": "model-00035-of-00037.safetensors",
+    "model.layers.75.self_attn.v_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.76.input_layernorm.weight": "model-00035-of-00037.safetensors",
+    "model.layers.76.mlp.down_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.76.mlp.gate_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.76.mlp.up_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.76.post_attention_layernorm.weight": "model-00035-of-00037.safetensors",
+    "model.layers.76.self_attn.k_proj.bias": "model-00035-of-00037.safetensors",
+    "model.layers.76.self_attn.k_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.76.self_attn.o_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.76.self_attn.q_proj.bias": "model-00035-of-00037.safetensors",
+    "model.layers.76.self_attn.q_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.76.self_attn.v_proj.bias": "model-00035-of-00037.safetensors",
+    "model.layers.76.self_attn.v_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.77.input_layernorm.weight": "model-00035-of-00037.safetensors",
+    "model.layers.77.mlp.down_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.77.mlp.gate_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.77.mlp.up_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.77.post_attention_layernorm.weight": "model-00035-of-00037.safetensors",
+    "model.layers.77.self_attn.k_proj.bias": "model-00035-of-00037.safetensors",
+    "model.layers.77.self_attn.k_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.77.self_attn.o_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.77.self_attn.q_proj.bias": "model-00035-of-00037.safetensors",
+    "model.layers.77.self_attn.q_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.77.self_attn.v_proj.bias": "model-00035-of-00037.safetensors",
+    "model.layers.77.self_attn.v_proj.weight": "model-00035-of-00037.safetensors",
+    "model.layers.78.input_layernorm.weight": "model-00036-of-00037.safetensors",
+    "model.layers.78.mlp.down_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.78.mlp.gate_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.78.mlp.up_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.78.post_attention_layernorm.weight": "model-00036-of-00037.safetensors",
+    "model.layers.78.self_attn.k_proj.bias": "model-00036-of-00037.safetensors",
+    "model.layers.78.self_attn.k_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.78.self_attn.o_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.78.self_attn.q_proj.bias": "model-00036-of-00037.safetensors",
+    "model.layers.78.self_attn.q_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.78.self_attn.v_proj.bias": "model-00036-of-00037.safetensors",
+    "model.layers.78.self_attn.v_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.79.input_layernorm.weight": "model-00036-of-00037.safetensors",
+    "model.layers.79.mlp.down_proj.weight": "model-00037-of-00037.safetensors",
+    "model.layers.79.mlp.gate_proj.weight": "model-00037-of-00037.safetensors",
+    "model.layers.79.mlp.up_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.79.post_attention_layernorm.weight": "model-00036-of-00037.safetensors",
+    "model.layers.79.self_attn.k_proj.bias": "model-00036-of-00037.safetensors",
+    "model.layers.79.self_attn.k_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.79.self_attn.o_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.79.self_attn.q_proj.bias": "model-00036-of-00037.safetensors",
+    "model.layers.79.self_attn.q_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.79.self_attn.v_proj.bias": "model-00036-of-00037.safetensors",
+    "model.layers.79.self_attn.v_proj.weight": "model-00036-of-00037.safetensors",
+    "model.layers.8.input_layernorm.weight": "model-00005-of-00037.safetensors",
+    "model.layers.8.mlp.down_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.8.mlp.gate_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.8.mlp.up_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.8.post_attention_layernorm.weight": "model-00005-of-00037.safetensors",
+    "model.layers.8.self_attn.k_proj.bias": "model-00005-of-00037.safetensors",
+    "model.layers.8.self_attn.k_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.8.self_attn.o_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.8.self_attn.q_proj.bias": "model-00005-of-00037.safetensors",
+    "model.layers.8.self_attn.q_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.8.self_attn.v_proj.bias": "model-00005-of-00037.safetensors",
+    "model.layers.8.self_attn.v_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.9.input_layernorm.weight": "model-00005-of-00037.safetensors",
+    "model.layers.9.mlp.down_proj.weight": "model-00006-of-00037.safetensors",
+    "model.layers.9.mlp.gate_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.9.mlp.up_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.9.post_attention_layernorm.weight": "model-00005-of-00037.safetensors",
+    "model.layers.9.self_attn.k_proj.bias": "model-00005-of-00037.safetensors",
+    "model.layers.9.self_attn.k_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.9.self_attn.o_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.9.self_attn.q_proj.bias": "model-00005-of-00037.safetensors",
+    "model.layers.9.self_attn.q_proj.weight": "model-00005-of-00037.safetensors",
+    "model.layers.9.self_attn.v_proj.bias": "model-00005-of-00037.safetensors",
+    "model.layers.9.self_attn.v_proj.weight": "model-00005-of-00037.safetensors",
+    "model.norm.weight": "model-00037-of-00037.safetensors"
+  }
+}

tokenizer_config.json

@@ -0,0 +1,40 @@
+{
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": ["<|im_start|>", "<|im_end|>"],
+  "bos_token": null,
+  "chat_template": "{% for message in messages %}{% if loop.first and messages[0]['role'] != 'system' %}{{ '<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n' }}{% endif %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "model_max_length": 32768,
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}