Upload folder using huggingface_hub

README.md

@@ -0,0 +1,85 @@
+---
+thumbnail: "https://assets-global.website-files.com/646b351987a8d8ce158d1940/64ec9e96b4334c0e1ac41504_Logo%20with%20white%20text.svg"
+base_model: tiiuae/Falcon3-Mamba-7B-Instruct
+metrics:
+- memory_disk
+- memory_inference
+- inference_latency
+- inference_throughput
+- inference_CO2_emissions
+- inference_energy_consumption
+tags:
+- pruna-ai
+---
+<!-- header start -->
+<!-- 200823 -->
+<div style="width: auto; margin-left: auto; margin-right: auto">
+    <a href="https://docs.pruna.ai/en/latest/setup/pip.html" target="_blank" rel="noopener noreferrer">
+        <img src="https://imgur.com/rVAgqMY.png" alt="PrunaAI" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+    </a>
+</div>
+<!-- header end -->
+
+[![Twitter](https://img.shields.io/twitter/follow/PrunaAI?style=social)](https://twitter.com/PrunaAI)
+[![GitHub](https://img.shields.io/github/followers/PrunaAI?label=Follow%20%40PrunaAI&style=social)](https://github.com/PrunaAI)
+[![LinkedIn](https://img.shields.io/badge/LinkedIn-Connect-blue)](https://www.linkedin.com/company/93832878/admin/feed/posts/?feedType=following)
+[![Discord](https://img.shields.io/badge/Discord-Join%20Us-blue?style=social&logo=discord)](https://discord.gg/rskEr4BZJx)
+
+# Simply make AI models cheaper, smaller, faster, and greener!
+
+- Give a thumbs up if you like this model!
+- Contact us and tell us which model to compress next [here](https://www.pruna.ai/contact).
+- Request access to easily compress your *own* AI models [here](https://z0halsaff74.typeform.com/pruna-access?typeform-source=www.pruna.ai).
+- Read the documentations to know more [here](https://pruna-ai-pruna.readthedocs-hosted.com/en/latest/)
+- Join Pruna AI community on Discord [here](https://discord.gg/CP4VSgck) to share feedback/suggestions or get help.
+
+## Results
+
+![image info](./plots.png)
+
+**Frequently Asked Questions**
+- ***How does the compression work?*** The model is compressed with llm-int8.
+- ***How does the model quality change?*** The quality of the model output might vary compared to the base model.
+- ***How is the model efficiency evaluated?*** These results were obtained with configuration described in `model/smash_config.json` and are obtained after a hardware warmup. The smashed model is directly compared to the original base model. Efficiency results may vary in other settings (e.g. other hardware, image size, batch size, ...). We recommend to directly run them in the use-case conditions to know if the smashed model can benefit you.
+- ***What is the model format?*** We use safetensors.
+- ***What calibration data has been used?*** If needed by the compression method, we used WikiText as the calibration data.
+- ***What is the naming convention for Pruna Huggingface models?*** We take the original model name and append "turbo", "tiny", or "green" if the smashed model has a measured inference speed, inference memory, or inference energy consumption which is less than 90% of the original base model.
+- ***How to compress my own models?*** You can request premium access to more compression methods and tech support for your specific use-cases [here](https://z0halsaff74.typeform.com/pruna-access?typeform-source=www.pruna.ai).
+- ***What are "first" metrics?*** Results mentioning "first" are obtained after the first run of the model. The first run might take more memory or be slower than the subsequent runs due cuda overheads.
+- ***What are "Sync" and "Async" metrics?*** "Sync" metrics are obtained by syncing all GPU processes and stop measurement when all of them are executed. "Async" metrics are obtained without syncing all GPU processes and stop when the model output can be used by the CPU. We provide both metrics since both could be relevant depending on the use-case. We recommend to test the efficiency gains directly in your use-cases.
+
+## Setup
+
+You can run the smashed model with these steps:
+
+0. Check requirements from the original repo tiiuae/Falcon3-Mamba-7B-Instruct installed. In particular, check python, cuda, and transformers versions.
+1. Make sure that you have installed quantization related packages.
+    ```bash
+    pip install transformers accelerate bitsandbytes>0.37.0
+    ```
+2. Load & run the model.
+    ```python 
+   from transformers import AutoModelForCausalLM, AutoTokenizer
+   
+
+   model = AutoModelForCausalLM.from_pretrained("PrunaAI/tiiuae-Falcon3-Mamba-7B-Instruct-bnb-8bit-smashed", trust_remote_code=True, device_map='auto')
+   tokenizer = AutoTokenizer.from_pretrained("tiiuae/Falcon3-Mamba-7B-Instruct")
+    
+   input_ids = tokenizer("What is the color of prunes?,", return_tensors='pt').to(model.device)["input_ids"]
+    
+   outputs = model.generate(input_ids, max_new_tokens=216)
+   tokenizer.decode(outputs[0])
+    ```
+
+## Configurations
+
+The configuration info are in `smash_config.json`.
+
+## Credits & License
+
+The license of the smashed model follows the license of the original model. Please check the license of the original model tiiuae/Falcon3-Mamba-7B-Instruct before using this model which provided the base model. The license  of the `pruna-engine` is [here](https://pypi.org/project/pruna-engine/) on Pypi.
+
+## Want to compress other models?
+
+- Contact us and tell us which model to compress next [here](https://www.pruna.ai/contact).
+- Do it by yourself [here](https://docs.pruna.ai/en/latest/setup/pip.html).

config.json

@@ -0,0 +1,54 @@
+{
+    "_name_or_path": "/covalent/.cache/models/tmp8bto9z7jb2q7p90e",
+    "architectures": [
+        "FalconMambaForCausalLM"
+    ],
+    "bos_token_id": 0,
+    "conv_kernel": 4,
+    "eos_token_id": 0,
+    "expand": 2,
+    "hidden_act": "silu",
+    "hidden_size": 4096,
+    "initializer_range": 0.1,
+    "intermediate_size": 8192,
+    "layer_norm_epsilon": 1e-05,
+    "mixer_rms_eps": 1e-05,
+    "model_type": "falcon_mamba",
+    "num_hidden_layers": 64,
+    "pad_token_id": 0,
+    "quantization_config": {
+        "_load_in_4bit": false,
+        "_load_in_8bit": true,
+        "bnb_4bit_compute_dtype": "bfloat16",
+        "bnb_4bit_quant_storage": "uint8",
+        "bnb_4bit_quant_type": "fp4",
+        "bnb_4bit_use_double_quant": false,
+        "llm_int8_enable_fp32_cpu_offload": false,
+        "llm_int8_has_fp16_weight": false,
+        "llm_int8_skip_modules": [
+            "lm_head"
+        ],
+        "llm_int8_threshold": 6.0,
+        "load_in_4bit": false,
+        "load_in_8bit": true,
+        "quant_method": "bitsandbytes"
+    },
+    "rescale_prenorm_residual": false,
+    "residual_in_fp32": true,
+    "state_size": 16,
+    "tie_word_embeddings": false,
+    "time_step_floor": 0.0001,
+    "time_step_init_scheme": "random",
+    "time_step_max": 0.1,
+    "time_step_min": 0.001,
+    "time_step_rank": 256,
+    "time_step_scale": 1.0,
+    "torch_dtype": "float16",
+    "transformers_version": "4.46.2",
+    "use_bias": false,
+    "use_cache": true,
+    "use_conv_bias": true,
+    "use_mambapy": false,
+    "vocab_size": 65024,
+    "api_key": null
+}

generation_config.json

@@ -0,0 +1,10 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 0,
+  "eos_token_id": [
+    10,
+    11
+  ],
+  "pad_token_id": 0,
+  "transformers_version": "4.46.2"
+}

model-00001-of-00002.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8c6bcf31695ec2fc8ba99d109afa29c6909b762c37456afdf678bc9e28f9ae6c
+size 4980466040

model-00002-of-00002.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1fe81b199f430efab97a90b4863994791cdf1eb4e7cefcc3bc02f44469c59a0a
+size 2861517192

model.safetensors.index.json

@@ -0,0 +1,1162 @@
+{
+  "metadata": {
+    "total_size": 7841857792
+  },
+  "weight_map": {
+    "backbone.embeddings.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.0.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.1.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.10.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.11.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.12.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.13.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.14.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.15.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.16.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.17.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.18.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.19.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.2.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.20.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.21.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.22.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.23.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.24.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.25.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.26.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.27.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.28.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.29.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.3.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.30.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.31.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.32.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.33.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.34.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.35.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.36.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.37.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.38.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.39.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.4.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.40.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.41.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.42.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.42.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.42.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.42.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.42.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.42.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.43.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.43.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.44.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.45.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.46.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.47.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.48.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.49.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.5.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.5.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.50.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.50.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.51.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.52.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.53.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.54.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.55.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.56.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.57.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.58.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.59.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.6.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.6.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.60.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.60.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.61.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.62.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.A_log": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.D": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.conv1d.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.conv1d.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.dt_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.dt_proj.bias": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.dt_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.dt_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.in_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.in_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.in_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.out_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.out_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.out_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.x_proj.SCB": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.x_proj.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.mixer.x_proj.weight_format": "model-00002-of-00002.safetensors",
+    "backbone.layers.63.norm.weight": "model-00002-of-00002.safetensors",
+    "backbone.layers.7.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.7.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.8.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.A_log": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.D": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.conv1d.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.conv1d.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.dt_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.dt_proj.bias": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.dt_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.dt_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.in_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.in_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.in_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.out_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.out_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.out_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.x_proj.SCB": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.x_proj.weight": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.mixer.x_proj.weight_format": "model-00001-of-00002.safetensors",
+    "backbone.layers.9.norm.weight": "model-00001-of-00002.safetensors",
+    "backbone.norm_f.weight": "model-00002-of-00002.safetensors",
+    "lm_head.weight": "model-00002-of-00002.safetensors"
+  }
+}

smash_config.json

@@ -0,0 +1,35 @@
+{
+    "comp_cgenerate_active": false,
+    "comp_ctranslate_active": false,
+    "comp_cwhisper_active": false,
+    "comp_diffusers2_active": false,
+    "comp_ifw_active": false,
+    "comp_onediff_active": false,
+    "comp_step_caching_active": false,
+    "comp_torch_compile_active": false,
+    "comp_ws2t_active": false,
+    "comp_x-fast_active": false,
+    "prune_torch-structured_active": false,
+    "quant_aqlm_active": false,
+    "quant_awq_active": false,
+    "quant_gptq_active": false,
+    "quant_half_active": false,
+    "quant_hqq_active": false,
+    "quant_llm-int8_active": true,
+    "quant_quanto_active": false,
+    "quant_torch_dynamic_active": false,
+    "quant_torch_static_active": false,
+    "quant_llm-int8_compute_dtype": "bfloat16",
+    "quant_llm-int8_double_quant": false,
+    "quant_llm-int8_enable_fp32_cpu_offload": false,
+    "quant_llm-int8_has_fp16_weight": false,
+    "quant_llm-int8_quant_type": "fp4",
+    "quant_llm-int8_threshold": 6.0,
+    "quant_llm-int8_weight_bits": 8,
+    "max_batch_size": 1,
+    "device": "cuda",
+    "cache_dir": "/covalent/.cache/models/tmp8bto9z7j",
+    "task": "",
+    "save_load_fn": "bitsandbytes",
+    "save_load_fn_args": {}
+}