Hannah-PASSTHROUGH / README.md

DenisTheDev

Upload folder using huggingface_hub

a17f4d5 verified 10 months ago

preview code

raw

history blame contribute delete

693 Bytes

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - openchat/openchat-3.5-1210
  - HuggingFaceH4/zephyr-7b-beta

Hannah-PASSTHROUGH

Hannah-PASSTHROUGH is a merge of the following models using mergekit:

openchat/openchat-3.5-1210
HuggingFaceH4/zephyr-7b-beta

🧩 Configuration

  slices:
    - sources:
      - model: openchat/openchat-3.5-1210
        layer_range: [0, 32]
    - sources:
      - model: HuggingFaceH4/zephyr-7b-beta
        layer_range: [24, 32]
  merge_method: passthrough
  dtype: bfloat16