Mistral-4B / README.md
fhai50032's picture
Upload folder using huggingface_hub
e28221c verified
|
raw
history blame
935 Bytes
metadata
tags:
  - merge
  - mergekit
  - mistral
  - fhai50032/RolePlayLake-7B
  - fhai50032/RolePlayLake-7B
  - fhai50032/RolePlayLake-7B
  - fhai50032/RolePlayLake-7B
  - fhai50032/RolePlayLake-7B
  - fhai50032/RolePlayLake-7B
base_model:
  - fhai50032/RolePlayLake-7B
  - fhai50032/RolePlayLake-7B
  - fhai50032/RolePlayLake-7B
  - fhai50032/RolePlayLake-7B
  - fhai50032/RolePlayLake-7B
  - fhai50032/RolePlayLake-7B

Mistral-4B

🧩 Configuration

dtype: bfloat16
merge_method: passthrough
slices:
- sources:
  - layer_range: [0, 8]
    model: fhai50032/RolePlayLake-7B
- sources:
  - layer_range: [11, 12]
    model: fhai50032/RolePlayLake-7B
- sources:
  - layer_range: [15, 16]
    model: fhai50032/RolePlayLake-7B
- sources:
  - layer_range: [19, 20]
    model: fhai50032/RolePlayLake-7B
- sources:
  - layer_range: [24, 25]
    model: fhai50032/RolePlayLake-7B
- sources:
  - layer_range: [28, 32]
    model: fhai50032/RolePlayLake-7B