Rombos-LLM-V2.6-Nemotron-70b / mergekit_config.yml
rombodawg's picture
Upload mergekit_config.yml with huggingface_hub
a0de141 verified
raw
history blame
369 Bytes
models:
- model: ./mergekit/models/llama-3.1-70b-instruct
parameters:
weight: 1
density: 1
- model: ./mergekit/models/Nemotron-70B-Instruct-HF
parameters:
weight: 1
density: 1
merge_method: ties
base_model: ./mergekit/models/llama-3.1-70b-base
parameters:
weight: 1
density: 1
normalize: true
int8_mask: true
dtype: bfloat16