Qwen2.5-Coder-12.3b-Instruct / mergekit_config.yml

Upload folder using huggingface_hub

13068c2 verified 14 days ago

519 Bytes

	dtype: bfloat16
	merge_method: passthrough
	slices:
	- sources:
	- layer_range: [0, 8]
	model: Qwen/Qwen2.5-Coder-7B-Instruct
	- sources:
	- layer_range: [4, 12]
	model: Qwen/Qwen2.5-Coder-7B-Instruct
	- sources:
	- layer_range: [8, 16]
	model: Qwen/Qwen2.5-Coder-7B-Instruct
	- sources:
	- layer_range: [12, 20]
	model: Qwen/Qwen2.5-Coder-7B-Instruct
	- sources:
	- layer_range: [16, 24]
	model: Qwen/Qwen2.5-Coder-7B-Instruct
	- sources:
	- layer_range: [20, 28]
	model: Qwen/Qwen2.5-Coder-7B-Instruct