DenisTheDev
/

Openchat-Passthrough

Text Generation

openchat/openchat-3.5-1210

openchat/openchat-3.5-0106

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Openchat-Passthrough / mergekit_config.yml

DenisTheDev's picture

Upload folder using huggingface_hub

2a736c1 verified 10 months ago

213 Bytes


	slices:
	- sources:
	- model: openchat/openchat-3.5-1210
	layer_range: [0, 32]
	- sources:
	- model: openchat/openchat-3.5-0106
	layer_range: [16, 32]
	merge_method: passthrough
	dtype: bfloat16