mergekit-community
/

Hermes-2-Pro-Llama-3-13B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Hermes-2-Pro-Llama-3-13B / mergekit_config.yml

MergeKitBot's picture

Upload folder using huggingface_hub

1931cc6 verified 4 months ago

history blame contribute delete

No virus

584 Bytes

	slices:
	- sources:
	- model: "NousResearch/Hermes-2-Pro-Llama-3-8B"
	layer_range: [0, 10]
	- sources:
	- model: "NousResearch/Hermes-2-Pro-Llama-3-8B"
	layer_range: [7, 17]
	- sources:
	- model: "NousResearch/Hermes-2-Pro-Llama-3-8B"
	layer_range: [13, 23]
	- sources:
	- model: "NousResearch/Hermes-2-Pro-Llama-3-8B"
	layer_range: [18, 28]
	- sources:
	- model: "NousResearch/Hermes-2-Pro-Llama-3-8B"
	layer_range: [22, 32]

	merge_method: passthrough
	base_model: "NousResearch/Hermes-2-Pro-Llama-3-8B"
	dtype: bfloat16