ehristoforu
/

llama3-12b-instruct-test

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

llama3-12b-instruct-test / mergekit_config.yml

ehristoforu's picture

Upload folder using huggingface_hub

f1f156c verified 6 months ago

history blame contribute delete

232 Bytes

	slices:
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [0, 24]
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [8, 32]
	merge_method: passthrough
	dtype: bfloat16