kromcomp
/

L3.1-Start-10B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

L3.1-Start-10B / mergekit_config.yml

kromeurus's picture

Upload folder using huggingface_hub

d73a532 verified 16 days ago

164 Bytes

	dtype: bfloat16
	merge_method: passthrough
	parameters:
	int8_mask: 1.0
	slices:
	- sources:
	- layer_range: [0, 42]
	model: merge/chubby10b+loras/Baldur-r128-LoRA