jeiku
/

MoEv2

Model card Files Files and versions Community

MoEv2 / mergekit_moe_config.yml

jeiku's picture

Upload folder using huggingface_hub

5a7965c verified 26 days ago

172 Bytes

	base_model: FourOhFour/Zenith_4B
	gate_mode: random
	dtype: bfloat16
	experts_per_token: 1
	experts:
	- source_model: FourOhFour/Luxe_4B
	- source_model: FourOhFour/Zenith_4B