nm-testing
/

tinyllama-fp8-dynamic-compressed-hf-quantizer

compressed-tensors

Model card Files Files and versions Community

tinyllama-fp8-dynamic-compressed-hf-quantizer / recipe.yaml

sadkins65's picture

Upload folder using huggingface_hub

5da78e7 verified 3 months ago

132 Bytes

	quant_stage:
	quant_modifiers:
	QuantizationModifier:
	ignore: [lm_head]
	scheme: FP8_DYNAMIC
	targets: [Linear]