--- license: other license_name: nvidia-open-model-license license_link: >- https://developer.download.nvidia.com/licenses/nvidia-open-model-license-agreement-june-2024.pdf tags: - fp8 - vllm base_model: nvidia/Minitron-4B-Base --- # Minitron-4B-Base-FP8 FP8 quantized checkpoint of [nvidia/Minitron-4B-Base](https://huggingface.co/nvidia/Minitron-4B-Base) for use with vLLM.