only ct2 int8 convert
ct2-transformers-converter --model facebook/nllb-200-distilled-600M --quantization int8 --trust_remote_code --output_dir nllb-200-distilled-600M-ct2-int8
Original author: Facebook
Original author model URL: facebook/nllb-200-distilled-600M
- Downloads last month
- 148
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model’s pipeline type.