YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Currently a WIP, I have several quants that will be KLD tested and uploaded here over the next few days. The reference logits for the KLD testing have been provided for reproducing results or performing comparative analysis with other quants.
- Downloads last month
- 1,558
Hardware compatibility
Log In
to view the estimation
3-bit
8-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support