thwin27
/

Aria-sequential_mlp-FP8-dynamic

Image-Text-to-Text

text-generation

compressed-tensors

Model card Files Files and versions Community

thwin27 commited on Oct 20

Commit

2cf9ce2

•

1 Parent(s): 60fe460

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ FP8-Dynamic quant from rhymes-ai Aria made with llm-compressor.
 Generated with the following code:
-```
 from transformers import AutoProcessor, AutoModelForCausalLM
 from llmcompressor.modifiers.quantization import QuantizationModifier
 from llmcompressor.transformers import SparseAutoModelForCausalLM, oneshot

 Generated with the following code:
+```python
 from transformers import AutoProcessor, AutoModelForCausalLM
 from llmcompressor.modifiers.quantization import QuantizationModifier
 from llmcompressor.transformers import SparseAutoModelForCausalLM, oneshot