thwin27
/

Aria-sequential_mlp-FP8-dynamic

Image-Text-to-Text

text-generation

compressed-tensors

Model card Files Files and versions Community

thwin27 commited on Oct 22

Commit

ff24ae3

•

1 Parent(s): 23cc088

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -6,6 +6,7 @@ base_model:
 pipeline_tag: image-text-to-text
 ---
 # Aria-sequential_mlp-FP8-dynamic
 FP8-Dynamic quantization from [Aria-sequential_mlp](https://huggingface.co/rhymes-ai/Aria-sequential_mlp) made with [LLM Compressor](https://github.com/vllm-project/llm-compressor).

 pipeline_tag: image-text-to-text
 ---
 # Aria-sequential_mlp-FP8-dynamic
+Warning: There is no inference code for transformers/vLLM yet!
 FP8-Dynamic quantization from [Aria-sequential_mlp](https://huggingface.co/rhymes-ai/Aria-sequential_mlp) made with [LLM Compressor](https://github.com/vllm-project/llm-compressor).