sometimesanotion
/

Qwen2.5-14B-Vimarckoso-v3

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

sometimesanotion commited on 26 days ago

Commit

97ad2f1

·

verified ·

1 Parent(s): 83e6173

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -138,6 +138,7 @@ parameters:
   int8_mask:         true
   normalize:         true
   rescale:           false
 models:
   - model:           EVA-UNIT-01/EVA-Qwen2.5-14B-v0.2-qv512
   - model:           arcee-ai/Virtuoso-Small-qv128

   int8_mask:         true
   normalize:         true
   rescale:           false
+# With this many models, it's good to pre-merge some LoRAs from Abliterate-Qwenvergence, with their ranks indicated in the suffixes.
 models:
   - model:           EVA-UNIT-01/EVA-Qwen2.5-14B-v0.2-qv512
   - model:           arcee-ai/Virtuoso-Small-qv128