llmixer
/

BigAurelian-v0.5-120b-32k-3.0bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

BigAurelian-v0.5-120b-32k-3.0bpw-h8-exl2 / README.md

llmixer's picture

Model upload

83f6b21 verified 11 months ago

|

history blame contribute delete

212 Bytes

metadata

license: llama2
language:
  - en
pipeline_tag: conversational
tags:
  - 3.0bpw
  - h8
  - exl2

Exllamav2 3.0bpw h8 quant for BigAurelian-v0.5-120b-32k.