EXL2 quants of dbrx-instruct.
Tokenizer from here
2.20 bits per weight2.30 bits per weight2.75 bits per weight3.00 bits per weight3.40 bits per weight3.75 bits per weight
measurement.json
-