mosaicml-mpt-7b-chat-w4-g128-awq / quantize_config.json
abhinavkulkarni's picture
Upload config
dac284e
raw
history blame
58 Bytes
{
"bits": 4,
"group_size": 128,
"zero_point": true
}