tiiuae-falcon-7b-instruct-w4-g64-awq / quantize_config.json
abhinavkulkarni's picture
Upload config
c656e43
raw
history blame
57 Bytes
{
"bits": 4,
"group_size": 64,
"zero_point": true
}