num_key_value_heads=16 instead of 8 in the original model
#21
by
Melody32768
- opened
in config.json，num_key_value_heads=16 instead of 8 in the original model 。Is it something that needs special modification when quantifying?