unsloth
/

Meta-Llama-3.1-405B-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

Why did num_key_value_heads change from 16 to 8?

#1 opened 3 months ago by