ReluLLaMA-70B-PowerInfer-GGUF

This model is the downstream distribution of SparseLLM/ReluLLaMA-70B in PowerInfer GGUF format consisting of the LLM model weights and predictor weights.

Downloads last month
20
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.