| library_name: transformers | |
| tags: [] | |
| # Model Card for dolphin-2.9.1-llama-3-70b-<u>awq</u> | |
| AWQ Quantized version of [cognitivecomputations/dolphin-2.9.1-llama-3-70b](/cognitivecomputations/dolphin-2.9.1-llama-3-70b). | |
| For use with vllm and other inference engines. |