metadata
license: llama2
language:
- en
base_model:
- meta-llama/Llama-2-7b-chat
pipeline_tag: text-generation
tags:
- amd
- meta
- facebook
- llama
- llama-2
- onnx
meta-llama/Llama-2-7b-chat
Introduction
This model was created by applying Quark with calibration samples from Pile dataset, and applying onnxruntime-genai model builder to convert to ONNX.Quantization Strategy
- AWQ / Group 128 / Asymmetric / FP32 activations
Quick Start
For quickstart, refer to AMD RyzenAI-SW-EA
Evaluation scores
The perplexity measurement is run on the wikitext-2-raw-v1 (raw data) dataset provided by Hugging Face. Perplexity score measured for prompt length 2k is 7.153726.
License
Modifications copyright(c) 2024 Advanced Micro Devices,Inc. All rights reserved.
license: llama2