evaldas-leliuga's picture
Added model
bdb2a27 verified
metadata
base_model: meta-llama/Llama-2-7b-hf
license: apache-2.0
inference: false
model_creator: Meta
model_name: Llama-2-7b-hf
quantized_by: Leliuga
pipeline_tag: text-generation
tags:
  - llama-2
  - arxiv:2307.09288
  - arxiv:1910.09700

Llama-2-7b-hf - bnb 4bit

Description

This model is 4bit quantized version of Llama-2-7b-hf using bitsandbytes. It's designed for fine-tuning! The PAD token is set as UNK.