Hugging Face's logo

meetrais
/
finetuned_mistral_7b

PEFT
Safetensors
Model card Files Community
meetrais commited on
Commit
fc33041
•
1 Parent(s): f8d2eeb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -55,6 +55,7 @@ bnb_4bit_use_double_quant=True,
55
  bnb_4bit_quant_type="nf4",
56
  bnb_4bit_compute_dtype=torch.bfloat16
57
  )
 
58
  model = AutoModelForCausalLM.from_pretrained(peft_model_id, quantization_config=bnb_config, device_map='auto')
59
 
60
  tokenizer = AutoTokenizer.from_pretrained(config.base_model_name_or_path)
 
55
  bnb_4bit_quant_type="nf4",
56
  bnb_4bit_compute_dtype=torch.bfloat16
57
  )
58
+
59
  model = AutoModelForCausalLM.from_pretrained(peft_model_id, quantization_config=bnb_config, device_map='auto')
60
 
61
  tokenizer = AutoTokenizer.from_pretrained(config.base_model_name_or_path)