Hugging Face's logo

athirdpath
/
Iambe-RP-v3-20b-EXL2-3bpw

Text Generation
Transformers
Safetensors
English
llama
Not-For-All-Audiences
text-generation-inference
Inference Endpoints
Model card Files Community
3
athirdpath commited on
Commit
3432c84
•
1 Parent(s): b8ac56f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -8,7 +8,8 @@ datasets:
8
  - athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1
9
  ---
10
 
11
- <p align="center"><font size="5"> <b>Needs ~13.5 GB of VRAM, missed the target a bit (w/o 8-bit cache)</b> </font></p>
 
12
  <p align="center"><img src="https://i.ibb.co/PCY2Xym/Iambe-RP-sml-t.png"/><font size="6"> <b>Iambe-RP-v3-20b</b> </font></p>
13
  <p align="center"><font size="4"> <b>Trained with Alpaca prompt formatting, ChatML works well too</b> </font></p>
14
 
 
8
  - athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1
9
  ---
10
 
11
+ <p align="center"><font size="5"> <b>Needs ~11.5 GB of VRAM (with 8-bit cache)</b> </font></p>
12
+ <p align="center"><font size="5"> <b>Needs ~13.5 GB of VRAM (w/o 8-bit cache)</b> </font></p>
13
  <p align="center"><img src="https://i.ibb.co/PCY2Xym/Iambe-RP-sml-t.png"/><font size="6"> <b>Iambe-RP-v3-20b</b> </font></p>
14
  <p align="center"><font size="4"> <b>Trained with Alpaca prompt formatting, ChatML works well too</b> </font></p>
15