Dracones commited on
Commit
fb87955
1 Parent(s): ac16ad4

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +19 -1
README.md CHANGED
@@ -18,6 +18,19 @@ Details about the model and the merge info can be found at the above mode page.
18
 
19
  I have not extensively tested this quant/model other than ensuring I could load it and chat with it.
20
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
  ## Quant Details
22
 
23
  This is the script used for quantization.
@@ -33,12 +46,14 @@ conda activate exllamav2
33
  MODEL_DIR="models/Midnight-Miqu-70B-v1.5"
34
  OUTPUT_DIR="exl2_midnightv15-70b"
35
  MEASUREMENT_FILE="measurements/midnight70b-v15.json"
 
36
 
37
  BIT_PRECISIONS=(6.0 5.0 4.5 4.0 3.5 3.0 2.75 2.5 2.25)
38
 
39
  for BIT_PRECISION in "${BIT_PRECISIONS[@]}"
40
  do
41
  CONVERTED_FOLDER="models/Midnight-Miqu-70B-v1.5_exl2_${BIT_PRECISION}bpw"
 
42
 
43
  if [ -d "$CONVERTED_FOLDER" ]; then
44
  echo "Skipping $BIT_PRECISION as $CONVERTED_FOLDER already exists."
@@ -51,4 +66,7 @@ do
51
 
52
  python convert.py -i "$MODEL_DIR" -o "$OUTPUT_DIR" -nr -m "$MEASUREMENT_FILE" -b "$BIT_PRECISION" -cf "$CONVERTED_FOLDER"
53
 
54
- done```
 
 
 
 
18
 
19
  I have not extensively tested this quant/model other than ensuring I could load it and chat with it.
20
 
21
+ ## Tavern Card
22
+
23
+ Included is a Tavern format character card created by Midnight Miqu v1.5 for chat. The card was created using a character creator helper bot using a single prompt for the base card, another prompt asking for specific conversation examples and then asking it to provide a text to image portrait prompt. Being able to faithfully follow the character creator bot to create this card demonstrates a pretty high level of intelligence.
24
+
25
+ ![image/png](Elrondel.card.png)
26
+
27
+ _An ageless, charismatic archmage named Elrondel stands before you, captured mid-laugh in a dimly lit study. His tall, slender frame is adorned with midnight blue robes that billow around him, intricate silver runes glinting in the candlelight. His stark white hair flows down to his shoulders, framing a sharp face with piercing sapphire eyes that seem to look right through you. A knowing smile plays upon his lips, hinting at countless secrets hidden beneath his pointed goatee._
28
+
29
+ _In one hand, he holds a smoldering pipe filled with exotic herbs, casting a mysterious haze around his form. The other hand rests upon Stormbreaker, a colossal staff that towers above most men, crackling with latent lightning energy. Various rings adorn his long, dexterous fingers, each holding its own arcane power. Around his neck hangs a dragon-eye amulet, the eye itself appearing to follow your every move with fierce scrutiny._
30
+
31
+ _The room is cluttered with tomes and scrolls, floating in midair as if held by invisible hands, creating a maelstrom of knowledge. Behind him, a crystal ball reflects swirling images of distant lands and times, while a cauldron bubbles with unknown concoctions on the hearth of an ancient fireplace. The scene exudes an air of enigma and might, leaving you both awestruck and slightly intimidated in the presence of this legendary figure from Thaylonia._
32
+
33
+
34
  ## Quant Details
35
 
36
  This is the script used for quantization.
 
46
  MODEL_DIR="models/Midnight-Miqu-70B-v1.5"
47
  OUTPUT_DIR="exl2_midnightv15-70b"
48
  MEASUREMENT_FILE="measurements/midnight70b-v15.json"
49
+ TEMPLATE_FILE="models/Midnight-Miqu-70B-v1.5/README-TEMPLATE.md"
50
 
51
  BIT_PRECISIONS=(6.0 5.0 4.5 4.0 3.5 3.0 2.75 2.5 2.25)
52
 
53
  for BIT_PRECISION in "${BIT_PRECISIONS[@]}"
54
  do
55
  CONVERTED_FOLDER="models/Midnight-Miqu-70B-v1.5_exl2_${BIT_PRECISION}bpw"
56
+ UPLOAD_FOLDER="Dracones/Midnight-Miqu-70B-v1.5_exl2_${BIT_PRECISION}bpw"
57
 
58
  if [ -d "$CONVERTED_FOLDER" ]; then
59
  echo "Skipping $BIT_PRECISION as $CONVERTED_FOLDER already exists."
 
66
 
67
  python convert.py -i "$MODEL_DIR" -o "$OUTPUT_DIR" -nr -m "$MEASUREMENT_FILE" -b "$BIT_PRECISION" -cf "$CONVERTED_FOLDER"
68
 
69
+ cp "$TEMPLATE_FILE" "$CONVERTED_FOLDER/README.md"
70
+ sed -i "s/X.XX/$BIT_PRECISION/g" "$CONVERTED_FOLDER/README.md"
71
+ done
72
+ ```