Kooten commited on
Commit
b31d3f9
1 Parent(s): cf4ac52

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -7,7 +7,7 @@ license: cc-by-nc-4.0
7
  ## Description
8
  QUIP quant of [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3)
9
 
10
- I wanted to try quanting in QUIP, it took about 20 hours but it works, its coherent and with all applications running as usual my vram usage is just above 6gigs, so it's tiny.
11
 
12
  ## Other quants:
13
  EXL2: [8bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-4bpw-exl2)
 
7
  ## Description
8
  QUIP quant of [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3)
9
 
10
+ I wanted to try quanting in QUIP, it took about 20 hours but it works, its coherent and really tiny
11
 
12
  ## Other quants:
13
  EXL2: [8bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-4bpw-exl2)