File size: 412 Bytes
8f626f1
 
e96ccb4
 
 
 
 
 
8f626f1
 
135c33b
8f626f1
30e8d36
 
320571b
 
e96ccb4
8f626f1
e96ccb4
8f626f1
e96ccb4
8f626f1
e96ccb4
343cd93
448e521
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
---
library_name: transformers
tags:
- vlm
- vision
license: apache-2.0
base_model:
- allenai/Molmo-7B-O-0924
---

# Molmo-7B-O BnB 4bit quant

30GB -> 7GB

approx. 12GB VRAM required

base model for more information:

https://huggingface.co/allenai/Molmo-7B-O-0924

example code:

https://github.com/cyan2k/molmo-7b-bnb-4bit

performance metrics & benchmarks to compare with base will follow over the next week