ShubhaLabs commited on
Commit
610b178
1 Parent(s): b0f70de

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Quantized Qwen Model
2
+
3
+ This repository contains a quantized version of the Qwen model for causal language modeling.
4
+
5
+ ## Model Details
6
+ - **Model Type**: Qwen2ForCausalLM
7
+ - **Quantization**: Dynamic Quantization
8
+
9
+ ## Usage
10
+ You can load this model using the Hugging Face Transformers library:
11
+
12
+ ```python
13
+ from transformers import AutoModelForCausalLM, AutoTokenizer
14
+
15
+ model = AutoModelForCausalLM.from_pretrained("ShubhaLabs/quantized_qwen_model")
16
+ tokenizer = AutoTokenizer.from_pretrained("ShubhaLabs/quantized_qwen_model")