Update README.md

README.md

@@ -27,14 +27,74 @@ This repository contains a GGML-formatted version of the [ruGPT-3.5-13B model](h
 
 #### Usage
 
-##### 4-bit Quantized Version
+##### For QuantizationType.Q4_0 and ContainerType.GGJT
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q4_0-ggjt.bin")
+print(model.generate("The meaning of life is ").text)
+```
 
+##### For QuantizationType.Q4_0 and ContainerType.GGML
 ```python
-# 4-bit Quantized Version
 from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q4_0.bin")
+print(model.generate("The meaning of life is ").text)
+```
 
-model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q4_0-ggjt.bin")
-print(model.generate("Смысл жизни в ").text)
+##### For QuantizationType.Q4_1 and ContainerType.GGJT
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q4_1-ggjt.bin")
+print(model.generate("The meaning of life is ").text)
+```
+
+##### For QuantizationType.Q4_1 and ContainerType.GGML
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q4_1.bin")
+print(model.generate("The meaning of life is ").text)
+```
+
+##### For QuantizationType.Q5_0 and ContainerType.GGJT
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q5_0-ggjt.bin")
+print(model.generate("The meaning of life is ").text)
+```
+
+##### For QuantizationType.Q5_0 and ContainerType.GGML
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q5_0.bin")
+print(model.generate("The meaning of life is ").text)
+```
+
+##### For QuantizationType.Q5_1 and ContainerType.GGJT
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q5_1-ggjt.bin")
+print(model.generate("The meaning of life is ").text)
+```
+
+##### For QuantizationType.Q5_1 and ContainerType.GGML
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q5_1.bin")
+print(model.generate("The meaning of life is ").text)
+```
+
+##### For QuantizationType.Q8_0 and ContainerType.GGJT
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q8_0-ggjt.bin")
+print(model.generate("The meaning of life is ").text)
+```
+
+##### For QuantizationType.Q8_0 and ContainerType.GGML
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q8_0.bin")
+print(model.generate("The meaning of life is ").text)
 ```
 
 ##### f16 Version
@@ -64,18 +124,79 @@ While this model is intended to be compatible with any GGML-compatible UI, it ha
 
 #### Использование
 
+##### Для QuantizationType.Q4_0 и ContainerType.GGJT
 ```python
-# Версия с квантованием в 4 бита
 from llm_rs import AutoModel
-
 model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q4_0-ggjt.bin")
 print(model.generate("Смысл жизни в ").text)
 ```
 
+##### Для QuantizationType.Q4_0 и ContainerType.GGML
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q4_0.bin")
+print(model.generate("Смысл жизни в ").text)
+```
+
+##### Для QuantizationType.Q4_1 и ContainerType.GGJT
 ```python
-# Версия f16
 from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q4_1-ggjt.bin")
+print(model.generate("Смысл жизни в ").text)
+```
 
+##### Для QuantizationType.Q4_1 и ContainerType.GGML
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q4_1.bin")
+print(model.generate("Смысл жизни в ").text)
+```
+
+##### Для QuantizationType.Q5_0 и ContainerType.GGJT
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q5_0-ggjt.bin")
+print(model.generate("Смысл жизни в ").text)
+```
+
+##### Для QuantizationType.Q5_0 и ContainerType.GGML
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q5_0.bin")
+print(model.generate("Смысл жизни в ").text)
+```
+
+##### Для QuantizationType.Q5_1 и ContainerType.GGJT
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q5_1-ggjt.bin")
+print(model.generate("Смысл жизни в ").text)
+```
+
+##### Для QuantizationType.Q5_1 и ContainerType.GGML
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q5_1.bin")
+print(model.generate("Смысл жизни в ").text)
+```
+
+##### Для QuantizationType.Q8_0 и ContainerType.GGJT
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q8_0-ggjt.bin")
+print(model.generate("Смысл жизни в ").text)
+```
+
+##### Для QuantizationType.Q8_0 и ContainerType.GGML
+```python
+from llm_rs import AutoModel
+model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-q8_0.bin")
+print(model.generate("Смысл жизни в ").text)
+```
+
+##### Версия f16
+```python
+from llm_rs import AutoModel
 model = AutoModel.from_pretrained("iashchak/ruGPT-3.5-13B-ggml", model_file="ruGPT-3.5-13B-f16.bin")
 print(model.generate("Смысл жизни в ").text)
 ```