Update README.md
Browse files
README.md
CHANGED
@@ -49,3 +49,18 @@ slices:
|
|
49 |
parameters:
|
50 |
weight: 1.0
|
51 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
49 |
parameters:
|
50 |
weight: 1.0
|
51 |
```
|
52 |
+
|
53 |
+
You can reproduce this model using the following commands:
|
54 |
+
|
55 |
+
```bash
|
56 |
+
# Setup
|
57 |
+
git clone https://github.com/arcee-ai/mergekit.git
|
58 |
+
cd mergekit && pip install -e .
|
59 |
+
pip install bitsandbytes
|
60 |
+
|
61 |
+
# Extraction
|
62 |
+
mergekit-extract-lora mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated meta-llama/Meta-Llama-3.1-8B-Instruct Llama-3.1-8B-Instruct-abliterated-LORA --rank=64
|
63 |
+
|
64 |
+
# Merge using previous config
|
65 |
+
mergekit-yaml config.yaml Hermes-3-Llama-3.1-8B-lorablated --allow-crimes --lora-merge-cache=./cache
|
66 |
+
```
|