mlabonne commited on
Commit
f8376f0
1 Parent(s): 3aad385

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -49,3 +49,18 @@ slices:
49
  parameters:
50
  weight: 1.0
51
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  parameters:
50
  weight: 1.0
51
  ```
52
+
53
+ You can reproduce this model using the following commands:
54
+
55
+ ```bash
56
+ # Setup
57
+ git clone https://github.com/arcee-ai/mergekit.git
58
+ cd mergekit && pip install -e .
59
+ pip install bitsandbytes
60
+
61
+ # Extraction
62
+ mergekit-extract-lora mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated meta-llama/Meta-Llama-3.1-8B-Instruct Llama-3.1-8B-Instruct-abliterated-LORA --rank=64
63
+
64
+ # Merge using previous config
65
+ mergekit-yaml config.yaml Hermes-3-Llama-3.1-8B-lorablated --allow-crimes --lora-merge-cache=./cache
66
+ ```