liashchynskyi commited on
Commit
a1cd529
·
verified ·
1 Parent(s): 9ba79cb

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - text-generation
8
+ - gguf
9
+ - llama
10
+ base_model: meta-llama/Meta-Llama-3-8B-Instruct
11
+ quantized_by: liashchynskyi
12
+ ---
13
+
14
+ ## Description
15
+
16
+ This repository contains GGUF format model files for [Meta LLama 3 Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct).
17
+
18
+ ## Prompt template
19
+
20
+ ```
21
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
22
+
23
+ {system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
24
+
25
+ {prompt}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
26
+ ```
27
+
28
+ ## Downloading using huggingface-cli
29
+
30
+ First, make sure you have hugginface-cli installed:
31
+
32
+ ```
33
+ pip install -U "huggingface_hub[cli]"
34
+ ```
35
+
36
+ Then, you can target the specific file you need:
37
+
38
+ ```
39
+ huggingface-cli download liashchynskyi/Meta-Llama-3-8B-Instruct-GGUF --include "meta-llama-3-8b-instruct.Q4_K_M.gguf" --local-dir ./ --local-dir-use-symlinks False
40
+ ```
41
+