rombodawg commited on
Commit
a2457d0
1 Parent(s): dca9bf4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -24
README.md CHANGED
@@ -10,28 +10,6 @@ tags:
10
  datasets:
11
  - Replete-AI/code_bagel
12
  ---
 
13
 
14
- # rombodawg/Llama3-8B-SFT-code_bagel-bnb-4bit-Q8_0-GGUF
15
- This model was converted to GGUF format from [`thesven/Llama3-8B-SFT-code_bagel-bnb-4bit`](https://huggingface.co/thesven/Llama3-8B-SFT-code_bagel-bnb-4bit) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
16
- Refer to the [original model card](https://huggingface.co/thesven/Llama3-8B-SFT-code_bagel-bnb-4bit) for more details on the model.
17
- ## Use with llama.cpp
18
- Install llama.cpp through brew.
19
- ```bash
20
- brew install ggerganov/ggerganov/llama.cpp
21
- ```
22
- Invoke the llama.cpp server or the CLI.
23
- CLI:
24
- ```bash
25
- llama-cli --hf-repo rombodawg/Llama3-8B-SFT-code_bagel-bnb-4bit-Q8_0-GGUF --model llama3-8b-sft-code_bagel-bnb-4bit-q8_0.gguf -p "The meaning to life and the universe is"
26
- ```
27
- Server:
28
- ```bash
29
- llama-server --hf-repo rombodawg/Llama3-8B-SFT-code_bagel-bnb-4bit-Q8_0-GGUF --model llama3-8b-sft-code_bagel-bnb-4bit-q8_0.gguf -c 2048
30
- ```
31
- Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
32
- ```
33
- git clone https://github.com/ggerganov/llama.cpp && \
34
- cd llama.cpp && \
35
- make && \
36
- ./main -m llama3-8b-sft-code_bagel-bnb-4bit-q8_0.gguf -n 128
37
- ```
 
10
  datasets:
11
  - Replete-AI/code_bagel
12
  ---
13
+ Just wanted to these the thesven/Llama3-8B-SFT-code_bagel-bnb-4bit model someone trained on a small subset on my code bagel dataset so i used gguf-my-repo to quantize it.
14
 
15
+ ## THIS IS NOT MY MODEL