mattshumer
/

Llama-3-8B-16K

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mattshumer commited on Apr 23

Commit

50089e2

•

1 Parent(s): 5a67bfe

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,6 +3,6 @@ datasets:
 - Yukang/LongAlpaca-16k-length
 ---
-This is an extended (16K) context version of LLaMA 3. Trained for five hours on 8x A6000 GPUs, using the `Yukang/LongAlpaca-16k-length` dataset.
 `rope_theta` was set to `1000000.0`. Trained with Axolotl.

 - Yukang/LongAlpaca-16k-length
 ---
+This is an extended (16K) context version of LLaMA 3 8B (base, not instruct). Trained for five hours on 8x A6000 GPUs, using the `Yukang/LongAlpaca-16k-length` dataset.
 `rope_theta` was set to `1000000.0`. Trained with Axolotl.