|
--- |
|
license: mit |
|
datasets: |
|
- roneneldan/TinyStories |
|
language: |
|
- en |
|
--- |
|
|
|
This is a Llama 2 architecture model series trained on the TinyStories dataset, intended for use in the [llama2.c](https://github.com/karpathy/llama2.c) project by Andrej Karpathy. |
|
|
|
Trained on a single v100 32GB GPU for 3 epochs, we achieve an inference speed of ~72 tokens/sec on the same. |
|
|
|
Achieved tok/s: **161.819538** on 12th Gen Intel(R) Core(TM) i9-12900HK |
|
|
|
Learn more on how to run inference in pure C using [llama2.c](https://github.com/karpathy/llama2.c) |
