|
--- |
|
license: gpl-3.0 |
|
--- |
|
|
|
# NVOM.ai LLama 3.2 3b (GGUF) |
|
A lightweight model optimized and trained on 100k+ dataset by nvom.ai |
|
|
|
# Benchmarks |
|
|
|
NVOM.ai AIBench SmartBench Specials (Based on NVOM.ai bench) |
|
NVOM Preview 4b 7.91 10.12 9.49 Speed, Smart, Quanatisation 8-12 - best |
|
NVOM LLama 3.2 3b 6.11 4.95 3.31 Speed, Quanatisation 5-8 - normal |
|
Meta LLama 3.2 3b 3.76 2.11 2.93 Quanatisation 1-4 - bad |
|
|
|
|
|
|
|
# Run model locally |
|
You can use [LM STUDIO](https://lmstudio.ai/) to start model |
|
Or you can use code and Transformers |
|
|
|
*Soon more information* |
|
|
