metadata

license: gpl-3.0

NVOM.ai LLama 3.2 3b (GGUF)

A lightweight model optimized and trained on 100k+ dataset by nvom.ai

Benchmarks

                       NVOM.ai AIBench SmartBench       Specials (Based on NVOM.ai bench)         
NVOM Preview 4b        7.91    10.12   9.49             Speed, Smart, Quanatisation        8-12 - best
NVOM LLama 3.2 3b      6.11    4.95    3.31             Speed, Quanatisation               5-8 -  normal
Meta LLama 3.2 3b      3.76    2.11    2.93             Quanatisation                      1-4 -  bad

Run model locally

You can use LM STUDIO to start model Or you can use code and Transformers

Soon more information