
Foundation Text-Generation Models Below 360M Parameters
Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.
Text Generation • Updated • 15.6k • 38Note License: apache-2.0
OuteAI/Lite-Oute-1-300M
Text Generation • Updated • 361 • 7Note License: apache-2.0
cerebras/Cerebras-GPT-256M
Text Generation • Updated • 2.04k • 25Note License: apache-2.0
upstage/TinySolar-248m-4k
Text Generation • Updated • 782 • 5Note License: apache-2.0
M4-ai/TinyMistral-248M-v3
Text Generation • Updated • 231 • 6Note License: apache-2.0
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • Updated • 940 • 2Note License: apache-2.0
MiniLLM/MiniPLM-Qwen-200M
Text Generation • Updated • 290 • 2Note License: apache-2.0
princeton-nlp/Sheared-Pythia-160m
Text Generation • Updated • 101 • 4Note License: apache-2.0
JackFram/llama-160m
Text Generation • Updated • 252k • 33Note License: apache-2.0
SmallDoge/Doge-160M
Text Generation • Updated • 4.55k • 2Note License: apache-2.0
EleutherAI/pythia-160m
Text Generation • Updated • 166k • • 29Note License: apache-2.0
HuggingFaceTB/SmolLM-135M
Text Generation • Updated • 163k • • 195Note License: apache-2.0
amd/AMD-Llama-135m
Text Generation • Updated • 18.2k • • 111Note License: apache-2.0
MiniLLM/MiniPLM-Mamba-130M
Text Generation • Updated • 108 • 2Note License: apache-2.0
EleutherAI/gpt-neo-125m
Text Generation • Updated • 120k • • 196Note License: mit
cerebras/Cerebras-GPT-111M
Text Generation • Updated • 4.57k • • 76Note License: apache-2.0
BEE-spoke-data/smol_llama-101M-GQA
Text Generation • Updated • 5.07k • • 28Note License: apache-2.0
openai-community/gpt2
Text Generation • Updated • 16.8M • • 2.59kNote License: mit
distilbert/distilgpt2
Text Generation • Updated • 1.7M • • 486Note License: apache-2.0
BEE-spoke-data/smol_llama-81M-tied
Text Generation • Updated • 2.95k • 6Note License: apache-2.0
weiser/82M-0.4
Text Generation • Updated • 66Note License: apache-2.0
KylinC/Llama-3-74M
Text Generation • Updated • 59Note License: mit
EleutherAI/pythia-70m
Updated • 59k • 63Note License: apache-2.0
JackFram/llama-68m
Text Generation • Updated • 506k • 26Note License: apache-2.0
OuteAI/Lite-Oute-1-65M
Text Generation • Updated • 223 • 9Note License: apache-2.0
SmallDoge/Doge-60M
Text Generation • Updated • 75.6k • 4Note License: apache-2.0
Felladrin/Minueza-32M-Base
Text Generation • Updated • 471 • 16Note License: apache-2.0
GerbilLab/Gerbil-A-32m
Text Generation • Updated • 165 • 2Note License: apache-2.0
EleutherAI/pythia-31m
Text Generation • Updated • 10.6k • 5Note License: apache-2.0
EleutherAI/pythia-14m
Text Generation • Updated • 128k • 20Note License: apache-2.0