Edit Models filters

Inference Providers

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

32,054

Full-text search

Active filters: bitsandbytes

unsloth/codellama-34b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 465 • 4

unsloth/llama-2-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 565 • 5

unsloth/zephyr-sft-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 8.5k • 5

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 7k • 11

herisan/Mistral-7b-bnb-4bit_mental_health_counseling_conversations

Text Generation • Updated Jan 13, 2024 • 346 • 2

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 12.5k • 32

unsloth/mistral-7b-instruct-v0.1-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 1.1k • 4

AISimplyExplained/Vakil-7B

Text Generation • Updated Jan 23, 2024 • 1.75k • 3

alnrg2arg/blockchainlabs_7B_merged_test2_4_prune_sft_4bit_DPO_orca

Text Generation • Updated Jan 26, 2024 • 8 • 2

unsloth/codellama-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 6.24k • 3

unsloth/codellama-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 134 • 2

unsloth/yi-34b-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 70 • 3

unsloth/yi-34b-chat-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 73 • 2

unsloth/tinyllama-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 9.06k • 4

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 1.9k • 29

unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.17k • 18

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.18k • 16

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3, 2024 • 1.54k • 20

unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 12.7k • 14

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 167 • 6

zamal/gemma-7b-finetuned

Text Generation • Updated Jun 11, 2024 • 353 • 5

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27, 2024 • 10.7k • 174

unsloth/mistral-7b-v0.2-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 2.41k • 14

Sahi19/Gemma2bLegalChatbot

Text Generation • Updated Mar 25, 2024 • 1

Anant58/Genshin-chat-ARM

Text Generation • Updated Dec 13, 2024 • 87 • 1

PrunaAI/mosaicml-mpt-7b-chat-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 189 • 1

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27, 2024 • 1.03k • 250

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 179 • 1

PrunaAI/Writer-palmyra-small-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 197 • 1

unsloth/gemma-1.1-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.89k • 5