Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Inference Endpoints

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,734

Full-text search

Active filters: quantized

afrideva/Dimensity-3B-GGUF

Text Generation • Updated Nov 26, 2023 • 46 • 1

afrideva/MiniChat-1.5-3B-GGUF

Text Generation • Updated Nov 26, 2023 • 52 • 3

afrideva/TinyLLama-v0-GGUF

Text Generation • Updated Nov 26, 2023 • 50

afrideva/TinyLlama-1.1B-Chat-v0.4-ENG-GGUF

Text Generation • Updated Nov 27, 2023 • 76

afrideva/dopeyplats-1.1b-2T-v1-GGUF

Text Generation • Updated Nov 27, 2023 • 53

afrideva/smartyplats-1.1b-v2-GGUF

Text Generation • Updated Nov 27, 2023 • 72

afrideva/TinyLlama-1.1B-2T-lr-2e-4-3ep-dolly-15k-instruct-v1-GGUF

Text Generation • Updated Nov 28, 2023 • 78

afrideva/TinyLlama-1.1B-step-2T-lr-5-5ep-oasst1-top1-instruct-V1-GGUF

Text Generation • Updated Nov 28, 2023 • 76

afrideva/smol_llama-101M-GQA-GGUF

Text Generation • Updated Nov 28, 2023 • 46

afrideva/smol_llama-101M-GQA-python-GGUF

Text Generation • Updated Dec 27, 2023 • 91

afrideva/zephyr-smol_llama-100m-dpo-full-GGUF

Text Generation • Updated Nov 28, 2023 • 56

afrideva/verysmol_llama-v11-KIx2-GGUF

Text Generation • Updated Nov 28, 2023 • 72

afrideva/smol_llama-101M-midjourney-messages-GGUF

Text Generation • Updated Nov 28, 2023 • 232

afrideva/TinyLlama-con-creative-writing-v0.2-GGUF

Text Generation • Updated Dec 1, 2023 • 54 • 1

afrideva/TinyLlama-con-brainstorming-v0.2-GGUF

Text Generation • Updated Dec 1, 2023 • 52

afrideva/Aira-2-1B1-GGUF

Text Generation • Updated Dec 2, 2023 • 129

afrideva/Astrohermes-3B-GGUF

Text Generation • Updated Dec 3, 2023 • 100 • 1

afrideva/Astridboros-3B-GGUF

Text Generation • Updated Dec 4, 2023 • 129 • 3

afrideva/TinyMistral-248M-SFT-v3-GGUF

Text Generation • Updated Dec 4, 2023 • 71

afrideva/Astrorocketboros-3B-GGUF

Text Generation • Updated Dec 7, 2023 • 61 • 2

afrideva/Echo-3B-GGUF

Text Generation • Updated Dec 8, 2023 • 20 • 3

afrideva/Ferret-3B-GGUF

Text Generation • Updated Dec 8, 2023 • 96 • 2

afrideva/TinyMistral-248M-SFT-v4-GGUF

Text Generation • Updated Dec 11, 2023 • 140

afrideva/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T-GGUF

Text Generation • Updated Dec 12, 2023 • 68 • 1

afrideva/Zephyr-3.43B-GGUF

Text Generation • Updated Dec 16, 2023 • 90 • 1

afrideva/SmolLlamix-8x101M-GGUF

Text Generation • Updated Dec 16, 2023 • 60 • 2

afrideva/Walter-Llama-1B-GGUF

Text Generation • Updated Dec 16, 2023 • 41

afrideva/LocutusqueXFelladrin-TinyMistral248M-Instruct-GGUF

Text Generation • Updated Dec 16, 2023 • 57

afrideva/Walter-StableLM-3B-GGUF

Text Generation • Updated Dec 16, 2023 • 42 • 3

afrideva/no-prompt-1.3b-GGUF

Text Generation • Updated Dec 16, 2023 • 106 • 1