Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

5,156

Full-text search

Active filters: exl2

dmanary-pronavigator/gemma-2-27b-it-exl2-4.5bpw

Text Generation • Updated Jul 7, 2024 • 15

ek826/Meta-Llama-3.1-405B-Instruct-6.0bpw-exl2

Text Generation • Updated Aug 4, 2024 • 11 • 2

Statuo/MN-Lyra-12b-EXL2-8bpw

Updated Aug 4, 2024 • 7

Statuo/MN-Lyra-12b-EXL2-6bpw

Updated Aug 4, 2024 • 7

Statuo/MN-Lyra-12b-EXL2-4bpw

Updated Aug 4, 2024 • 7

dmanary-pronavigator/gemma-2-27b-it-exl2-4.0bpw

Text Generation • Updated Jul 7, 2024 • 7

Orion-zhen/Y1.5-MS-Mysteria-34b-4.0bpw-exl2

Text Generation • Updated Aug 5, 2024 • 9

Orion-zhen/Y1.5-MS-Mysteria-34b-6.5bpw-exl2

Text Generation • Updated Aug 5, 2024 • 9

Slvcxc/Sekhmet_Gimmel-L3.1-8B-v0.3-8.0bpw-h8-exl2

Updated Aug 5, 2024 • 5

blockblockblock/internlm2_5-20b-chat-bpw4-exl2

Text Generation • Updated Aug 5, 2024 • 8 • 1

blockblockblock/LLaMA-33B-HF-bpw4-exl2

Text Generation • Updated Aug 5, 2024 • 11

blockblockblock/llama-13b-bpw6-exl2

Updated Aug 6, 2024 • 7

DeusImperator/MN-12B-Lyra-v1_exl2_8bpw_max

Updated Aug 6, 2024 • 4

Kotokin/internlm_internlm2_5-20b-chat-exl2-8bpw

Text Generation • Updated Aug 6, 2024 • 13

DeusImperator/magnum-32b-v2_exl2_4.7bpw

Text Generation • Updated Aug 27, 2024 • 12

TeeZee/2xbagel-34b-v0.2-bpw3.0-h6-exl2

Text Generation • Updated Aug 7, 2024 • 25

Annuvin/EXAONE-3.0-7.8B-Instruct-Llamafied-6.5bpw-h8-exl2

Updated Jan 16 • 9 • 2

TeeZee/2xbagel-34b-v0.2-bpw2.8-h6-exl2

Text Generation • Updated Aug 7, 2024 • 22

JackCloudman/RYS-XLarge-6.0bpw-h6-exl2

Updated Aug 16, 2024 • 14

TeeZee/2xbagel-34b-v0.2-bpw2.9-h6-exl2

Text Generation • Updated Aug 8, 2024 • 16

denru/Tess-3-Mistral-Large-2-123B-5_0bpw-h8-exl2-pippa

Updated Aug 8, 2024 • 10 • 1

Orion-zhen/athene-70b-4.5bpw-exl2

Text Generation • Updated Aug 9, 2024 • 6

DeusImperator/magnum-32b-v2_exl2_4.7bpw_rpcal_mk2

Text Generation • Updated Aug 27, 2024 • 12

Alias1964/Llama-3.1-70B-Instruct-lorablated-Q4-EXL2

Text Generation • Updated Aug 8, 2024 • 20 • 1

Statuo/Theia-21b-EXL2-6bpw

Updated Aug 10, 2024 • 6

Statuo/Theia-21b-EXL2-4bpw

Updated Aug 10, 2024 • 8

FuturisticVibes/dolphin-2.9.3-mistral-nemo-12b-8.0bpw-h8-exl2

Updated Aug 23, 2024 • 5

Statuo/Theia-21b-EXL2-8bpw

Updated Aug 10, 2024 • 13

FuturisticVibes/Theia-21B-v1-8.0bpw-h8-exl2

Updated Aug 23, 2024 • 7

FuturisticVibes/dolphin-2.9.4-llama3.1-8b-8.0bpw-h8-exl2

Updated Aug 23, 2024 • 5