Edit Models filters

Inference status

Misc

Misc with no match

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

297

Full-text search

Active filters: web-llm

mlc-ai/TinyLlama-1.1B-Chat-v0.4-q0f16-MLC

Updated Jul 11 • 11

mlc-ai/TinyLlama-1.1B-Chat-v0.4-q0f32-MLC

Updated Jul 11 • 3

mlc-ai/phi-1_5-q0f32-MLC

Updated Jul 11 • 7

mlc-ai/phi-1_5-q4f32_1-MLC

Updated Jul 11 • 37 • 1

mlc-ai/phi-2-q0f32-MLC

Updated Jul 11 • 4

mlc-ai/phi-2-q4f32_1-MLC

Updated Jul 11 • 65 • 1

mlc-ai/NeuralHermes-2.5-Mistral-7B-q3f16_1-MLC

Updated Jul 11 • 3

mlc-ai/Qwen-7B-Chat-q4f16_1-MLC

Updated Jul 11 • 2 • 2

mlc-ai/Qwen-7B-Chat-q4f32_1-MLC

Updated Jul 11 • 2

mlc-ai/Qwen-1_8B-Chat-q4f16_1-MLC

Updated Jul 11 • 12 • 1

mlc-ai/Qwen-1_8B-Chat-q4f32_1-MLC

Updated Jul 11 • 5 • 1

mlc-ai/Qwen-14B-Chat-q4f32_1-MLC

Updated Jul 11 • 4

mlc-ai/CodeLlama-7b-hf-q4f16_1-MLC

Updated Jul 11 • 3

mlc-ai/CodeLlama-7b-hf-q4f32_1-MLC

Updated Jul 11 • 9

mlc-ai/CodeLlama-13b-hf-q4f16_1-MLC

Updated Jul 11 • 4

mlc-ai/CodeLlama-13b-hf-q4f32_1-MLC

Updated Jul 11 • 5

mlc-ai/CodeLlama-34b-hf-q4f16_1-MLC

Updated Jul 11 • 2

mlc-ai/CodeLlama-34b-hf-q4f32_1-MLC

mlc-ai/CodeLlama-7b-Instruct-hf-q4f16_1-MLC

mlc-ai/CodeLlama-7b-Instruct-hf-q4f32_1-MLC

Updated Jul 11 • 1

mlc-ai/CodeLlama-13b-Instruct-hf-q4f16_1-MLC

Updated Jul 11 • 2

mlc-ai/CodeLlama-13b-Instruct-hf-q4f32_1-MLC

Updated Jul 11 • 2

mlc-ai/CodeLlama-34b-Instruct-hf-q4f16_1-MLC

Updated Jul 11 • 3

mlc-ai/CodeLlama-34b-Instruct-hf-q4f32_1-MLC

Updated Jul 11 • 4

mlc-ai/CodeLlama-7b-Python-hf-q4f16_1-MLC

mlc-ai/CodeLlama-7b-Python-hf-q4f32_1-MLC

Updated Jul 11 • 2

mlc-ai/CodeLlama-13b-Python-hf-q4f16_1-MLC

Updated Jul 11 • 5

mlc-ai/CodeLlama-13b-Python-hf-q4f32_1-MLC

Updated Jul 11 • 2

mlc-ai/CodeLlama-34b-Python-hf-q4f16_1-MLC

Updated Jul 11 • 3

mlc-ai/CodeLlama-34b-Python-hf-q4f32_1-MLC

Updated Jul 11 • 3