Edit Models filters

Inference status

Misc

Intel® Neural Compressor

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

66

Full-text search

Active filters: Intel® Neural Compressor

Intel/MiniLM-L12-H384-uncased-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 17

Intel/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 45 • 16

Intel/gpt-j-6B-int8-static-inc

Text Generation • Updated Apr 19, 2023 • 51 • 9

Intel/gpt-j-6B-pytorch-int8-static-inc

Text Generation • Updated Jan 18 • 45

Intel/gpt-neox-japanese-2.7b-int8-inc

Text Generation • Updated Mar 21

Intel/bert-large-uncased-rte-int8-dynamic-inc

Text Classification • Updated Mar 21 • 20

Intel/whisper-large-int8-static-inc

Automatic Speech Recognition • Updated May 18, 2023 • 11

Intel/whisper-large-int8-dynamic-inc

Automatic Speech Recognition • Updated May 18, 2023 • 6 • 1

Intel/bert-large-uncased-rte-int8-static-inc

Text Classification • Updated Mar 22 • 16

Intel/distilbert-base-uncased-MRPC-int8-dynamic-inc

Text Classification • Updated Mar 21 • 9 • 1

Intel/distilbert-base-uncased-MRPC-int8-static-inc

Text Classification • Updated Mar 22 • 5

Intel/albert-base-v2-MRPC-int8-inc

Text Classification • Updated Mar 22 • 26

Intel/bert-base-uncased-CoLA-int8-inc

Text Classification • Updated Mar 22 • 21

Intel/bert-large-uncased-cola-int8-inc

Text Classification • Updated Mar 22 • 11

Intel/bert-base-uncased-STS-B-int8-inc

Text Classification • Updated Mar 22 • 13

Intel/bert-base-cased-finetuned-sst2-int8-inc

Text Classification • Updated Mar 21 • 30

Intel/bert-base-uncased-QNLI-int8-inc

Text Classification • Updated Mar 22 • 12

Intel/deberta-v3-base-mrpc-int8-static-inc

Text Classification • Updated May 25, 2023 • 6

Intel/deberta-v3-base-mrpc-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 7

Intel/whisper-small-int8-dynamic-inc

Automatic Speech Recognition • Updated Jul 7, 2023 • 3

Intel/whisper-small-int8-static-inc

Automatic Speech Recognition • Updated Jul 7, 2023 • 3

Intel/whisper-medium-int8-static-inc

Automatic Speech Recognition • Updated Jul 12, 2023 • 7 • 1

Intel/whisper-medium-int8-dynamic-inc

Automatic Speech Recognition • Updated Jul 12, 2023 • 8

Intel/whisper-tiny-int8-static-inc

Automatic Speech Recognition • Updated Aug 25, 2023 • 3

Intel/whisper-tiny-int8-dynamic-inc

Automatic Speech Recognition • Updated Aug 25, 2023 • 8 • 2

Intel/whisper-base-int8-static-inc

Automatic Speech Recognition • Updated Aug 25, 2023 • 4

Intel/whisper-base-int8-dynamic-inc

Automatic Speech Recognition • Updated Aug 25, 2023 • 5 • 1

Intel/whisper-large-v2-int8-static-inc

Automatic Speech Recognition • Updated Sep 1, 2023 • 2

Intel/whisper-large-v2-int8-dynamic-inc

Automatic Speech Recognition • Updated Sep 1, 2023 • 4 • 1

Intel/whisper-tiny-onnx-int4-inc

Automatic Speech Recognition • Updated Oct 16, 2023 • 17 • 7