Intel
/

gpt-j-6B-int8-static-inc

Text Generation

text-generation-inference

PostTrainingStatic

Intel® Neural Compressor

neural-compressor

Inference Endpoints

Model card Files Files and versions Community

gpt-j-6B-int8-static-inc

3 contributors

History: 17 commits

MengniWang's picture

add batch inference code

03e8016 over 1 year ago