AIFunOver
/

Qwen2.5-7B-Instruct-1M-openvino-4bit

Text Generation

4-bit precision

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Qwen2.5-7B-Instruct-1M-openvino-4bit

1 contributor

History: 16 commits

AIFunOver's picture

Upload README.md with huggingface_hub

926e5c8 verified 3 days ago

.gitattributes

1.52 kB

initial commit 3 days ago
README.md

949 Bytes

Upload README.md with huggingface_hub 3 days ago
config.json

875 Bytes

Upload config.json with huggingface_hub 3 days ago
generation_config.json

243 Bytes

Upload generation_config.json with huggingface_hub 3 days ago
model.safetensors.index.json

27.8 kB

Upload model.safetensors.index.json with huggingface_hub 3 days ago
openvino_config.json

651 Bytes

Upload openvino_config.json with huggingface_hub 3 days ago
openvino_detokenizer.bin

1.58 MB
LFS

Upload openvino_detokenizer.bin with huggingface_hub 3 days ago
openvino_detokenizer.xml

11.1 kB

Upload openvino_detokenizer.xml with huggingface_hub 3 days ago
openvino_model.bin

4.61 GB
LFS

Upload openvino_model.bin with huggingface_hub 3 days ago
openvino_model.xml

2.58 MB

Upload openvino_model.xml with huggingface_hub 3 days ago
openvino_tokenizer.bin

3.77 MB
LFS

Upload openvino_tokenizer.bin with huggingface_hub 3 days ago
openvino_tokenizer.xml

24.7 kB

Upload openvino_tokenizer.xml with huggingface_hub 3 days ago
sparse_attention_config.json

47.9 kB

Upload sparse_attention_config.json with huggingface_hub 3 days ago
tokenizer.json

7.03 MB

Upload tokenizer.json with huggingface_hub 3 days ago
tokenizer_config.json

7.23 kB

Upload tokenizer_config.json with huggingface_hub 3 days ago
vocab.json

2.78 MB

Upload vocab.json with huggingface_hub 3 days ago