phi-3-onnx / README.md
doberst's picture
Upload README.md
137a3ab verified
|
raw
history blame
1.06 kB
metadata
license: apache-2.0
inference: false
tags:
  - green
  - llmware-chat
  - p3
  - ov

phi-3-ov

phi-3-ov is an OpenVino int4 quantized version of Microsoft Phi-3-mini-4k-instruct, providing a very fast, very small inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.

Model Description

  • Developed by: microsoft
  • Quantized by: llmware
  • Model type: phi3
  • Parameters: 3.8 billion
  • Model Parent: microsoft/Phi-3-mini-4k-instruct
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: Chat, general-purpose LLM
  • Quantization: int4

Get started right away with OpenVino

Looking for AI PC solutions and demos, contact us at llmware

Model Card Contact

llmware on hf

llmware website