On my device, I was able to achieve a 64.04x speedup over WASM! π€― How much does WebGPU speed up ML models running locally in your browser? Try it out and share your results! π
Introducing Phi-3 WebGPU, a private and powerful AI chatbot that runs 100% locally in your browser, powered by π€ Transformers.js and onnxruntime-web!
π On-device inference: no data sent to a server β‘οΈ WebGPU-accelerated (> 20 t/s) π₯ Model downloaded once and cached