README.md

---
title: ggml-ctransformers-fastapi
emoji: 🐳🤗⚡️
sdk: docker
app_port: 8000
duplicated_from: matthoffner/ggml-ctransformers-fastapi
---

# ggml-ctransformers-fastapi

## <a href="https://github.com/ggerganov/ggml" target="_blank">ggml</a>
## <a href="https://github.com/marella/ctransformers" target="_blank">ctransformers</a>
## [FastAPI Docs](https://matthoffner-ggml-ctransformers-fastapi.hf.space/docs)

### Updates

* Added /v1/chat/completions
* [Start using ctransformers](https://github.com/marella/ctransformers)
* [Added starcoder example](https://github.com/ggerganov/ggml/tree/master/examples/starcoder)