70B model?
#1
by
rocca
- opened
I'm wondering if you trained a 70b Llama 2 accelerator, and if so, whether you could release it?
Hi @rocca , we have trained an early version of llama3-70b speculator. We are planning on improving it first, and following it up with a llama2-70b speculator. Thanks for your interest! Hopefully soon 🤞
Great to hear! Keenly looking forward to trying out llama2-70b speculator.
Hi @rocca , an update: we have trained a llama2-70b speculator and achieved a good speedup. We plan to release it soon following the testing and clearance process 🤞
Great to hear!!
Hi @rocca , you can find the llama2-70b speculator here: https://huggingface.co/ibm-fms/llama2-70b-accelerator