Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
baichuan-inc
/
Baichuan2-7B-Chat-4bits
like
57
Follow
Baichuan Intelligent Technology
256
Text Generation
Transformers
PyTorch
English
Chinese
baichuan
custom_code
text-generation-inference
Inference Endpoints
4-bit precision
License:
other
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
你们用4bit有感觉到慢吗
#1
by
chaochaoli
- opened
Sep 19, 2023
Discussion
chaochaoli
Sep 19, 2023
你们用4bit有感觉到慢吗
sunssssun
Sep 19, 2023
明细很慢，怎么做加速
WinterGYC
Baichuan Intelligent Technology org
Sep 20, 2023
4bit会比fp16的慢一些的，加速可以看一些开源的框架
See translation
WinterGYC
changed discussion status to
closed
Sep 20, 2023
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
