Hugging Face's logo

Alibaba-NLP
/
gte-Qwen2-7B-instruct

Sentence Similarity
sentence-transformers
Safetensors
Transformers
qwen2
text-generation
mteb
Qwen2
custom_code
Eval Results
text-generation-inference
text-embeddings-inference
Inference Endpoints
Model card Files Community
50

bfloat16 vs. float32

#34
by tanliboy - opened
Discussion
tanliboy

I notice that the base model Qwen2-7B-instruct is in bfloat16 but this model is in float32.
What's the impact on precision if we load with bfloat16?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment