BAAI/Infinity-Instruct
Viewer
•
Updated
•
20.4M
•
8.82k
•
559
zhanghang
hangzhang-nlp
AI & ML interests
None yet
Recent Activity
liked
a dataset
about 1 month ago
BAAI/Infinity-Instruct
upvoted
a
paper
about 1 month ago
Breaking the Memory Barrier: Near Infinite Batch Size Scaling for
Contrastive Loss
Organizations
hangzhang-nlp's activity
liked
a
dataset
about 1 month ago
upvoted
2
papers
about 1 month ago
liked
a
Space
3 months ago
upvoted
a
paper
4 months ago
liked
a
model
4 months ago
liked
a
Space
4 months ago
Reacted to
stas's
post with 👍
6 months ago
Post
If you're trying to run MoE Mixtral-8x7b under DeepSpeed w/ HF Transformers it's likely to hang on the first forward.
The solution is here https://github.com/microsoft/DeepSpeed/pull/4966?_x_tr_sl=auto&_x_tr_tl=en&_x_tr_hl=en-US#issuecomment-1989671378
and you need deepspeed>=0.13.0
Thanks to Masahiro Tanaka for the fix.
The solution is here https://github.com/microsoft/DeepSpeed/pull/4966?_x_tr_sl=auto&_x_tr_tl=en&_x_tr_hl=en-US#issuecomment-1989671378
and you need deepspeed>=0.13.0
Thanks to Masahiro Tanaka for the fix.
Where is the GSD dataset?
1
#6 opened 7 months ago
by
hangzhang-nlp
hangzhang-nlp
upvoted
an
article
7 months ago
Article
Introducing Idefics2: A Powerful 8B Vision-Language Model for the community
•
168
upvoted
a
collection
8 months ago
upvoted
a
paper
8 months ago
liked
a
dataset
8 months ago
authored
a
paper
12 months ago
liked
a
model
about 1 year ago
updated
a
Space
about 1 year ago
upvoted
2
papers
about 1 year ago
liked
a
model
over 1 year ago
updated
a
model
over 1 year ago