Rong Shan
CyberDancer
AI & ML interests
Recommender System, Large Language Models
Recent Activity
new activity
4 months ago
tiiuae/falcon-mamba-7b:Sequential Prefilling
new activity
4 months ago
tiiuae/falcon-mamba-7b:RuntimeError: Tensor on device meta is not on the expected device cuda:0!
new activity
about 1 year ago
RWKV/rwkv-5-world-1b5:It seems that this project can only support a batch_size of 1 during inference?
Organizations
None yet
CyberDancer's activity
Sequential Prefilling
#13 opened 4 months ago
by
CyberDancer
RuntimeError: Tensor on device meta is not on the expected device cuda:0!
5
#6 opened 6 months ago
by
abcdata
It seems that this project can only support a batch_size of 1 during inference?
1
#1 opened over 1 year ago
by
howard-hou
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64414d0a66a62c605c94d14d/KGjlf9tRwslr7Q503YLnJ.jpeg)