gräfics

graefics's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in stabilityai/stablelm-2-1_6b about 2 months ago

Any plans to use RMSNorm (or FlashNorm) instead of LayerNorm?

1

#12 opened about 2 months ago by graefics

New activity in HuggingFaceTB/SmolLM-135M about 2 months ago

Are there two identical embedding tensors, even though embeddings are shared?

#15 opened about 2 months ago by graefics

New activity in 1bitLLM/bitnet_b1_58-3B 6 months ago

Any plans to use MQA (multi-query attention) or GQA (grouped-query attention) in the future?

#9 opened 6 months ago by graefics