Pedram Rostami

PedramR's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted 2 papers 7 months ago

Training LLMs over Neurally Compressed Text

Paper • 2404.03626 • Published Apr 4 • 21

The Unreasonable Ineffectiveness of the Deeper Layers

Paper • 2403.17887 • Published Mar 26 • 78

upvoted 2 papers 8 months ago

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Paper • 2403.03507 • Published Mar 6 • 182

Simple and Scalable Strategies to Continually Pre-train Large Language Models

Paper • 2403.08763 • Published Mar 13 • 48

upvoted a paper 9 months ago

Tuning Language Models by Proxy

Paper • 2401.08565 • Published Jan 16 • 20