Ruslan S.

poedator's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored 3 papers over 1 year ago

SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices

Paper • 2406.02532 • Published Jun 4, 2024 • 13

SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

Paper • 2306.03078 • Published Jun 5, 2023 • 3

Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding

Paper • 2402.12374 • Published Feb 19, 2024 • 4