Unified Scaling Laws for Compressed Representations
Paper
•
2506.01863
•
Published
•
19
Ionut Modoranu
ionutmodo
AI & ML interests
Optimization for Deep Learning, Sparsity
Recent Activity
upvoted
a
paper
4 days ago
WUSH: Near-Optimal Adaptive Transforms for LLM Quantization
authored
a paper
2 months ago
Unified Scaling Laws for Compressed Representations
authored
a paper
2 months ago
Optimizers Qualitatively Alter Solutions And We Should Leverage This
Organizations
authored
2
papers
2 months ago
authored
3
papers
6 months ago
Error Feedback Can Accurately Compress Preconditioners
Paper
•
2306.06098
•
Published
MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence
Paper
•
2405.15593
•
Published
•
1
SVD-Free Low-Rank Adaptive Gradient Optimization for Large Language Models
Paper
•
2505.17967
•
Published
•
17