Home 🏠

❯

Paper Breakdowns

Paper Breakdowns

19 items under this folder.

Mar 04, 2025
Reasoning with Latent Thoughts: On the Power of Looped Transformers
- Reasoning
Mar 02, 2025
LLM-Microscope: Uncovering the Hidden Role of Punctuation in Context Memory of Transformers
- Mechanistic-Interpretibility
Mar 01, 2025
Searching Latent Program Spaces
- Program-Synthesis
Feb 21, 2025
From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Control
- Reinforcement-Learning
Feb 19, 2025
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
- Attention-Variants
Feb 17, 2025
Training Language Models for Social Deduction with Multi-Agent Reinforcement Learning
- Reinforcement-Learning
Feb 16, 2025
Step Back to Leap Forward: Self-Backtracking for Boosting Reasoning of Language Models
- Reasoning
Feb 14, 2025
LLM Pretraining with Continuous Concepts
- Architectures
Feb 11, 2025
GenARM: Reward Guided Generation with Autoregressive Reward Model for Test-time Alignment
- Alignment
- RL-in-Language-Modeling
Feb 10, 2025
Aligner: Efficient Alignment by Learning to Correct
- Alignment
Feb 08, 2025
A simple neural network module for relational reasoning
- Classics
Feb 07, 2025
Scalable-Softmax Is Superior for Attention
- Attention-Variants
Feb 06, 2025
Diverse Preference Optimization
- RL-in-Language-Modeling
Feb 05, 2025
DINT Transformer
- Attention-Variants
Feb 02, 2025
ReMoE- Fully Differentiable Mixture-of-Experts with ReLU Routing
- Mixture-of-Experts
Feb 01, 2025
The Super Weight in Large Language Modeling
- Mechanistic-Interpretibility
- Theoretical-Deep-Learning
Jan 30, 2025
Grokking at the Edge of Numerical Stability
- Grokking
- Theoretical-Deep-Learning
Jan 30, 2025
SFT Memorizes, RL Generalizes- A Comparative Study of Foundation Model Post-training
- RL-in-Language-Modeling
- Reasoning
Jan 29, 2025
Autonomy-of-Experts Models
- Mixture-of-Experts