Home 🏠

❯

Tag Index

Found 12 total tags.

Alignment

2 items with this tag.

Feb 11, 2025
GenARM: Reward Guided Generation with Autoregressive Reward Model for Test-time Alignment
- Alignment
- RL-in-Language-Modeling
Feb 10, 2025
Aligner: Efficient Alignment by Learning to Correct
- Alignment

Architectures

1 item with this tag.

Feb 14, 2025
LLM Pretraining with Continuous Concepts
- Architectures

Attention-Variants

3 items with this tag.

Feb 19, 2025
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
- Attention-Variants
Feb 07, 2025
Scalable-Softmax Is Superior for Attention
- Attention-Variants
Feb 05, 2025
DINT Transformer
- Attention-Variants

Classics

1 item with this tag.

Feb 08, 2025
A simple neural network module for relational reasoning
- Classics

Grokking

1 item with this tag.

Jan 30, 2025
Grokking at the Edge of Numerical Stability
- Grokking
- Theoretical-Deep-Learning

Mechanistic-Interpretibility

2 items with this tag.

Mar 02, 2025
LLM-Microscope: Uncovering the Hidden Role of Punctuation in Context Memory of Transformers
- Mechanistic-Interpretibility
Feb 01, 2025
The Super Weight in Large Language Modeling
- Mechanistic-Interpretibility
- Theoretical-Deep-Learning

Mixture-of-Experts

2 items with this tag.

Feb 02, 2025
ReMoE- Fully Differentiable Mixture-of-Experts with ReLU Routing
- Mixture-of-Experts
Jan 29, 2025
Autonomy-of-Experts Models
- Mixture-of-Experts

Program-Synthesis

1 item with this tag.

Mar 01, 2025
Searching Latent Program Spaces
- Program-Synthesis

Reasoning

3 items with this tag.

Mar 04, 2025
Reasoning with Latent Thoughts: On the Power of Looped Transformers
- Reasoning
Feb 16, 2025
Step Back to Leap Forward: Self-Backtracking for Boosting Reasoning of Language Models
- Reasoning
Jan 30, 2025
SFT Memorizes, RL Generalizes- A Comparative Study of Foundation Model Post-training
- RL-in-Language-Modeling
- Reasoning

Reinforcement-Learning

2 items with this tag.

Feb 21, 2025
From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Control
- Reinforcement-Learning
Feb 17, 2025
Training Language Models for Social Deduction with Multi-Agent Reinforcement Learning
- Reinforcement-Learning

RL-in-Language-Modeling

3 items with this tag.

Feb 11, 2025
GenARM: Reward Guided Generation with Autoregressive Reward Model for Test-time Alignment
- Alignment
- RL-in-Language-Modeling
Feb 06, 2025
Diverse Preference Optimization
- RL-in-Language-Modeling
Jan 30, 2025
SFT Memorizes, RL Generalizes- A Comparative Study of Foundation Model Post-training
- RL-in-Language-Modeling
- Reasoning

Theoretical-Deep-Learning

2 items with this tag.

Feb 01, 2025
The Super Weight in Large Language Modeling
- Mechanistic-Interpretibility
- Theoretical-Deep-Learning
Jan 30, 2025
Grokking at the Edge of Numerical Stability
- Grokking
- Theoretical-Deep-Learning