The Salt - Curated AI

The Salt - Curated AI

Home
Notes
AI Notebooks
AI Repositories
Related Articles
deep dive
Archive
About
Most Popular
View all
LongRoPE: Towards Unlimited Context Length for the Transformer
 • Benjamin Marie
Online DPO with a Reward Model
 • Benjamin Marie
Qwen3 Technical Report: Reasoning in Pre-Training and Post-Training
 • Benjamin Marie
Evaluating AdEMAMix: A New Optimizer for Faster, More Efficient LLM Training
 • Benjamin Marie
FineWeb-Edu: How to Make a Very High-Quality Dataset to Pre-train LLMs
 • Benjamin Marie
3
Pre-train LLMs on Millions of Synthetic Instructions
 • Benjamin Marie
Reward Correct CoT for Better Reasoning Models
The Weekly Salt #73
 • 
Benjamin Marie
Magistral: Advancing Reasoning with Efficient GRPO Training
No More KL Penalty, No Need for a Reference Model
 • 
Benjamin Marie
Better Data Recipes for Pre-training LLMs and Training Reasoning Models
The Weekly Salt #72
 • 
Benjamin Marie
Reasoning Models Are More Prone to "Hallucination"
The Weekly Salt #71
 • 
Benjamin Marie
End-to-End FP4 Training for LLMs with Blackwell GPUs
The Weekly Salt #70
 • 
Benjamin Marie
How to Teach LLMs When to Think
The Weekly Salt #69
 • 
Benjamin Marie
Qwen3 Technical Report: Reasoning in Pre-Training and Post-Training
Plus a Brief Look at the Limitations of the Multilingual Evaluation
 • 
Benjamin Marie
The Salt - Curated AI
The Salt - Curated AI
The Salt offers weekly reviews and in-depth analyses of the latest AI papers. If you want to stay informed of recent progress in AI without reading much, The Salt is for you!
Recommendations
The Kaitchup – AI on a Budget
The Kaitchup – AI on a Budget
Benjamin Marie

The Salt - Curated AI

AboutArchiveRecommendationsSitemap
© 2025 Benjamin Marie
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture