Masoud's Notes

Part 3: Stepping into the World – Tabular Value-Based Methods

9 min read   ·   April 03, 2026

2026   ·   reinforcement-learning   machine-learning   ai   mdp   sarsa   q-learning   ·   reinforcement-learning

Part 2: The Multi-Armed Bandit – Mastering the Art of Choices

6 min read   ·   April 02, 2026

2026   ·   reinforcement-learning   machine-learning   ai   multi-armed-bandit   ·   reinforcement-learning

Part 1: A Comprehensive Introduction to Reinforcement Learning (RL)

7 min read   ·   April 01, 2026

2026   ·   reinforcement-learning   machine-learning   ai   dpo   ·   reinforcement-learning

Beyond Correlation: A Guide to Causal Inference and Impact Evaluation

Navigating the Potential Outcomes Framework to extract true causal signals from observational data.

9 min read   ·   March 31, 2026

2026   ·   data-science   machine-learning   causal-inference   impact-evaluation   ·   ml-papers

Optimizers: From Adam to Muon

7 min read   ·   March 30, 2026

2026   ·   optimization   machine-learning   muon   adamw   LLM   ·   ml-papers