Courses
I teach machine learning as a volunteer coach for AOAI, the Algerian national selection for the International Olympiad in Artificial Intelligence (IOAI). Here are some of the courses I wrote. Each one rebuilds a core idea from first principles and ends with a hands-on challenge. I add new ones regularly.
01
Courses on Probability and Optimization
The two views of learning: empirical risk minimization and maximum likelihood.
- Markov, Chebyshev, law of large numbers
- Cauchy–Schwarz, gradient descent and its convergence
- GD vs SGD
- MLE; challenge: Gaussian-mixture clustering
02
Linear Regression for ML
Covariance, linear regression and regularization, from geometry to real data.
- Correlation as a cosine
- Least squares, multivariate regression
- Bias–variance tradeoff
- Ridge & Lasso, Bayesian view; challenge: house prices
03
Transformers
From attention to modern language models, rebuilt from simple mathematical principles.
- Embeddings, positional information
- Self-attention and the 1/√dk factor
- Multi-head attention, FFN, residuals
- Causal masking, next-token MLE, KV cache; challenge: NumPy attention layer