Datascience @ ENS 2022
- Exercises
- Notebook about stochastic gradient descent
- Intro to pytorch — Simple neural network — ConvNet
Optimization for datascience, 2022
Good reference with prerequisites : https://mml-book.github.io/ (main focus on chapter 5, lots of important things in chapters 2, 3, 4)
Reference for the course : https://web.stanford.edu/~boyd/cvxbook/
- Introduction / algebra reminders / calculus reminders / exercices
- Gradient descent
- Proximal Gradient descent
- Stochastic Gradient descent
- Variance reduction methods and Exercises about implicit bias
Machine learning and python, 2020