DS703: Introduction to Statistical Inference and Machine Learning
Core, IIT Bombay, C-MInDS, 2026
Course Title: Introduction to Statistical Inference and Machine Learning
Instructors: Parthe Pandit, Arjun Bhagoji
TA: Sreeranjini T M, Yash Sharma
Time: Monday, Tuesday, Thursday (11.35-12.30am)
Room: LT206
Office Hours: Arjun (2.30-3.30pm on Mondays in CC120/online), Parthe (4-5pm on Mondays in KR-320)
Course Description
This course is intended to serve as a foundational graduate course in statistics and machine learning for all incoming graduate students in C-MInDS. It will provide them with one part of the unified, necessary background to take further electives. The course will be rigorous, starting with a treatment of statistical inference as a precursor to modern machine learning. Key aspects of theoretical machine learning such as generalisation bounds will be covered.
Intended Audience: The intended audience for this class is graduate students working in machine learning and data science, who are interested in doing research in this area. However, interested final-year undergraduates are welcome to attend as well.
Pre-requisites: Mathematical maturity will be assumed as will the basics of algorithms, probability, linear algebra, and optimisation.
Course Schedule
| Week | Topic | References | Notes | Comments |
|---|---|---|---|---|
| 1 | Measure-theoretic probability, exponential families | Chapter 1, Durrett | ||
| 2 | Parameter estimation | |||
| 3 | Hypothesis testing | |||
| 4 | Confidence intervals | |||
| 5 | Linear regression | |||
| 6 | Linear regression (cont.) | |||
| 7 | Kernels | |||
| 8 | Mid-sem week | |||
| 9 | Classification and risk notions, support vector machines | Chapter 5, Mohri et al. | ||
| 10 | Surrogate losses and logistic regression | Chapter 4, Mohri et al. | ||
| 11 | Boosting and bagging | |||
| 12 | Generalisation bounds | |||
| 13 | Unsupervised learning and dimensionality reduction | |||
| 14 | Advanced Topics | |||
| 15 | Advanced Topics |
Resources
Practice problems
Running list of practice questions
Supplementary Books
Probability
Statistics
Optimisation
Machine Learning
- Mohri et al., Foundations of Machine Learning
- Shalev-Shwartz & Ben-David, Understanding Machine Learning: From Theory to Algorithms
- Schölkopf & Smola, Learning with Kernels
General
Helpful Courses
Other references mentioned in class
Grading
Quizzes: 40% (4, each 10%)
Mid-sem: 15%
End-sem: 25%
Class participation+attendance: 20%
All exams allow handwritten cheatsheets of appropriate length. No other aids are permitted.
Attendance Policy
2 unexplained absences are allowed. 3 additional pre-approved absences are allowed.
Accommodations
Students with disabilities and health issues should approach the instructors at any point during the semester to discuss accommodations. The course aim is to learn together and legitimate bottlenecks will be resolved collaboratively.