CSN-382 Machine Learning
Spring 2022-23
Instructor: Balasubramanian Raman
Office: S-227, CSE Building
Class Meeting Time: Mondays, Tuessdays and Thursdays (2-3 pm).
Class Room: APJ Abdul Kalam Block - 407
Office Hours: Tuesdays and Fridays, 11:00 a.m. - 1:00 p.m. and by appointment
TAs: Dr. Pradeep Singh (pradeep.cs at sric), Kishore Babu(kbabu89 at cs), Deepak Kumar (d_kumar at cs) and Diya Sati(diya_s at cs)
Email: first four letters of first name at cs dot ac dot in
Announcements
May 05, 2023: ETE answer scripts have been distributed
May 05, 2023: Re-Quiz 1 has been conducted.
April 27, 2023: ETE has been conducted.
April 24, 2023: Quiz 2 has been conducted.
Assignment 5 has been posted.
April 06, 2023: Re-MTE has been conducted.
Assignment 4 has been posted.
March 01, 2023: MTE has been conducted.
Assignment 3 has been posted.
February 09, 2023: Quiz 1 has been conducted.
February 02, 2023: Assignment 2 has been posted.
January 20, 2023: Python Lab sheet 1 for Batch 02 has been posted.
January 19, 2023: Assignment 1 has been posted.
January 19, 2023: Python Lab sheet 1 for Batch 01 has been posted.
January 05, 2023: Classes have begun.
Course Objectives, Learning Outcomes and Prerequisites
This course provides an introduction to the fundamental concepts in machine learning and popular machine learning algorithms. We will cover the standard and most popular supervised learning algorithms including linear regression, logistic regression, decision trees, k-nearest neighbour, an introduction to Bayesian learning and the Naive Bayes algorithm, support vector machines and kernels and neural networks with an introduction to Deep Learning.
Prerequisites: Programming and Data Structures.
Evaluation Components
- Term tests/quizzes (10%)
- Assignments and Tutorials (10%)
- Mini Project(10%)
- Mid-Term Examination (30%)
- End Term Examination (40%)
Lecture Notes
01. Introduction to Machine Learning (09/01/2023)
02. Different Types of Learning (10/01/2023)
03. Linear Regression-OLS and Introduction to Gradient Descent (12/01/2023)
04. Linear Regression-Gradient Descent, Prelimininary Statistics-Covariance, Correlation, Measures of Association in Regression (16/01/2023)
05. R-Squared, Adjusted R-Squared, Feature Engineering, Introduction to PCA (17/01/2023)
06. PCA and Introduction to Logistic Regression (19/01/2023)
06. Why Eigenvectors with the highest Eigenvalues maximize the variance in PCA? (19/01/2023)
07. Logistic Regression and Introduction to Probability Theory (23/01/2023)
08. Conditional Probability and Naive Bayes classifier (24/01/2023)
09. Problem Discussion (02/02/2023)
10. kNN and Loadings in PCA (06/02/2023)
11. Feature Selection and Introduction to LDA (07/02/2023)
12. Quiz 1 (09/02/2023), Solution (Posted on 13/02/2023)
13. LDA (13/02/2023)
13. Why Eigenvectors with the highest Eigenvalues maximize the separation between the classes in LDA? (13/02/2023)
14. k-Means Clustering and k-Modes clustering (16/02/2023)
15. Cost Function Optimization and Introduction to Regularization (20/02/2023)
16. Regularization, Convex Optimization (21/02/2023)
17. Heirarchichal Clustering and the Introduction to Decision Tree (27/03/2023)
18. Decision Tree (28/03/2023)
19. Optimisation in ML & Introduction to Neural Networks (30/03/2023)
20. Neural Networks (03/04/2023)
21. MLPs, Kernel Methods, Kernel Tricks, Activation functions, Forward Propogation, Backpropogation, Loss functions,Regularization Techniques (10/04/2023)
22 and 23. Backpropogation, Hidden Layers, Loss functions, Compute Gradients for Output Layer, General MLP Architecture and Optimization Algorithms (11/04/2023 and 13/4/2023)
24. CNNs, Convolution Operation, Pooling Layer, Fully Connected Layer, Backpropagation and Optimization (15/04/2023)
25 to 34. Mini Project Presentations (17/04/2023 to 26/04/2023)
35. Quiz 2 (24/04/2023), Solution (Posted on 24/04/2023)
36. Re-Quiz 1 (05/05/2023), Solution (Posted on 05/05/2023)
Assignments
01. Assignment 1 (Posted on 19/01/2023, due on 02/02/2023), Solution/Hint (Posted on 07/02/2023).
02. Python Lab Sheet 1 for Batch 01 (Posted on 19/01/2023)
03. Python Lab Sheet 1 for Batch 02 (Posted on 19/01/2023)
04. Assignment 2 (Posted on 02/02/2023, due on 17/02/2023).
05. Assignment 3 .
06. Assignment 4 .
07. Assignment 5 .
- There will be four to seven assignments.
- Late assignments will be accepted, with a 10% penalty per day, up to five days.
- Submission procedure and other requirements will be stated in individual assignments.
- Students are responsible for backing up and protecting their work.
Examinations
01. Quiz 1 (09/02/2023), Solution (Posted on 13/02/2023)
02. MTE (01/03/2023), Solution (Posted on 03/03/2023)
03. Re-MTE (06/04/2023), Solution (Posted on 06/04/2023)
04. Quiz 2 (24/04/2023), Solution (Posted on 24/04/2023)
05. ETE (27/04/2023), Solution (Posted on 27/04/2023)
06. Re-Quiz 1 (05/05/2023), Solution (Posted on 05/05/2023)
Extras
01. How to install anaconda in windows and ubuntu along with google colab (Posted on 20/01/2023)
Recommended Study Material
The following will be used as a reference/text book for this course:
1. Mohri Mehryar, Afshin Rostamizadeh, and Ameet Talwalkar, Foundations of machine learning, MIT press, 2018.
2. Sammut, Claude, and Geoffrey I. Webb, Encyclopedia of machine
learning and data mining, Springer, 2017.
3. Witten Ian H., Eibe Frank, Mark A. Hall, and Christopher J. Pal, Data Mining: Practical machine learning tools and techniques, Morgan Kaufmann, 2016.
4. Muller Andreas C. and Sarah Guido. Introduction to Machine
Learning with Python: A Guide for Data Scientists, 2016.
5. Christopher M. Bishop. Pattern Recognition and Machine Learning, Springer, 2013.
Instructor: Balasubramanian Raman
Office: S-227, CSE Building
Class Meeting Time: Mondays, Tuessdays and Thursdays (2-3 pm).
Class Room: APJ Abdul Kalam Block - 407
Office Hours: Tuesdays and Fridays, 11:00 a.m. - 1:00 p.m. and by appointment
TAs: Dr. Pradeep Singh (pradeep.cs at sric), Kishore Babu(kbabu89 at cs), Deepak Kumar (d_kumar at cs) and Diya Sati(diya_s at cs)
Email: first four letters of first name at cs dot ac dot in
Office: S-227, CSE Building
Class Meeting Time: Mondays, Tuessdays and Thursdays (2-3 pm).
Class Room: APJ Abdul Kalam Block - 407
Office Hours: Tuesdays and Fridays, 11:00 a.m. - 1:00 p.m. and by appointment
TAs: Dr. Pradeep Singh (pradeep.cs at sric), Kishore Babu(kbabu89 at cs), Deepak Kumar (d_kumar at cs) and Diya Sati(diya_s at cs)
Email: first four letters of first name at cs dot ac dot in
Announcements
May 05, 2023: ETE answer scripts have been distributedMay 05, 2023: Re-Quiz 1 has been conducted.
April 27, 2023: ETE has been conducted.
April 24, 2023: Quiz 2 has been conducted.
Assignment 5 has been posted.
April 06, 2023: Re-MTE has been conducted.
Assignment 4 has been posted.
March 01, 2023: MTE has been conducted.
Assignment 3 has been posted.
February 09, 2023: Quiz 1 has been conducted.
February 02, 2023: Assignment 2 has been posted.
January 20, 2023: Python Lab sheet 1 for Batch 02 has been posted.
January 19, 2023: Assignment 1 has been posted.
January 19, 2023: Python Lab sheet 1 for Batch 01 has been posted.
January 05, 2023: Classes have begun.
Course Objectives, Learning Outcomes and Prerequisites
This course provides an introduction to the fundamental concepts in machine learning and popular machine learning algorithms. We will cover the standard and most popular supervised learning algorithms including linear regression, logistic regression, decision trees, k-nearest neighbour, an introduction to Bayesian learning and the Naive Bayes algorithm, support vector machines and kernels and neural networks with an introduction to Deep Learning.
Prerequisites: Programming and Data Structures.
Prerequisites: Programming and Data Structures.
Evaluation Components
- Term tests/quizzes (10%)
- Assignments and Tutorials (10%)
- Mini Project(10%)
- Mid-Term Examination (30%)
- End Term Examination (40%)
Lecture Notes
01. Introduction to Machine Learning (09/01/2023)02. Different Types of Learning (10/01/2023)
03. Linear Regression-OLS and Introduction to Gradient Descent (12/01/2023)
04. Linear Regression-Gradient Descent, Prelimininary Statistics-Covariance, Correlation, Measures of Association in Regression (16/01/2023)
05. R-Squared, Adjusted R-Squared, Feature Engineering, Introduction to PCA (17/01/2023)
06. PCA and Introduction to Logistic Regression (19/01/2023)
06. Why Eigenvectors with the highest Eigenvalues maximize the variance in PCA? (19/01/2023)
07. Logistic Regression and Introduction to Probability Theory (23/01/2023)
08. Conditional Probability and Naive Bayes classifier (24/01/2023)
09. Problem Discussion (02/02/2023)
10. kNN and Loadings in PCA (06/02/2023)
11. Feature Selection and Introduction to LDA (07/02/2023)
12. Quiz 1 (09/02/2023), Solution (Posted on 13/02/2023)
13. LDA (13/02/2023)
13. Why Eigenvectors with the highest Eigenvalues maximize the separation between the classes in LDA? (13/02/2023)
14. k-Means Clustering and k-Modes clustering (16/02/2023)
15. Cost Function Optimization and Introduction to Regularization (20/02/2023)
16. Regularization, Convex Optimization (21/02/2023)
17. Heirarchichal Clustering and the Introduction to Decision Tree (27/03/2023)
18. Decision Tree (28/03/2023)
19. Optimisation in ML & Introduction to Neural Networks (30/03/2023)
20. Neural Networks (03/04/2023)
21. MLPs, Kernel Methods, Kernel Tricks, Activation functions, Forward Propogation, Backpropogation, Loss functions,Regularization Techniques (10/04/2023)
22 and 23. Backpropogation, Hidden Layers, Loss functions, Compute Gradients for Output Layer, General MLP Architecture and Optimization Algorithms (11/04/2023 and 13/4/2023)
24. CNNs, Convolution Operation, Pooling Layer, Fully Connected Layer, Backpropagation and Optimization (15/04/2023)
25 to 34. Mini Project Presentations (17/04/2023 to 26/04/2023)
35. Quiz 2 (24/04/2023), Solution (Posted on 24/04/2023)
36. Re-Quiz 1 (05/05/2023), Solution (Posted on 05/05/2023)
Assignments
01. Assignment 1 (Posted on 19/01/2023, due on 02/02/2023), Solution/Hint (Posted on 07/02/2023).02. Python Lab Sheet 1 for Batch 01 (Posted on 19/01/2023)
03. Python Lab Sheet 1 for Batch 02 (Posted on 19/01/2023)
04. Assignment 2 (Posted on 02/02/2023, due on 17/02/2023).
05. Assignment 3 .
06. Assignment 4 .
07. Assignment 5 .
- There will be four to seven assignments.
- Late assignments will be accepted, with a 10% penalty per day, up to five days.
- Submission procedure and other requirements will be stated in individual assignments.
- Students are responsible for backing up and protecting their work.
Examinations
01. Quiz 1 (09/02/2023), Solution (Posted on 13/02/2023)02. MTE (01/03/2023), Solution (Posted on 03/03/2023)
03. Re-MTE (06/04/2023), Solution (Posted on 06/04/2023)
04. Quiz 2 (24/04/2023), Solution (Posted on 24/04/2023)
05. ETE (27/04/2023), Solution (Posted on 27/04/2023)
06. Re-Quiz 1 (05/05/2023), Solution (Posted on 05/05/2023)
Extras
01. How to install anaconda in windows and ubuntu along with google colab (Posted on 20/01/2023)
Recommended Study Material
The following will be used as a reference/text book for this course:1. Mohri Mehryar, Afshin Rostamizadeh, and Ameet Talwalkar, Foundations of machine learning, MIT press, 2018.
2. Sammut, Claude, and Geoffrey I. Webb, Encyclopedia of machine learning and data mining, Springer, 2017.
3. Witten Ian H., Eibe Frank, Mark A. Hall, and Christopher J. Pal, Data Mining: Practical machine learning tools and techniques, Morgan Kaufmann, 2016.
4. Muller Andreas C. and Sarah Guido. Introduction to Machine Learning with Python: A Guide for Data Scientists, 2016.
5. Christopher M. Bishop. Pattern Recognition and Machine Learning, Springer, 2013.