CS 539: Machine Learning :: Summer 2024

Primary Textbook is

Additional course readings will be drawn from the following textbooks:

Tentative Schedule (subject to change)

Week #

Date

Topic

Readings

Homework

Quiz

Project

1

5/21

Course overview & Machine Learning, Framing a Learning Problem; Supervised Learning & Decision Trees

Flach: Prologue & Ch. 1, The Discipline of Machine Learning; Mitchell: Ch. 3

 

 

 

2

5/28

Decision Trees & Overfitting, Evaluation

k-Nearest Neighbor, Linear Regression; Gradient Descent

Flach: 2.1-3.2, LfD: 1.1, 3.1-3.2.1, Flach: 7.1,

Optional linear algebra review

HW1 out

 

Form a team by June 4

 

3

6/4

Linear Regression; Regularization, Linear Classification; Perceptron

Flach: 7.1, 7.2, 7.4

Basis functions

LfD: 3.3

HW2 out

Quiz1

 

4

6/11

Logistic Regression; Evaluation; Neural Network

LfD: 2, 3.2.2, Learning Theory Notes

Deep Learning

Backpropagation

http://neuralnetworksanddeeplearning.com/chap2.html

 

 

 

5

6/18

Deep Learning

DLP: 5.1; Convolutional Neural Networks

HW3 out

Quiz2

 

6

6/25

Deep Learning

DLP: 6.2

 

 

 

Proposal due by June 25

7

7/2

Support Vector Machines

Ensemble Methods;

Flach: 7.3, LfD: 8

Flach: 7.5, Bennett

Flach: 11

HW4 out

 

 

8

7/9

Naive Bayes; Text Classification; Word Vectors;

 

Unsupervised Learning: 

K-Means; GMMs;

Generative Model Notes
Flach: 9.1, 9.2

Distributed Representations of Words and Phrases and their Compositionality

k-means clustering

Flach 8.4

Mixture of Gaussians

 

 

Quiz3

 

9

7/16

Markov Decision Process; Reinforcement Learning;

 Sutton & Barto: Ch. 3, Ch. 4, Ch. 6, RL notes

 

 

 

10

7/23

Transfer Learning; Project Presentation (live session)

 

 

Quiz4 (7/23~7/24)

Website and Slides due by July 23

Peer & Self Evaluation Form by July 24