CS6140 schedule

CS6140/4420 Machine Learning Section 3, Fall 2026

Week / Assignment	Topic / Lecture	Other Reading
9/10 - 9/17 Week 1: Intro, Regression HW 1 — Due: 9/22	Intro LinReg LinReg Intro LinReg Ridge Intro Regression Slides Lecture 1 Lecture 2 Normalization: When to Use What	Background: Probabilities Convexity1 Convexity2 Linear algebra Programming: MATLAB, Java, Python, R DHS 8.1-8.5 KMPP ch 16.2 DHS ch 5 (up to 5.4.2) KMPP ch 7 (up to 7.5) Regression, Advanced Topics (Bayesian views, Lasso closed form, further reading — not required for HW1/HW2)
9/17 - 9/24 Week 2: Decision Trees, Boosting, Features	DT DT Boosting KNN Decision Trees Boosting Distances and Similarities KNN Local Classifiers	DHS ch 9, 9.5 KMPP ch 16, 16.6, 27.6.2 AdaBoost: Slides \| Boosting the Margin \| Additive Logistic Regression \| AdaBoost/Hedge RankBoost LambdaMART JForests: Paper \| Code XGBoost Bagging ECOC: Lecture \| Slides \| Paper Active Learning: Notes \| Slides VC Dimension: Wikipedia \| Slides
9/24 - 10/1 Week 3: Gradient Descent HW2 — Due: 10/6	GD LogReg GD LogReg Gradient Descent, Logistic Regression Logistic Regression, Newton Lecture 3 Lecture 4	DHS ch 5 KMPP ch 7, 8 Newton's Method Logistic Regression
10/1 - 10/8 Week 4: Perceptron, Regularization	Perceptron Lecture 5 The Perceptron Regularization (Stanford) Regularized Logistic Regression (Ng) Regularized Logistic Regression (Ng)	Logistic Regression: Loss Functions, Convexity, Feature Selection
10/8 - 10/15 Week 5: SVM, Kernels HW3 — Due: 10/20	SVM SVM Kernel KernelPCA SVM SVM Lecture 5-6 Kernels Representer Theorem Lecture 7 Lecture 8 Lecture 9	DSH ch 5.11 KMPP ch 14 Optimization: Convex \| Constrained SMO: Notes (Stanford) \| Paper (Platt) Saddle-point SVM Tutorial (Burges) SVM: Wikipedia \| SVM and VC Dimension \| Notes (Ng) Kernel Methods: Slides \| Primer \| Paper Harmonic Functions
10/15 - 10/22 Week 6: PCA, Kernels	PCA Margins Lecture 17 PCA PCA, LDA Fisher LDA (optional)	PCA: DHS ch 10 KMPP ch 25 Margins and Feature Analysis for Boosting Haar Features: Wikipedia \| Slides \| Paper Indexing (optional) N-gram Matching (optional) CRFs for Text (optional) tSNE: Slides \| Paper \| Code \| Gradient Derivation (optional) Feature Engineering: Article \| Slides (Princeton) \| Slides (Berkeley)
10/22 - 10/29 Week 7: Generative HW 4 — Due: 11/3	GDA NaiveBayes Probability Primer Generative Intro GDA, Naive Bayes (Ng) GDA Lecture 9 Naive Bayes Missing Values, Naive Bayes Naive Bayes and Logistic Regression (CMU) Lecture 10 Bayesian Linear Regression — supports HW4 Problem 5	DHS ch 2, 3 KMPP ch 2, 3, 4 Smoothing Maximum Likelihood Naive Bayes Multivariate Normal: Wikipedia \| Marginal/Conditional Correlation Coefficient
10/29 - 11/5 Week 8: Generative, EM	GMM GMM Mixtures EM for Gaussian Mixtures EM Lecture 11+12 Lecture 13	KMPP ch 20, KMPP ch 11(EM) EM: Example \| Wikipedia \| Notes (Berkeley) \| Notes (other) \| Slides (other) Graphical Models: Factor Graphs (optional) \| Slides (Bishop) \| Book (Bishop) \| Video (Bishop): Part 1, Part 2, Part 3
11/5 - 11/12 Week 9: Neural Networks, Backprop, Autoencoders HW5 — Due: 11/17	NN AutoEnc Perceptrons, Neural Networks Lecture 18: NN Basics Intro to Neural Networks Visualizer : Neural Networks Activation Function Table Lecture 19: AutoEncoderNN, Word Vectors_NN, Activation — autoencoder part supports HW5 Problem 1	DHS ch 6 Neural network toy example Other slides (Mitchell) BackPropagation: Article (Brilliant) \| Paper (Ron Williams)
11/12-11/19 Week 10: Generative Neural Networks: VAE, GAN	Variational Autoencoders (VAE) — supports HW5 Problem 3 Generative Adversarial Networks (GAN) — supports HW5 Problem 4	EM for Gaussian Mixtures (Week 8) — background for the EM/VAE/GAN continuity in HW5 Problems 3–4
11/19 - 11/26 Week 11: Adv NN, CNN HW6 — Due: 12/1	AdvNN CNN Lecture 7/23 : Adv NN intro Lecture 7/25 : Convolution NNets (d2l slides w/ annotations) basic CNN (d2l html+ pytorch) Modern CNN (d2l html+ pytorch)
11/26-12/3 Week 12: RNN, LSTM	RNN Seq2Seq Lecture 7/30 : Recurrent NNets, LSTM, GRU (d2l slides w/ annotations) RNN (d2l html+ pytorch) Lecture 8/1 : RNN : Encoder-Decoder, Seqence-to-Sequence, Machine Translation (d2l slides w/ annotations) RNN-Modern (d2l html+ pytorch)
12/3 - 12/10 Week 13: Word Vectors, Attention HW7 — Due: 12/15	Word2Vec Attention Lecture 8/13 : NLP, Word-To-Vec, Glove Embedding (d2l slides w/ annotations) — supports HW7 Problem 1 NLP, Word Embedding (d2l html+ pytorch) Lecture 8/6 : Attention Mechanic (d2l slides w/ annotations)	Simple Word-2-Vec tutorial
12/10 - 12/17 Week 14: Self-Attention, Transformers	Transformer Attention and Transformers (d2l html+ pytorch) Lecture 8/8 : Self Attention & Transformers (d2l slides w/ annotations)
Final Exam week (date TBD)	Final Exam: theory, on paper, in class. You may bring your own written notes; no devices allowed. Do not expect pure math derivations/calculations. Instead, expect questions on key algorithmic points related to class material, and possible simple modifications for a specific purpose.