Schedule

Date Topic Notes Reading Assignment out/due
9/4/2014 Introduction, Intelligent Agents Course Introduction, A scattered history of AI, AI in sci fi, AI today, AI agents. In addition to the Python/autograder tutorial linked to the right, feel free to have a look at the official Python Tutorial. Ch 2 Python/autograder Tutorial (optional, but recommended). This introduces you to Python and the autograder.
9/11/2014 Classical search Classical search. Ch 3, Ch 4.1 -- 4.3 PA 1 out
9/18/2014 Adversarial search Adversarial search Ch 5.1 -- 5.4 HW 1 out
9/25/2014 Class Cancelled Ch 6.1 -- 6.3 PA 1 due, PA 2 out
10/2/2014 Constraint Satisfaction Constraint Satisfaction Ch 13 HW 1 due
10/9/2014 CSPs, Probability Background Ch 14.1 -- 14.5 PA 2 due , HW 2 out
10/16/2014 MDPs, Reinforcement Learning Markov Decision Processes SB 3.1--3.3, 3.5--3.6, SB 4.1--4.4, SB 6.5 PA 3 out, HW 2 due
10/23/2014 Midterm Exam, MDPs, reinforcement learning Here is a Java applet that illustrates q-learning in a very simple gridworld environment. This one illustrates value iteration. This one illustrates reinforcement learning applied to the inverted pendulum task. This one illustrates a robot learning to flip pancakes using reinforcement learning. This one is a video of q-learning (w/ dyna updates) in a grid world. This one is a video of the one-legged walker from the homework assignment.
10/30/2014 Bayes Networks, HMMs Hidden Markov Models / Bayes Filtering / Particle Filtering. Example of HMM (slides from UC Berkeley). Dieter Fox PF example. Ch 15.1 -- 15.3 PA 3 due, PA 4 out
11/6/2014 Bayes Networks Bayes Networks Project title and abstract due (CS4100 only).
11/13/2014 Nieve Bayes, Linear Classifiers Machine Learning Ch 18.1--18.2, 18.6--18.9 PA 4 due. By this date, CS4100 students must have met w/ instructional staff and obtained green-light for project (CS4100 only).
11/20/2014 ML More Machine Learning. Zisserman's slides on SVM application to person detection. Ch 20 PA 5 out, HW 3 out,
11/27/2014 THANKSGIVING
12/4/2014 ML review; robotics; course wrapup PA 5 due, HW 3 due. Solutions
12/11/2014 In-class final exam (cs5100 only), 6-9pm. Closed book. I will allow students to bring 2 pages of paper containing notes of any form to the exam.
12/12/2014 Projects due (CS4100 only). Project reports should have this format.


Important note: unless noted otherwise, all readings and assignments are due on the day that they appear in the schedule.

Unless noted otherwise, all readings are from Artificial Intelligence: A Modern Approach, 3rd Ed., Russell and Norvig.