CS534 Spring 2019 - Lecture Notes

Computer Science Department

CS534 Artificial Intelligence
Lecture Notes - Spring 2019

Lecture Notes: Robotics

Russell's & Norvig's book slides - Robotics

Lecture Notes: Machine Vision

Lecture Notes: Natural Language Processing (NLP)

Useful Slides and Class Handout:
- NLP Slides - Prof. Ruiz
- Prof. Ruiz's CS4341 B term 2003 Exam 2 Problem IV solutions.
Other Useful Material:

Lecture Notes: Machine Learning

Useful Pointers, Slides and Class Handout:
- Mitchell's book Chapter 1 - Intro
- Prof. Ruiz's Brief Intro to Machine Learning
- See Prof. Ruiz's Intro to Data Mining for more sample applications
- Decision Trees
  - Mitchell's book Chapter 3 - Decision Trees
  - Russell's & Norvig's book slides - Decision Trees
  - Prof. Ruiz's lecture materials:
    - credit_history.arff used in the Decision Trees handout and slides
    - Prof. Ruiz's Decision Trees slides
    - Prof. Ruiz's Decision Trees handout
    - Additional resources (e.g., additional slides, examples, homework problem solutions) at: Prof. Ruiz's Lecture Notes on Decision Trees
- Artificial Neural Networks
  - Mitchell's book Chapter 4 - Artificial Neural Networks
  - Russell's & Norvig's book slides - Neural Networks
  - Prof. Ruiz's lecture materials:
    - Prof. Ruiz's Artificial Neural Networks slides
    - Additional resources at: Prof. Ruiz's Lecture Notes on Neural Networks
- Bayesian Learning
  - Mitchell's book Chapter6 - Bayesian Learning
  - Russell's & Norvig's book slides - Bayesian Networks
  - Prof. Ruiz's lecture materials:
    - credit_history.arff used in the Bayesian Models handouts
    - Prof. Ruiz's Naive Bayes handout
    - Prof. Ruiz's Bayesian Networks handout
    - Additional resources (e.g., additional slides, examples, homework problem solutions) at: Prof. Ruiz's Lecture Notes on Bayesian Models
- Support Vector Machines (SVMs)
- Deep Learning
  - Prof. Ruiz's Lecture Notes on Deep Learning
- Reinforcement Learning
  - Prof. Ruiz's Lecture Notes on Reinforcement Learning
- Read the Web: Research Project at Carnegie Mellon University

Lecture: Uncertainty & Probabilistic Reasoning

Useful Slides and Class Handout:

Lecture Notes: Planning

Useful Slides and Class Handout:
- Russell and Norvig's textbook slides - Chapter 11
Other Useful Material:

Lecture Notes: Logic

Useful Pointers, Slides and Class Handout:
- Kabir's selected slides from Russell and Norvig's Chapter 7
- Prof. Ruiz's Logic-Based Systems - ppt Slides or pdf Slides
- Propositional Logic - Russell and Norvig's textbook slides - Chapter 7 (pdf)
- First Order Logic - Russell and Norvig's textbook slides - Chapter 8 (pdf)
- Reasoning with First Order Logic - Russell and Norvig's textbook slides - Chapter 9 (pdf)
- See Andrew Sawchuk's solutions to HW4
Other Useful Material:
- Association for the Advancement of Artificial Intelligence (AAAI) - Reasoning
- EQP: Equational Prover
- Prolog
  - Wikepedia: Prolog
- Links contributed by the CS534 Spring 2013 Cisco students:
  - ProVerif: Cryptographic protocol verifier in the formal model
  - Protégé Project:
    - Stanford's Protégé Project
    - Protégé OWL Tutorial
  - J. Urban and Vyskocil. "Theorem Proving in Large Formal Mathematics as an Emerging AI Field". 2012.
    - The Mizar Project
  - Cycorp
  - Expert Systems (lots of examples of expert systems are available online)

Lecture Notes: Constraint Satisfaction PBMs

Russell and Norvig's textbook slides - Chapter 6 (pdf)

Lecture Notes: Adversarial Search

Useful Pointers, Slides and Class Handout:
- Russell and Norvig's textbook slides - Chapter 5 pdf
- MIT's AI Demo: Games (by Winston)
Sample online game playing systems using AI:
- Association for the Advancement of Artificial Intelligence (AAAI) - AI Topics - Games & Puzzles
- Interesting AI Demos and Projects - See Game Design and Playing
- Chess
  - IBM's Deep Blue
  - Chess Tree Search
- Go
  - AlphaGo
- Checkers
  - Chinook
  - Book: Blondie24 - Playing at the Edge of AI and system. This checkers system uses a minimax search based on a utility function implemented via a neural network trained using a genetics algorithm.
- Go-moku
  - Gonoku Online (5-in-a-row)
- Tic-Tac-Toe:
  - 3D Tic-tac-toe. http://www.geometrygames.org/SoS/
  - 3D Tic-tac-toe. http://www.hpmuseum.org/software/41td/ttt3d.htm
- Connect-4: (just some of the multiple related sites are included below)

Lecture Notes: Search

Useful Pointers, Slides and Class Handout:
- Search, Blind Search, Heuristic Search:
- Genetic Algorithms:
  - Tom Mitchell's Machine Learning Slides on Genetic Algorithms

Lecture Notes: Introduction to AI and Agents, Search

Useful Pointers, Slides and Class Handout:
- Introduction to AI:
  - Kabir's and Ruiz's slides
  - Russell and Norvig's textbook slides - Chapter 1
- Agents: