CS4341 A Term 2017 - Lecture Notes

Computer Science Department

CS4341 Introduction to Artificial Intelligence
Lecture Notes - A term 2017

Lecture Notes: Robotics

Russell's & Norvig's book slides - Robotics

Lecture Notes: Machine Vision

Lecture Notes: Natural Language Processing (NLP)

Useful Slides and Class Handout:
- NLP Slides - Prof. Ruiz
- Prof. Ruiz's CS4341 B term 2003 Exam 2 Problem IV solutions.
Other Useful Material:

Lecture Notes: Machine Learning

Useful Pointers, Slides and Class Handout:
- Mitchell's book Chapter 1 - Intro
- Prof. Ruiz's Brief Intro to Machine Learning
- Decision Trees
  - Mitchell's book Chapter 3 - Decision Trees
  - Russell's & Norvig's book slides - Decision Trees
  - Prof. Ruiz's lecture materials:
    - credit_history.arff used in the Decision Trees handout and slides
    - Prof. Ruiz's Decision Trees slides
    - Prof. Ruiz's Decision Trees handout
    - Additional resources (e.g., additional slides, examples, homework problem solutions) at: Prof. Ruiz's Lecture Notes on Decision Trees
- Artificial Neural Networks
  - Mitchell's book Chapter 4 - Artificial Neural Networks
  - Russell's & Norvig's book slides - Neural Networks
  - Prof. Ruiz's lecture materials:
    - Prof. Ruiz's Artificial Neural Networks slides
    - Additional resources at: Prof. Ruiz's Lecture Notes on Neural Networks
- Bayesian Learning
  - Mitchell's book Chapter6 - Bayesian Learning
  - Russell's & Norvig's book slides - Bayesian Networks
  - Prof. Ruiz's lecture materials:
    - credit_history.arff used in the Bayesian Models handouts
    - Prof. Ruiz's Naive Bayes handout
    - Prof. Ruiz's Bayesian Networks handout
    - Additional resources (e.g., additional slides, examples, homework problem solutions) at: Prof. Ruiz's Lecture Notes on Bayesian Models
- Support Vector Machines (SVMs)
- Deep Learning
  - Prof. Ruiz's Lecture Notes on Deep Learning
- Reinforcement Learning
  - Prof. Ruiz's Lecture Notes on Reinforcement Learning
- Read the Web: Research Project at Carnegie Mellon University

Lecture Notes: Planning

Useful Slides and Class Handout:
- Russell and Norvig's textbook slides - Chapter 11
Other Useful Material:

Lecture Notes: Logic

Useful Pointers, Slides and Class Handout:
- Kabir's selected slides from Russell and Norvig's Chapter 7
- Prof. Ruiz's Logic-Based Systems - ppt Slides or pdf Slides
- Propositional Logic - Russell and Norvig's textbook slides - Chapter 7 (pdf)
- First Order Logic - Russell and Norvig's textbook slides - Chapter 8 (pdf)
- Reasoning with First Order Logic - Russell and Norvig's textbook slides - Chapter 9 (pdf)
- See Andrew Sawchuk's solutions to HW4
Other Useful Material:
- Association for the Advancement of Artificial Intelligence (AAAI) - Reasoning
- EQP: Equational Prover
- Prolog
  - Wikepedia: Prolog
- Links contributed by the CS534 Spring 2013 Cisco students:
  - ProVerif: Cryptographic protocol verifier in the formal model
  - Protégé Project:
    - Stanford's Protégé Project
    - Protégé OWL Tutorial
  - J. Urban and Vyskocil. "Theorem Proving in Large Formal Mathematics as an Emerging AI Field". 2012.
    - The Mizar Project
  - Cycorp
  - Expert Systems (lots of examples of expert systems are available online)

Lecture Notes: Constraint Satisfaction PBMs

Russell and Norvig's textbook slides - Chapter 6 (pdf)

Lecture Notes: Adversarial Search

Useful Pointers, Slides and Class Handout:
- Russell and Norvig's textbook slides - Chapter 5 pdf
- Piotr Mardziel's Minimax Script. Note: Piotr implemented this script as solution to Part 1 of Project 2 - CS4341 B03
- MIT's AI Demo: Games (by Winston)
Sample online game playing systems using AI:
- Game AI Resources
- Association for the Advancement of Artificial Intelligence (AAAI) - AI Topics - Games & Puzzles
- Interesting AI Demos and Projects - See Game Design and Playing
- Chess
  - Chess Tree Search
- Checkers
  - Book: Blondie24 - Playing at the Edge of AI and system. This checkers system uses a minimax search based on a utility function implemented via a neural network trained using a genetics algorithm.
  - Checkers
- Go-moku
  - http://www.cs.fiu.edu/~longy/five.html
- Tic-Tac-Toe:
- Connect-4: (just some of the multiple related sites are included below)

Lecture Notes: Search

Useful Pointers, Slides and Class Handout:
- Search, Blind Search, Informed Search, Heuristic Search:
  - Russell and Norvig's textbook slides:
    - Chapter 3 (uninformed and informed search),
    - Chapter 4 (local search)
  - Prof. Ruiz's and Kabir's slides: animation of search methods in Romania's map example
  - Prof. Ruiz's slides: summary of all search methods
  - Solutions to old HW1
  - MIT's AI Demo: Map search (by Winston)
- Genetic Algorithms:
  - Tom Mitchell's Machine Learning Slides on Genetic Algorithms

Lecture Notes: Introduction to AI and Agents, Search

Useful Pointers, Slides and Class Handout:
- Introduction to AI:
  - Kabir's and Ruiz's slides
  - Russell and Norvig's textbook slides - Chapter 1
- Agents: