CS 525D Spring 2004

Computer Science Department

Due Date: April 6th 2004 at 3:00 pm

For the construction of classification rules we will use both the PRISM algorithm (implemented in the Weka system) and the FOIL algorithm.

Construct, using a FOIL-like algorithm, the most accurate hypothesis (i.e. set of rules) you can to predict the target attribute of each of your datasets. The following are guidelines to use a FOIL-like algorithm to mine your patterns:
- Code: I strongly encourage you to use a version of FOIL available online, for instance the one available at Quinlan's Webpage or a more recent one if you find one. However, you can implement your own code if you prefer.
- Instances: You can restrict your experiments to a subset of the dataset if your system cannot handle the whole dataset. But remember that the more accurate your system is, the better.
Compare the set of rules produced by the two algoritms (i.e., Prism and Foil).

Written Report. Your written report is due at 3:00 pm. Please hand it in at the beginning of class. Your report should contain the following sections with the corresponding discussions:
1. Code Description: Describe the code that you used/wrote. DESCRIBE IN DETAIL THE ALGORITHM USED IN THE CODE, that is, the Prism algorithm and the Foil algorithm. Remember to acknowledge any sources of information/code you used for the implementation of your system.
2. Experiments: For each experiment you ran describe:
  - Your system parameters.
  - Instances: What data did you use for the experiments?
  - Any pre or post processing done to improve the accuracy of your results.
  - Accuracy of the resulting rules.
3. Summary of Results
  - What was the accuracy of the most accurate set of rules you obtained?
  - Discuss how this accuracy compares with that of your most accurate results from the previous assignments and with the accuracy of the set of rules constructed with the other method (Foil or Prism) used in this project.
  - Include the most accurate set of rules you obtained in your report.
  - Discuss the strengths and the weaknesses of your project.
Oral Report. We will discuss the results from the individual projects during the class on April 6th 2004. Be ready to show your results and to discuss your project in 7 minutes durin class. PREPARE SLIDES SHOWING YOUR WORK.