CS Data Collection

---

Based on the Objectives and Outcomes the WPI Computer Science department uses a variety of methods of measurement to collect data. We analyze it, evaluate it, present it to the department faculty, discuss it, and try to make adjustments that reduce perceived weaknesses while maintaining perceived strengths. Some methods generate little analyzable data, but instead provide an opportunity for reflection about the state of the department.

In no particular order:

• CS Alumni Survey
  The CS department Alumni who graduated with BS degrees 5, 10 and 15 years previously are surveyed every year to establish how important they feel each Objective is, and how well WPI CS prepared them relative to each Objective.
• MQP Review Report
  At regular intervals determined by the WPI Administration the department undertakes a significant review of the content and quality of that year's MQPs. Many of the outcomes are assessed, as well as the correlation between perceived quality and grade assigned. The most recent studies were done in 2001 and 2006.
• MQP Presentation Evaluations
  In April every year all graduating students present their MQPs to their departments. The CS department also has an opportunity for this in December. Every project is presented publically. The CS faculty evaluate every presentation using a form. The resulting data is mostly used to evaluate presentation skills.
• Advisor's Evaluation of MQP
  Every MQP has a faculty advisor. CS advisors provide an evaluation of every completed MQP via a web form, based on the CS Outcomes. The resulting data is used to provide a view of how well MQPs are supporting outcomes.
• Transcripts of Seniors
  Transcripts of students applying for graduation are checked by the Registrar's Office using a program that ensures that departmental requirements are being met. In addition their records are reviewed by a faculty member to indicate specific problems to the student if there are any, or to indicate approval. This ensures that all students graduating meet WPI and the department's course distribution requirements.
• Transcripts of Graduates
  Occasionally, a small, randomly selected sample of transcripts of recent graduates are reviewed to monitor trends.
• Course Enrollments
  Course enrollments are monitored regularly to ensure that enough sections of courses are offered so that majors can graduate on time.
• Advisory Board Report
  Regular CS Advisory Board meetings provide feedback to the department head, and offer suggestions about improvements and future directions.
• CDC Report
  The Career Development Center provides an annual report summarizing internships, post-graduation employment, and attendance at graduate school.
• NSSE
  WPI participates in the National Survey of Student Engagement.
• EBI
  WPI participates in the EBI Survey of exiting seniors. We include CS Majors in the survey, even though the survey is directed towards Engineering students.
• Student evaluations of courses
  At the end of every term students evaluate the course and instructor for every course in which they are registered. Faculty get an electronic report of their evaluation. The department head also gets information about every evaluation. This allows teaching quality, as it varies across instructors an courses, to be monitored.
• Course to Outcomes mapping
  Every course has a mapping of intended educational outcomes for the course to the CS department's outcomes, associated with the methods for measuring whether that outcome was achieved -- typically projects, exams, portfolios, etc. Typically this mapping is included in the web pages for the course.
• Faculty Retreat
  The department holds a faculty retreat whenever possible, with the goals of reviewing recent self-assessment data, evaluating current strengths and weaknesses, and proposing solutions to problems. Typically the list of action items is addressed by appropriate departmental committees during the following year(s). The most recent retreat was held in August 2007.
• Department meetings
  CS Department meetings are held every three weeks during the academic year. A variety of issues are discussed, including staffing, new courses, changes to regulations, and collected data.
• Education Committee meetings
  The CS Education Committee continually reviews the CS curriculum and responds to suggestions from the CS Faculty, the CS Department Head, and the CS Assessment Coordination Committee. Proposed revisions to regulations, proposed new courses, or any other important issues are raised at CS Department meetings. Those presented as motions are discussed and may result in changes to the CS regulations or curriculum, once approved by the WPI faculty.
• TA Evaluations
  Most undergraduate courses are run with the help of Teaching Assistants. At the end of every class the faculty instructor provides an evaluation of the TAs. The TA Coordinator uses this data to provide better assignments of TAs for each course, in order to ensure the best support for the faculty and the undergraduate students.
• Faculty Evaluations
  Every year each faculty member prepares an activity report about research, teaching and service for that year and delivers it to the Department Head, and subsequently the Provost, for their evaluation. The Department Head provides an evaluation of the faculty member, and discusses strengths, weaknesses and plans with them.

• Annual Report
  The department's annual report provides an opportunity to reflect on and summarize the state of the department, including the Undergraduate and Graduate programs, facilities, funding, research, and staffing.
• Student reported workload
  In the Student evaluations of courses they report how much time they spent working on the course. Recently this data was summarized and profiled for discussion at the Retreat. It provides a way of determining whether the 1000, 2000, 3000 and 4000 level courses are hard enough (or too hard) for their category. For each class, WPI expects at least 17 hours of work per week, including class and laboratory time.
• Percentage of students taking courses
  Recently data was collected about what percentage of our majors take each course. As we provide distribution requirements, allowing student choice, this provides feedback about the impact of Advising and the Catalog on student course selection.
• IQP Review Report
  At regular intervals (usually yearly) determined by the WPI Administration an evaluation is done of a large sample of the IQPs done at WPI.