An `AI in Design' View of Design
System Evaluation

Performance

What kind of performance criteria have been used, and how does the system perform based on these criteria?

e.g., time, memory, number of failures, amount of backtracking, conflicts, etc.

Discussion. Performance criteria give a quantitative measure of the system's behavior. Some of these criteria reflect the amount of resources consumed, of which time and memory are the most important. Network load or disk space are other examples. However, performance is also represented by factors representing the rate of success of the system. For example, the number of failures on the path to a solution or the amount of processing needed to recover from such failures. In distributed systems, similar factors are the number of conflicts and the overhead incurred by conflict resolution. Ratings of the generated design solution also reflect the performance of the design system.

Up : Next

/Papers/IJDC/sect7.3.html  			Thu May 29 18:05:26 EDT 1997