ver patterns along multiple dimensions. In fact, there are many cases where no single dimensional view can correctly represent the semantics of influence because the influence ratios will always be off regardless of how one aggregates. See the paper: OLAP & Data Mining: Bridging the Gap for a detailed discussion of this.
Question 6: Types and Classes of Patterns Discovered
a) How powerful and general are the patterns the system can discover and express?
b) Can the system mix different pattern types, e.g. influence and affinity patterns?
c) Can the system discover time-based patterns and trends?
The format of the patterns discovered by the system is very general and goes far beyond decision trees or simple affinities. The advantage to this is that the general rules discovered are far more powerful than decision trees. Decision trees are very limited in that they cannot find all the information in a database. Being rule-based keeps the system from being constrained to one part of a search space and makes sure that many more clusters and patterns are found -- allowing the system to provide more information and better predictions.
Question 7: System Initiative
a) Does the system use its own initiative to perform discovery or is it guided by the user?
b) Can the system discover unexpected patterns by itself?
c) Can the system start-up by itself on a weekly or monthly basis and perform discovery?
In some cases the user has to interact and guide the system, e.g. build a decision tree. However, a better approach is for the system to use its own initiative in the data mining process, forming hypothesis automatically based on the character of the data. The system should start-up by itself, select the significant patterns in the data and filter the unimportant trends. The analyses should be done routinely on a weekly or monthly basis.
Question 8: Treatment of Data Types
a) Are all data types handled in their own form or translated to other types?
b) Can the system find numeric ranges in data by itself?
c) Do a large number of non-numeric values cause problems for the system?
The system should manage all data types in a uniform manner and in their native formats, i.e. numbers, dates and constants should remain numbers, dates and constants internally. Interesting ranges in the data should be discovered by the system, not requiring "number bin" construction by the user. A large number of constant values in the database should not choke the system.
Question 9: Data Dependencies and Hierarchies
a) Can the system be told about the functional dependencies in our database?
b) Does the system understand the concept of data hierarchy?
c) How does the system use dependencies and/or hierarchies for discovery?
The system should be capable of using the functional (and other dependencies) that exist in a database. The use of these dependencies can significantly enhance the power of a discovery -- in fact ignoring them can lead to confusion. The system should understand the concept of hierarchy and should be able to use it for discovery along multiple dimensions.
Question 10: Flexibility and Noise Sensitivity
a) How brittle is the system when dealing with noisy data?
b) How well does the system cope with data exceptions and low quality data?
c) Can the system provide statements with flexible numeric ranges discovered by itself in the data?
The system should not be sensitive to noise and should internally use fuzzy logic to smooth data brittleness. As the data gathers noise, the system should only reduce the level on confidence associated with the results provided, not suddenly change direction in discovery. However, the system should still produce the most significant findings from the data set, even if noise is present.