1 / 27

Tools for Knowledge Discovery: A Seven-Step Process Model

This chapter explores the KDD process model, scientific method application, and various tools for knowledge discovery in databases. Topics covered include goal identification, creating target datasets, data preprocessing, data transformation, data mining, interpretation and evaluation, and taking action.

gvillarreal
Download Presentation

Tools for Knowledge Discovery: A Seven-Step Process Model

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Part II Tools for Knowledge Discovery

  2. Knowledge Discovery in Databases Chapter 5

  3. 5.1 A KDD Process Model

  4. Figure 5.1 A seven-step KDD process model

  5. Figure 5.2 Applyiing the scientific method to data mining

  6. Step 1: Goal Identification Define the Problem. Choose a Data Mining Tool. Estimate Project Cost. Estimate Project Completion Time. Address Legal Issues. Develop a Maintenance Plan.

  7. Step 2: Creating a Target Dataset

  8. Figure 5.3 The Acme credit card database

  9. Step 3: Data Preprocessing Noisy Data Missing Data

  10. Noisy Data Locate Duplicate Records. Locate Incorrect Attribute Values. Smooth Data.

  11. Preprocessing Missing Data Discard Records With Missing Values. Replace Missing Real-valued Items With the Class Mean. Replace Missing Values With Values Found Within Highly Similar Instances.

  12. Processing Missing Data While Learning Ignore Missing Values. Treat Missing Values As Equal Compares. Treat Missing values As Unequal Compares.

  13. Step 4: Data Transformation Data Normalization Data Type Conversion Attribute and Instance Selection

  14. Data Normalization Decimal Scaling Min-Max Normalization Normalization using Z-scores Logarithmic Normalization

  15. Attribute and Instance Selection Eliminating Attributes Creating Attributes Instance Selection

  16. Step 5: Data Mining Choose training and test data. Designate a set of input attributes. If learning is supervised, choose one or more output attributes. Select learning parameter values. Invoke the data mining tool.

  17. Step 6: Interpretation and Evaluation Statistical analysis. Heuristic analysis. Experimental analysis. Human analysis.

  18. Step 7: Taking Action Create a report. Relocate retail items. Mail promotional information. Detect fraud. Fund new research.

  19. 5.9 The Crisp-DM Process Model Business understanding Data understanding Data preparation Modeling Evaluation Deployment

  20. 5.10 Experimenting with ESX

  21. A Four-Step Model for Knowledge Discovery Identify the goal. Prepare the data. Apply data mining. Interpret and evaluate the results.

  22. Experiment 1: Attribute Evaluation *Applying the Four-Step Process Model to the Credit Screening Dataset*

  23. Experiment 2: Parameter Evaluation *Applying the Four-Step Process Model to the Satellite Image Dataset*

  24. Figure 5.4 Satellite image data

More Related