60 likes | 131 Views
This project involves crawling relevant URLs, searching for data, parsing HTML, extracting information, training an SVM classifier, and classifying multi-class data for database insertion with query parsing and information retrieval capabilities.
E N D
Software Agents for Web Mining FYP Project by: Shuchi Mittal Quek Siew Guat Patricia Professor: Franklin Fu
Monitor/Retrieval • Crawling relevant URL’s • Search for required data and links • HTML parsing and cleaning • Information Extraction • Transfer raw data to the Database
SVM Learn SVM Learner Training Data Classifier (Model) Testing or unknown Data SVM multi-class Classify Class A Class n Class B ……….. Classification • Data Pre-processing • Training Data and data cleaning • Multi-class Classification of data • Inserting classified data into the database
Matching/Dispatch • Query Parsing • Database Transaction • Data Cleaning • Information retrieval from the database • Interface and Display