Agent-Based Hybrid Intelligent Systems and Their Dynamic Reconfiguration

1. Agent-Based Hybrid Intelligent Systems and Their Dynamic Reconfiguration Zili Zhang Faculty of Computer and Information Science Southwest University zhangzl@swu.edu.cn Acknowledgement: Pengyi Yang, Li Tao

2. Roadmap • Background and Motivation • The Genetic Ensemble (GE) Hybrid System • Problem Definition • Overview of the GE System • Experimental Results • Advantages of the GE System • Dynamic Reconfiguration • Dynamic Reconfiguration Model • The Algorithm for Dynamic Reconfiguration • Experiments and Evaluation • Conclusions

3. Background and Motivation • A few years ago, we proposed an agent-based framework for complex problem solving (Z. Zhang & C. Zhang, Agent-Based Hybrid Intelligent Systems: An Agent-Based Framework for Complex Problem Solving, LNAI2938, Springer, 2004.) • This framework was applied to: • Financial Investment Planning (PRICAI’02) • Data Mining etc (Applied AI, 2003)

4. Our Understanding • Hybrid approaches are required for many complex problems • Better results can be achieved when these techniques are combined in hybrid intelligent systems • Agent technology is well suited to model the manifold interactions among the many different components of hybrid intelligent systems

5. In Bioinformatics • Hybrid algorithms can be used to solve a variety of problems in bioinformatics • The hybrid algorithm often improves on either a single algorithm, in terms of performance, or in the transparency of its results • There are numerous ways in which algorithms can be combined (E. Keedwell and A. Narayannan: Intelligent Bioinformatics – The application of AI techniques to bioinformatics problems, Wiley, 2005 [Ch. 11])

6. The GE Hybrid System • Z. Zhang. P. Yang, X. Wu, and C. Zhang, An Agent-based Hybrid System for Microarray Data Analysis, IEEE Intelligent Systems,Sept./Oct. 2009.

7. Problem Definition • To identify biologically important genes and to improve data classification accuracy, we need to develop effective gene selection measures. • Currently, there are a lot of gene selection strategies available. Several studies set out to compare the strength and the weakness of each method. The comparison results tell us that with different datasets different methods often perform unevenly. • Instead of choosing one method for one situation, we combine different methods to create a more accurate and general hybrid system—the GE system.

9. Classifiers • Integrated classifiers: • Decision Tree (DT) • Random Forest (RF) • 7-Nearest Neighbors (7NN) • Naïve Bayes (NB) • 3-Nearest Neighbors (3NN)

10. Blocking Committee • Suppose a total of n classifiers each creates a different hypothesis denoted as while classifying the data using gene subset s. The fitness function derived from blocking integration strategy can be defined as follows: Where y is the class label and C(.) is the accuracy Evaluation function which can be calculated by cross Validation etc.

11. Voting Committee • Suppose a total of n classifiers each creates a different hypothesis denoted as while classifying the data using gene subset s. The fitness function derived from voting integration strategy can be defined as follows: Where y is the class label, k is the number of classifier in voting, and V(.) is the voting function of a given classifier.

12. Filters • Gain Ratio • ReliefF where d denotes the number of genes in subset s, and is the jth gene in subset s.

13. Why Choosing these algorithms? • We based the selection of classifiers for GE hybrids on their sample classification accuracy and diversity from other classifiers. • For the filter components, we favored those that are consistent with classifier components.

14. By Implementing different algorithms in terms of agents, we can test different combinations by forming different multiagent systems at runtime rather than at design time. • We no longer need to modify the code each time we test a new combination. • Therefore, in a given time frame we can investigate many more algorithm combinations than we could using traditional methods.

15. Experimental Results • Datasets

16. Gene Subset Size Determination

17. Classification Results

19. Reproducibility

20. Advantages of the GE System • Evaluate gene subsets from multiple aspects. • Select better generalization gene profiles. • Avoid selection bias of certain feature evaluation method. • Allow different selection and evaluation methods to be integrated at ease. • Achieve higher classification accuracy while also obtain better selection stability

21. Dynamic Reconfiguration • Given the scale and complexity of real-world applications, it is increasingly important that complex software systems operating in dynamic operational environments call for dynamic reconfiguration (self-configuration, self-organization) property. • Such software systems should reorganise automatically with environments and tasks changes as we can not pre-define everything at the design time.

22. Observations • Today’s complex problem solving systems often fail because of the wrong configuration or static organization. • In this context, to fail means to produce incorrect solutions, solutions of unacceptable bad quality or to spend unreasonable time and resources.

23. How to Model Dynamic Configuration • Autonomic computing perspective • Self-organization perspective • Ecological perspective (F. Zambonelli, Self-Management and Many Facets of “Nonself”, IEEE IS, March/April, 2006, pp. 53-55.)

24. Autonomic computing perspective

25. Self-organization perspective

26. Ecological perspective

27. Using AOC to Model Dynamic Reconfiguration • Autonomy-Oriented Computing (AOC) is an emerging computational paradigm that draws on theprinciples of self-organization and complexsystems [Jiming Liu et al] • A formal framework of AOC consists of a population of autonomous entities and the rest of the system referred to as the environment. • An autonomous entity consists of a detector (or a set of such), an effector (again, there can be a set of such) and a repository of local behavior rules.

28. Specifically, using AOC framework to model dynamic reconfigurationof agent-based systems, we need toclearly describe what are the environment, primitive behaviors andbehavioral rules of autonomous entities (here agents), and theinteractions between agents and their environment.

29. Once we have done these, the dynamicreconfiguration of agent-based systems is then reduced to theself-organization of AOC systems.

31. A heuristic algorithm (HIERA) has beendeveloped to support the organization formation behavior in dynamicreconfiguration.

32. The HIERA algorithm • Initialization: initialize the parameters of CAgents,including searching steps, primitive behaviors probability, and soon. • Search: use local-searching algorithm to search appropriateMAgent. • Behavior Selection: use Roulette method toselect primitive behaviors according to different behaviorprobability, and use heuristic rules to modifybehavior probabilities

33. Based on the experiments conducted, HIERA algorithmcan converge in an acceptable time • It can change its searchingstrategy adaptively according to differentenvironments.

34. Conclusions • Hybrid approaches are required for many complex problems • Agent-based approaches are suitable for building hybrid systems in general, and that a genetic ensemble system is appropriate for microarray data analysis in particular. • Dynamic reconfiguration is crucial for complex software systems

35. Future Work • Trustworthiness of agent-based systems with dynamic reconfiguration capability • Trusted computing initiative • Trusted Software initiative in China

36. Questions and Comments?