“Roadmap Endorsement” -- comments and elaborations

1. “Roadmap Endorsement”-- comments and elaborations The Third Workshop of EchoGRID Project June 9-10, Athens, Greece

2. Comments on Grid Management • About myself • One of the finest parts in the roadmap document • Observation/opinion about GM in grid research – agreed • FCAPS×layers – an innovative framework to address the issues • Further elaborations • A domain specific cloud

3. About myself • Fully involved in ChinaGrid – another grid research activity in China • Partially involved in CNGrid • Especially, have deployed and been operating the realcourse grid since 2003 • http://realcourse.grids.cn • Simplistic application – distributed university lecture videos on demand – a good test for baseline • Over 40 universities’ participation across 15 cities, over 10,000 users every day • Operational/management cost -- $50,000/year

4. About the roadmap • In general, the roadmap is a fine document – I’ve learnt a lot from it • very informative • EU and China in one perspective • The grid management part is particularly well elaborated • visionary, utility model • innovative framework • 3,5,10 years detailed roadmap with different levels of emphases

5. Opinions agreed • “grid management has been a non-priority topic in the research world” • “should be an explicit focus of research” • “without grid management practices in place, the funding for these initiatives will lack clear motivation.”

6. FCAPS×layers A nice way to address grid management issues

7. FCAPS applied to realcourse • Fault • MQ + email + telephone • Configuration • A script run 20 minutes to incorporate a new node + heart beating for adjustment • Accounting • Resource trading • Performance • Monitor based server selection • Security • Learning attack patterns and enforce some policy

8. As we look at the four tables • Issues raised – so that we know what to work on – recommendation to funding agencies • it would be better if goals are also specified – so that we know for what we can declare success in reaching a milestone

9. Further elaborations • What are the key (or bottleneck) challenges in grid management ? • Issues in the tables are just too many • Go back to the origin • Essence of grid: “widely distributed secure sharing of different ownerships” • Essence of management: make things done effectively, efficiently, and economically • Technological, economical, or political? • successful management practices exist – telecom, Internet, distributed IT/computing infrastructure within a big company, such as Amazon/Google/IBM/HP, etc.

10. Further elaborations • How to be “relevant” ? • As we see the industry moves fast, SOA, cloud computing, … • Industry evolvement is very much emphasized in the roadmap, which is crucial for the future development • “to engage” or “to be engaged”, and how

11. Further elaborations • What grid applications will be pervasive ? • If no much, where the economy of scale comes from ? • Electricity, applications are of course pervasive • Internet, email, browsing, etc. are pervasive • Incentives for one to get engaged on the grid • Minimized effort to maintain the engagement • Maximized ease of using others resources • Best-effort service vs. guaranteed service • Internet vs. telecom • It got to be an interdisciplinary studies • Economist, sociologist, computer scientist, practitioners, …

12. An Domain Specific Cloud • 100TB storage, installed • Webinfomall -- Chinese web archive since 2001 • 30 billion pages, with 1-2 million increment every day • TFS – an implementation of GFS, done ! • TMR – an implementation of MapReduce, done ! • TBT – an implementation of BigTable, working on • Maze – a P2P file sharing system, deployed and operated since 2003 • Tianwang – a search engine since 1997 • Web search and mining API based on Webinfomall, working on