350 likes | 513 Views
The UK e -Science Program: Next Generation Grid Applications. Tony Hey Director of UK e-Science Core Program Tony.Hey@epsrc.ac.uk. e-Science and the Grid.
E N D
The UK e-Science Program: Next Generation Grid Applications Tony Hey Director of UK e-Science Core Program Tony.Hey@epsrc.ac.uk
e-Science and the Grid ‘e-Science is about global collaboration in key areas of science, and the next generation of infrastructure that will enable it.’ John Taylor, DG of UK OST • Requirements of e-Science Grid Application Projects determine services required by Grid middleware • UK Projects focus more on Grid Data Services than Teraflop/s HPC systems
NASA’s IPG Bill Johnston’s vision for the Information Power Grid is to revolutionize how NASA addresses large-scale science and engineering problems by providing persistent infrastructure for • “highly capable” computing and data management services that, on-demand, locate and co-schedule multi-Center resources to address large-scale and/or widely distributed problems • the ancillary services needed to support the workflow management frameworks that coordinate the processes of distributed science and engineering
Human Models Multi-disciplinary Simulations Wing Models • Lift Capabilities • Drag Capabilities • Responsiveness Stabilizer Models Airframe Models • Deflection capabilities • Responsiveness Crew Capabilities - accuracy - perception - stamina - re-action times - SOP’s Engine Models • Braking performance • Steering capabilities • Traction • Dampening capabilities • Thrust performance • Reverse Thrust performance • Responsiveness • Fuel Consumption Landing Gear Models Whole system simulations are produced by couplingall of the sub-system simulations
UK e-Science Initiative • $180M Programme over 3 years • $130M is for Grid Applications in all areas of science and engineering • $50M ‘Core Program’ to encourage development of generic ‘industrial strength’ Grid middleware • Require $30M additional ‘matching’ funds from industry
UK e-Science Projects • $130M for e-Science application ‘pilots’ - span all sciences and engineering • Particle Physics and Astronomy (PPARC) - $25M GridPP and $8M AstroGrid • Engineering and Physical Sciences (EPSRC) - funding 6 projects at around $5M each • Biology, Medical and Environmental Science - funding projects with total value of $35M
UKe-Science Pilot Projects (1) • GRIDPP (PPARC) • ASTROGRID (PPARC) • Comb-e-Chem (EPSRC) • DAME (EPSRC) • DiscoveryNet (EPSRC) • GEODISE (EPSRC) • myGrid (EPSRC) • RealityGrid (EPSRC)
UKe-Science Pilot Projects (2) • Climateprediction.com (NERC) • Oceanographic Grid (NERC) • Molecular Environmental Grid (NERC) • NERC DataGrid (NERC + OST-CP) • Biomolecular Grid (BBSRC) • Proteome Annotation Pipeline (BBSRC) • High-Throughput Structural Biology (BBSRC) • Global Biodiversity (BBSRC)
UKe-Science Pilot Projects (3) • Biology of Ageing (BBSRC + MRC) • Sequence and Structure Data (MRC) • Molecular Genetics (MRC) • Cancer Management (MRC + PPARC) • Clinical e-Science Framework (MRC) • Neuroinformatics Modeling Tools (MRC)
Some UKCore Program Projects • MIASGRID (OST-CP) • AKTing (OST-CP) • EquatorGrid (OST-CP) • DIRCGrid (OST-CP) • MB-NG (OST-CP/PPARC) • UK EDG (OST-CP/PPARC) • OGSA-DAI (OST-CP) • Plus Centre Industrial Grid Projects
Powering the Virtual Universehttp://www.astrogrid.ac.uk(Edinburgh, Belfast, Cambridge, Leicester, London, Manchester, RAL) Multi-wavelength showing the jet in M87: from top to bottom – Chandra X-ray, HST optical, Gemini mid-IR, VLA radio. AstroGrid will provide advanced, Grid based, federation and data mining tools to facilitate better and faster scientific output. Picture credits: “NASA / Chandra X-ray Observatory / Herman Marshall (MIT)”, “NASA/HST/Eric Perlman (UMBC), “Gemini Observatory/OSCIR”, “VLA/NSF/Eric Perlman (UMBC)/Fang Zhou, Biretta (STScI)/F Owen (NRA)” p12 Printed: 06/09/2014
Comb-e-Chem Project Video Simulation Properties Analysis StructuresDatabase Diffractometer X-Raye-Lab Propertiese-Lab Grid
myGrid Project • Imminent ‘deluge’ of genomics data • Highly heterogeneous • Highly complex and inter-related • Convergence of data and literature archives
myGrid Generic Technologies • Database access from the Grid • Process enactment on the Grid • Personalisation services • Metadata services • Development of Agent Services Grid Services+Ontologies • Towards the ‘Semantic Grid’
DAME Project In flight data Global Network eg: SITA Ground Station Airline DS&S Engine Health Center Maintenance Centre Internet, e-mail, pager Data centre
Geodise Project Geodise will provide grid-based seamless access to an intelligent knowledge repository, a state-of-the-art collection of optimisation and search tools, industrial strength analysis codes, and distributed computing & data resources
UK Grid ‘Core Program’ • Network of e-Science Centres • UK e-Science Grid 2. Generic/Industrial Grid Middleware 3. e-Health Grid ‘Grand Challenge’ 4. Support for e-Science Applications 5. Outreach/International Activities 6. Grid Network Issues
UK e-Science Grid Edinburgh Glasgow DL Newcastle Belfast Manchester Cambridge Oxford Hinxton RAL Cardiff London Southampton
Access Grid Access Grid
Industrial Grid Projects • Grid Application Projects have more than $15M industrial input - mostly major pharmaceutical and engineering companies • Around $24M allocated for collaborative industrial projects for middleware/tools - at present $20M allocated with matching industrial funding - more than 50 companies involved
Open Grid Services Architecture • Development of web services from W3C • OGSA will provide • Naming /Authorization / Security / Privacy • Higher level services: Workflow, Transactions, Data Mining, Knowledge Discovery,… • Exploit Synergy: Commercial Internet with Grid Services
E-Science Centre Projects Example Industrial Projects: • E-Science Portal (with Sun) • OSCAR-G (with Intel and Compusys) • Tele-Medicine (with Siemens, Cancer Trust and Regional Hospitals) • Molecular Informatics (with Unilever) • GRIDmist (with HP) • Grid Data Services (with IBM,Oracle)
Databases in the Grid Data Complexity Semantic Web Classical Web Classical Grid Computational Complexity
OGSA – Data Access and Integration Project - Key middleware area for UK Program - Develop high-quality data-centric middleware capability - Total Budget $5M (CP $2M) - Three Centres: Edinburgh, Manchester and Newcastle - Industrial partners: IBM US, IBM Hursley and Oracle UK.
OGSA – DAI Project Update • Design Specification completed • Papers for GGF5 WG on Database Access and Integration Services • Three Prototypes delivered: • Distributed Query Service • XML Database Interface • Relational Database Interface • Beta versions by November 2002 • Integrate with Globus GT3?
e-Health Grid Projects • Grid-Enabled Knowledge Services for Medical Informatics -Triple Assessment in Breast Cancer: Fusion of Clinical, Radiological and Cytological data • Grid-based Medical Devices for Everyday Health -Patient sensors, mobile wireless communication
e-Diamond GRID The challenge Medical Image Analysis Technology Clinical Application Clinical Validation
e-Diamond Mammograms have different appearances, depending on image settings and acquisition systems SMF is a normalised representation independent of scanner settings
e-Diamond Applications of SMF Teleradiology and QC VirtualMammo Training and Differential Diagnosis “Find one like it” ? Advanced CAD SMF-CAD workstation Epidemiology SMFcomputed breast density
Grid Network Team • Expert group to identify end-to-end network bottlenecks and other network issues - e.g. problems with multicast for Access Grid • Identify e-Science project requirements • Funding £0.5M traffic engineering/QoS project with PPARC, UKERNA and CISCO - investigating MPLS using SuperJANET network • Funding DataGrid extension project investigating bandwidth scheduling with PPARC • Proposal for ‘UKLight’ lambda connection to Chicago and Amsterdam
SuperJanet4, June 2002 20Gbps 10Gbps Scotland via Glasgow Scotland via Edinburgh 2.5Gbps 622Mbps WorldCom Glasgow WorldCom Edinburgh 155Mbps NNW NorMAN YHMAN WorldCom Manchester WorldCom Leeds Northern Ireland EMMAN MidMAN WorldCom Reading WorldCom London EastNet TVN External Links WorldCom Bristol WorldCom Portsmouth South Wales MAN LMN SWAN& BWEMAN Kentish MAN LeNSE
Research Challenges • Building a Future Infrastructure - Developing a Semantic Grid - Trusted Ubiquitous Systems - Rapid Customized Assembly of Services - Autonomic Computing • Putting the Infrastructure to work - Support for New Forms of Community - Socio-Economic Impact - Collaboratory IPR and legal issues
Summary • UK Grid projects emphasize data federation as much as computation • Metadata and ontologies will be key to higher level Grid services • e-Science will produce a deluge of scientific data that must be annotated and curated in scientific data ‘digital libraries’
e-Scienceand the Grid ‘e-Science will change the dynamic ofthe way science is undertaken.’ John Taylor, 2001 ‘[The Grid] intends to make access to computing power, scientific data repositories and experimental facilities as easy as the Web makes access to information.’ Tony Blair, 2002