1 / 39

Calit2—CSE’s Living Laboratory for the Future Applications of Information Technology

Calit2—CSE’s Living Laboratory for the Future Applications of Information Technology. UCSD CSE 292 Lecture Series (Fall 2009) Calit2@ UCSD November 30, 2009. Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor,

raoul
Download Presentation

Calit2—CSE’s Living Laboratory for the Future Applications of Information Technology

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Calit2—CSE’s Living Laboratory for the Future Applications of Information Technology UCSD CSE 292 Lecture Series (Fall 2009) Calit2@ UCSD November 30, 2009 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD Follow me on Twitter: lsmarr

  2. Abstract The California Institute for Telecommunications and Information Technology (Calit2) is a UC San Diego/UC Irvine partnership which allows for research into the applications of the continued exponential growth of telecom and IT. I will review the specialized Calit2 facilities which are available to professors and students in CSE and then describe several emerging disciplines in which we have teamed application scientists and computer scientists. These include microbial metagenomics, remote ocean observatories, cosmological supercomputing simulations, Green IT, and global telepresence.

  3. California’s Institutes for Science and Innovation A Bold Experiment in Collaborative Research UCSB UCLA UCI UCSD California Institute for Bioengineering, Biotechnology, and Quantitative Biomedical Research Center for Information Technology Research in the Interest of Society UCD UCM UCB UCSF California NanoSystems Institute UCSC California Institute for Telecommunications and Information Technology www.ucop.edu/california-institutes

  4. What Is Calit2? • Research on the Future of the Internet and its Transformation of Our Society • Core Partnership Between UCSD and UCI • Several Hundred Faculty • Alliances With Other Campuses • Prototyping Of Infrastructure Through “Living Laboratories” • From Campus to Planetary Scale • Partnerships With Multiple Levels of Government and Industry • Secret Sauce: Technical Professionals to Move Projects Forward • Multidisciplinary Research Teams • Faculty, Postdocs, Staff, Students • Industry Partners – • From Giants to Start-up Companies • Community Partners • Emergency Responders

  5. Two New Calit2 Buildings Provide New Laboratories for “Living in the Future” • “Convergence” Laboratory Facilities • Nanotech, BioMEMS, Chips, Radio, Photonics • Virtual Reality, Digital Cinema, HDTV, Gaming • Over 1000 Researchers in Two Buildings • Linked via Dedicated Optical Networks UC Irvine Preparing for a World in Which Distance is Eliminated… www.calit2.net $100M From State for New Facilities

  6. Calit2 UCSD Affiliated CentersLoci for Innovation

  7. The UCSD Center for Networked Systems:A Calit2 Affiliated Center Research Interests • Diverse Research Projects • Multiple Faculty • Multiple Students • Multidisciplinary • CNS Research Theme Member Companies Center Faculty Project Proposals http://cns.ucsd.edu/

  8. First Trans-Pacific Super High Definition Telepresence Meeting Using Digital Cinema 4k Streams Keio University President Anzai UCSD Chancellor Fox Streaming 4k with JPEG 2000 Compression ½ gigabit/sec 100 Times the Resolution of YouTube! Lays Technical Basis for Global Digital Cinema Sony NTT SGI

  9. Ultra Resolution Virtual Reality: Toward a 3D Global Collaboratory 15 Meyer Sound Speakers + Subwoofer Connected at 50 Gb/s to Quartzite 30 HD Projectors! Varrier Showing 360 degree Mars Rover Images StarCAVE Showing Biomolecules and GreenLight Project Source: Tom DeFanti, Greg Dawe, Calit2 Cluster with 30 Nvidia 5600 cards-60 GB Texture Memory

  10. Calit2 Has Advanced Facilities for Building Prototypes • Calit2 Laboratories • Millimeter Wave • Microwave/PA • Circuits • Embedded Systems • Photonics

  11. Calit2 Microbial Metagenomics Cluster-Used by Over 3000 Scientists in 70 Countries Source: Phil Papadopoulos, SDSC, Calit2 ~200TB Sun X4500 Storage 10GbE 512 Processors ~5 Teraflops ~ 200 Terabytes Storage 1GbE and 10GbE Switched/ Routed Core

  12. Calit2 is Creating CAMERA 2.0 --Advanced Cyberinfrastructure Service Oriented Architecture Source: CAMERA CTO Mark Ellisman

  13. The NSF-Funded Ocean Observatory Initiative With a Cyberinfrastructure for a Complex System of Systems Source: Matthew Arrott, Calit2 Program Manager for OOI CI

  14. NSF OOI is a $400M Program -OOI CI is $34M Part of This 30-40 Software Engineers Housed at Calit2@UCSD Source: Matthew Arrott, Calit2 Program Manager for OOI CI

  15. OOI-CI Needs Service-Oriented-Architecture Frameworks to Address Several Service Composition Challenges • A Scientist is Trying to Setup a Facility out of Resources (Instruments, Computing Capabilities, Storage) Spread Over a Variety of Authority Domains • Some of the Integration Challenges: • Resource Discovery (Instruments, Storage, Computation) • Resource Access (Seamlessly Across Infrastructure) • Resource Model (Adding/Removing an Instrument, ...) • Authentication, Authorization, And Other Policies, • Governance Across Multiple Authorities • Need for Agility and Flexibility • High availability with active failure management Source: Ingolf Krueger, CSE, Calit2

  16. OOI CIResearch Topics • Semantic Foundations • Formal Service Notion • Composition Operators • Refinement Notions for Services • Mapping from Services to Components • Description Techniques for Services and Components • Message Sequence Charts • Architecture Definition Languages • Service-Oriented Development Process • Requirements Engineering • Logical vs. Deployment Architectures • Verification and Validation • Integrated Development Process and Tool Support Source: Ingolf Krueger, CSE, Calit2

  17. Exploring Cosmology With Supercomputers, Supernetworks, and Supervisualization Source: Mike Norman, SDSC Intergalactic Medium on 2 GLyr Scale Science: Norman, Harkness,Paschos SDSC Visualization: Insley, ANL; Wagner SDSC • 40963 Particle/Cell Hydrodynamic Cosmology Simulation • NICS Kraken (XT5) • 16,384 cores • Output • 148 TB Movie Output (0.25 TB/file) • 80 TB Diagnostic Dumps (8 TB/file) • ANL * Calit2 * LBNL * NICS * ORNL * SDSC

  18. Project StarGate: Network & Hardware Source: Mike Norman, SDSC ALCF ESnet DOE Eureka 100 Dual Quad Core Xeon Servers 200 NVIDIA Quadro FX GPUs in 50 Quadro Plex S4 1U enclosures 3.2 TB RAM Science Data Network (SDN) > 10 Gb/s fiber optic network Dynamic VLANs configured using OSCARS rendering NICS SDSC visualization simulation NSF TeraGrid Kraken Cray XT5 8,256 Compute Nodes 99,072 Compute Cores 129 TB RAM Calit2/SDSC OptIPortal1 20 30” (2560 x 1600 pixel) LCD panels 10 NVIDIA Quadro FX 4600 graphics cards > 80 gigapixels 10 Gb/s network throughout *ANL * Calit2 * LBNL * NICS * ORNL * SDSC

  19. OptIPortals: Scaling up the Personal ComputerFor Supernetwork Connected Data-Intensive Users Mike Norman, SDSC October 10, 2008 Two 64K Images From a Cosmological Simulation of Galaxy Cluster Formation log of gas temperature log of gas density

  20. How Can Computer Science and Engineering Research Help Meet the Greatest Challenge of Our Time? We believe colleges and universities must exercise leadership in their communities and throughout society by modeling ways to minimize global warming emissions… • American College and University Presidents’ Climate Commitment • 659 Presidents Have Signed So Far • Commitment for Taking Steps Toward Climate Neutrality www.presidentsclimatecommitment.org

  21. ICT is a Critical Element in Achieving Greenhouse Gas Emission Reduction Targets • GeSI member companies: • Bell Canada, • British Telecomm., • Plc, • Cisco Systems, • Deutsche Telekom AG, • Ericsson, • France Telecom, • Hewlett-Packard, • Intel, • Microsoft, • Nokia, • Nokia Siemens Networks, • Sun Microsystems, • T-Mobile, • Telefónica S.A., • Telenor, • Verizon, • Vodafone Plc. • Additional support: • Dell, LG. www.smart2020.org

  22. The Global ICT Carbon Footprint isAlready Significant Today and Growing Rapidly ICT Emissions are Growing at 6% Annually! • Note--the assumptions behind the growth in emissions expected in 2020: • takes into account likely efficient technology developments that affect the power consumption of products and services • and their expected penetration in the market in 2020 www.smart2020.org

  23. Reduction of ICT Emissions is a Global Challenge –U.S. and Canada are Small Sources U.S. and Canada Together Fall From 25% to 14% of Global ICT Emissions by 2020 www.smart2020.org

  24. The Global ICT Carbon Footprint by Subsector-The Internet, Data Centers, and PCs The Number of PCs (Desktops and Laptops) Globally is Expected to Increase from 592 Million in 2002 to More Than Four Billion in 2020 PCs Are Biggest Problem Data Centers Are Rapidly Improving www.smart2020.org

  25. First, Reduce Physical Energy and Cooling--UCSD Has Two Sun Microsystems Modular Data Centers • Sun Has Shown up to 40% Reduction in Energy Using Active Management of Disks, CPUs, etc. • Sun Measures Temperature at 40 Points in the Air Stream (5 Spots on 8 Racks) Plus: • Internal Humidity and Temperature at the Sensor Module, • External Temperature and Humidity, • Incoming and Exiting Water Temperature and Power Utilization in Each of the 8 Racks

  26. The NSF-Funded UCSD GreenLight Project: How Software Can Make Data Centers More Efficient? • Focus on 5 Communities with At-Scale Computing Needs: • Metagenomics • Ocean Observing • Microscopy • Bioinformatics • Digital Media • Goal: Measure, Monitor, & Web Publish Real-Time Sensor Outputs • Via Service-Oriented Architectures • Allow Researchers Anywhere to Study Computing Energy Cost • Enable Scientists to Explore Tactics for Maximizing Work/Watt • Develop Middleware that Automates Optimal Choice of Compute/RAM Power Strategies for Desired Greenness

  27. Research Needed on How to Deploy a Green CI MRI • Computer Architecture • Rajesh Gupta/CSE • Software Architecture • Amin Vahdat, Ingolf Kruger/CSE • CineGrid Exchange • Tom DeFanti/Calit2 • Visualization • Falko Kuster/Structural Engineering • Power and Thermal Management • Tajana Rosing/CSE • Analyzing Power Consumption Data • Jim Hollan/Cog Sci • Direct DC Datacenters • Tom Defanti, Greg Hidley http://greenlight.calit2.net

  28. Machine Learning for Dynamic Power and Thermal Management to Reduce Energy Requirements • NSF Project Greenlight • Green Cyberinfrastructure in Energy-Efficient Modular Facilities • Closed-Loop Power &Thermal Management • Dynamic Power Management (DPM) • Optimal DPM for a Class of Workloads • Machine Learning to Adapt • Select Among Specialized Policies • Use Sensors and Performance Counters to Monitor • Multitasking/Within Task Adaptation of Voltage and Frequency • Measured Energy Savings of Up to 70% per Device • Dynamic Thermal Management (DTM) • Workload Scheduling: • Machine learning for Dynamic Adaptation to get Best Temporal and Spatial Profiles with Closed-Loop Sensing • Proactive Thermal Management • Reduces Thermal Hot Spots by Average 60% with No Performance Overhead CNS System Energy Efficiency Lab (seelab.ucsd.edu) Prof. Tajana Šimunić Rosing, CSE, UCSD

  29. But, If IT is Used in New WaysCarbon Savings Can Be Much Larger! While the sector plans to significantly step up the energy efficiency of its products and services, IT’s largest influence will be by enabling energy efficiencies in other sectors, an opportunity that could deliver carbon savings five times larger than the total emissions from the entire ICT sector in 2020. --Smart 2020 Report Major Opportunities for the United States* • Smart Buildings • Virtual Meetings • Smart Transportation Systems • Smart Electrical Grids * Smart 2020 United States Report Addendum www.smart2020.org

  30. Developing Greener Smart Campuses as Societal Prototypes: Calit2 (UCSD & UCI) Student Video -- UCSD Living Laboratory for Real-World Solutions www.gogreentube.com/watch.php?v=NDc4OTQ1 on UCSD UCI Named ‘Best Overall' in Flex Your Power Awards www.today.uci.edu/news/release_detail.asp?key=1859 • Coupling the Internet and the Electrical Grid • Measuring Electrical Demand Per Building Across Campus • Measuring Demand at Sub-Building Levels • Reducing Computer Energy Usage in Buildings • Travel Substitution • Next Generation Global Telepresence • Beyond Cisco Telepresence • Enabling Continuous Collaboration Without Travel

  31. Real-Time Monitoring of Building Energy Usage:UCSD Has 34 Buildings On-Line http://mscada01.ucsd.edu/ion/

  32. Comparision Between UCSD Buildings:kW/sqFt Year Since 1/1/09 Calit2 and CSE are Very Energy Intensive Buildings

  33. Power Management in Mixed Use Buildings:The UCSD CSE Building is Energy Instrumented Source: Rajesh Gupta, CSE, Calit2 • 500 Occupants, 750 Computers • Detailed Instrumentation to Measure Macro and Micro-Scale Power Use • 39 Sensor Pods, 156 Radios, 70 Circuits • Subsystems: Air Conditioning & Lighting • Conclusions: • Peak Load is Twice Base Load • 70% of Base Load is PCs and Servers • 90% of That Could Be Avoided!

  34. Today Dedicated 10Gbps Lightpaths Tie Together State and Regional Fiber Infrastructure Interconnects Two Dozen State and Regional Optical Networks Internet2 Dynamic Circuit Network Under Development NLR 40 x 10Gb Wavelengths Expanding with Darkstrand to 80

  35. Linking the Calit2 Auditoriums at UCSD and UCI with HD for Shared Seminars September 8, 2009 September 8, 2009 Avoiding Travel Between Campuses Photo by Erik Jepsen, UC San Diego

  36. The OptIPuter Project: Creating High Resolution Portals Over Dedicated Optical Channels to Global Science Data Scalable Adaptive Graphics Environment (SAGE) $13.5M Over Five Years Picture Source: Mark Ellisman, David Lee, Jason Leigh Calit2 (UCSD, UCI) and UIC Lead Campuses—Larry Smarr PI Univ. Partners: SDSC, USC, SDSU, NW, TA&M, UvA, SARA, KISTI, AIST Industry: IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent

  37. Rocks/CGLX OptIPortalUses OpenGL Hardware Accelerated Open GL Application CGLX Tools CGLX (cglXlib) CARBON AGL GL X GLX Driver Graphics Hardware LINUX (UNIX) MAC OS 10 Network Layer Cluster Layer Render Node Layer Dsp. 0 Dsp. 1 Serial Mode Dsp. 2 High Performance Network EventQueue event 2 MAC OS10 Wall store event 1 event 0 currentevent store Threaded Mode Linux 64bit Wall Dsp. 0 Dsp. 1 Dsp. 2 • CGLX features: • Cross-Platform Hardware Accelerated Rendering • Synchronized Multi-Layer OpenGL Context Support • Distributed Event Management • Scalable Multi Display Support Source: Kai-Uwe Doerr, Falko Kuester, Calit2

  38. High Definition Video Connected OptIPortals:Virtual Working Spaces for Data Intensive Research LifeSize HD NASA Ames Lunar Science Institute Mountain View, CA NASA Interest in Supporting Virtual Institutes Source: Falko Kuester, Kai Doerr Calit2; Michael Sims, NASA

  39. Multi-User Global Workspace:San Diego, Chicago, Saudi Arabia Source: Tom DeFanti, KAUST Project, Calit2

More Related