1 / 172

Global Grid Forum 7 Tutorial March 4, 2003 Rick Stevens Michael E. Papka Thomas D. Uram Ti Leggett

Global Grid Forum 7 Tutorial March 4, 2003 Rick Stevens Michael E. Papka Thomas D. Uram Ti Leggett Ivan R. Judson. Overview. Morning Session The Access Grid Project (1/4 hour) Overview of the goals of the Access Grid (AG) project Access Grid 2.0 Overview (3/4 hour)

grady
Download Presentation

Global Grid Forum 7 Tutorial March 4, 2003 Rick Stevens Michael E. Papka Thomas D. Uram Ti Leggett

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Global Grid Forum 7 Tutorial March 4, 2003 Rick Stevens Michael E. Papka Thomas D. Uram Ti Leggett Ivan R. Judson

  2. Overview Morning Session • The Access Grid Project (1/4 hour) • Overview of the goals of the Access Grid (AG) project • Access Grid 2.0 Overview (3/4 hour) • Architecture and Design • Introduces the changes to the AG from v1.x - v2.0 • Overview of Reference Platforms • Installation and Configuration of AG 2.0 (11/2 hour) • Installation and Setup of Laptop Reference Platform • Installation and Setup of Advanced Reference Platform • Access Grid 2.0 Advanced Section (11/2 hours) • Installing and Running a Venue Server • Nodes, Services, Venues, Venue Servers • Plans for the next Year

  3. Overview cont’d Afternoon Session • AG 2.0 Technology Overview (11/2 hour) • An overview of technology used in AG 2.0 • AG Toolkit 2.0 Development (1 1/2 hours) • How to develop Services with the AGTk • Application, Node, and Network Services • Walkthrough building examples • Advanced Application Development (1 hour) • Walk through of application development on top of AG 2.0

  4. Rick Stevens Argonne National Laboratory and University of Chicago stevens@mcs.anl.gov WelcomeIntroduction to the Access Grid

  5. Group to Group Interaction on the Grid

  6. The Access Grid • The Access Grid project’s focus is to enable groups of people to interact with Grid resources and to use the Grid technology to support group to group collaboration at a distance • Supporting distributed research collaborations • Distributed Lectures and seminars • Remote participation in design and development • Virtual site visits and team meetings • Complex distributed grid based applications • Long term collaborative workflows

  7. Distance Learning

  8. Access Grid and Collaboration TechnologiesConnecting People and Applications via the Grid Access Grid  Integrating Group to Group Collaboration and Visualization

  9. Stages of Collaborative Work • Awareness • Interaction • Cooperation • Collaboration • Virtual Organization Increasing need for persistent collaborative infrastructure Can the concept of Persistent Shared Spacesenable the cost-effective support of virtual organizations.

  10. Distributed Exploratory Analysis

  11. Hands free audio Multiple Video and Audio streams Wide field of view Virtual collaborative spaces Secure Rooms Integration with GRID services The Access Grid, a collection of designed spaces Enabling Group to Group Interaction

  12. Ambient mic (ceiling mount) Presenter mic Feedback view surface Audience mic Presenter camera Audience camera Technician headset AccessGrid and ActiveMural

  13. Access Grid – The Novel Ideas • Peer-to-peer Virtual Venues servers to enable worldwide, secure virtual communities through the use of high-end collaboration environments • Collaborative work sharing beyond simple application sharing • Integration of high-end visualization environments into collaborative spaces • Methods of asynchronous collaboration: capture, synchronization, record, playback and annotation of collaborative experiences.

  14. HW Components of an AG Node RGB Video Digital Video Display Computer Network Shared App, Control NTSC Video Video Capture Computer Digital Video Analog Audio Digital Audio Audio Capture Computer Mixer Control Computer RS232 Serial Echo Canceller

  15. Access Grid Project Goals • Enable Group-to-Group Interaction and Collaboration • Connecting People and Teams via the Grid • Improve the User Experience: Go Beyond Teleconferencing • Provide a Sense of Presence • Support Natural Interaction Modalities • Use Quality but Affordable Digital IP Based Audio/video • Leverage IP Open Source Tools • Enable Complex Multisite Visual and Collaborative Experiences • Integrate With High-end Visualization Environments • ActiveMural, Powerwall, CAVE Family, Workbenches • Build on Integrated Grid Services Architecture • Develop New Tools Specifically Support Group Collaboration

  16. StationOne Early concept sketch for a single user visual Superstation. Designed to be both a high-resolution visualization environment and a high-end node in a collaboratory for advanced simulation .

  17. Our Approach • Attack Research Questions in the context of real world experience • Build up a critical mass of groups using the AG Platform • Involve multiple groups in trying new ideas and evaluation • Build Working Infrastructure as well as Prototype Software • Argonne has five working AG nodes under development • New Software is used weekly/Daily as part of standard nanocruises • Involve multiple groups in deployment, use and research • Active collaborations with over a dozen groups working on AG technology • Release software early and often (use open source model) • Contribute to the Community Code base

  18. Group-to-Group Interaction is Different • Large-scale scientific and technical collaborations often involve multiple teams working together • Group-to-group interactions are more complex than than individual-to-individual interactions • Ghe access grid project is aimed at exploring and supporting this more complex set of requirements and functions • Ghe access grid will integrate and leverage desktop tools as needed

  19. Ad Hoc Collaboration

  20. The Grid Software Stack

  21. Some Access Grid Active Research Issues • Scalable wide area communication • Evolution of multicast related techniques, and time shifting issues • Scoping of resources and persistence • Value of spatial metaphors, security models • Virtual Venues, synchronous and asynchronous models • Improving sense of presence and point of view • Wide Field Video, Tiled Video, High-resolution video codecs • Network monitoring and bandwidth management • Beacons and network flow engine • Role of Back-channel communications • Text channels and private audio • Recording and playback of multistream media

  22. Interactive Scientific Computing

  23. The Continuum at EVL and TRECCAmplified Work Environment Passive stereo display AccessGrid Digital white board Tiled display

  24. Access Grid 2.0 Architecture Application Services Virtual Venues Services Access Grid Network Services Access Grid Nodes Users

  25. An Integrated View of Simulation, Experiment, and Bioinformatics Problem Specification Simulation Browsing & Visualization SIMS Database Analysis Tools LIMS Experimental Design Experiment Browsing & Visualization

  26. BioGrid Services Model Domain Oriented Services • Drug Discovery • Microbial Engineering • Molecular Ecology • Oncology Research Basic BioGrid Services • Integrated Databases • Sequence Analysis • Protein Interactions • Cell Simulation Grid Resource Services • Compute Services • Pipeline Services • Data Archive Service • Database Hosting

  27. End!!

  28. Access Grid vs. Commercial Desktop Tools • AG targets beyond the desktop • large format multi-screen for AG Global Channels • room scale hands free full-duplex audio • AG uses dedicated hardware • multiple machines, separation of function NT, Linux • AG software is Open Source • extends and builds on community tools • AG environment is integrated with Grid services • extensible framework designed to “plug-into” the Grid • AG development is a Community Effort • you are welcome to join in the fun!!

  29. Access Grid 2.0 Overview

  30. Virtual Venues Places where users collaborate Network Services Advanced Middleware Virtual Venues Client User Software Nodes Shared Nodes Administratively scoped set of resources Resources Provide capabilities Personal Nodes User scoped set of Resources What is the Access Grid? • Users collaborate by sharing: • Data • Applications • Resources

  31. Access Grid Architecture

  32. Virtual Venues • What is a Virtual Venue? • A Virtual Venue is a virtual space for people to collaborate • What do Virtual Venues provide? • Entry/Exit Authorization Information • Connections to other Venues • Coherence among Users • Venue Environment, Users, Data • Client Capabilities Negotiation • List of Available Network Services • Keep track of resulting Stream Configurations • Applications • Virtual Venues have two interfaces • Administrative – Venue Management Software • Client – Virtual Venue Client Software

  33. Network Services • Network Services • Provide a middleware layer for enabling the richest collaborations • Are invisible to Venues Clients, used by Virtual Venues • Primarily Transform streaming data • Can be anywhere on the network • Can be composed to build complex solutions: • Venue Audio Stream  Audio Transcoder  Audio to Text  Two-Way Pager • Two-Way Pager  Text to Audio  Audio Transcoder  Venue Audio Stream • Network Services provide opportunities for third party developers • ANL is working on Network Services for • Audio Transcoding (16KHz ↔ 8KHz) • Video Stream Selection

  34. Virtual Venues Client • Enable face-to-face meeting activities • What can be done: • Sharing Data • Shared Applications • Applications: • Distributed PowerPoint • Shared Web browser • Whiteboard • Voting Tool • Question & Answer Tool • Shared Desktop Tool • Integrate legacy single-user apps

  35. Access Grid Nodes • Access Grid Nodes • Comprise a set of collaboration resources • Expose those resources through Node Services • Basic Node Services include: • Audio & Video Services • Network Performance Monitoring Service • Network Reliability/Fallback Service • Leashing Service – Registering presence with a shared node • Extended Node Services could be: • Display Service with enhanced layout control • Video Service supporting new CODECs • Automatic performance adaptation • Application Hosting Service

  36. Access Grid 2.0 Design Requirements • Secure Communication Throughout • Reliable, Robust Data Transport • Example: Network Failover Technology • More Diverse Reference Platforms • Handhelds  High End Solutions • Personal and Shared Nodes • More Usable Software • Well Documented Interfaces • Federated Operation • Integrate Grid Computing Technology • AG 2.0 is Web Services based • AG 2.0 uses GT2.X • AG 2.0 can enhance an OGSI by providing collaboration services

  37. Access Grid Nodes • Access Grid 2.0 reference platforms: • Advanced Node – Tiled Display, Multiple Video Streams, Localized Audio • Room Node – Shared Display, Multiple Video Streams, Single Audio Stream (AG 1.x Node) • Desktop Node – Desktop Monitor, Multiple Video Streams, Single Audio Stream (AG 1.X PIG) • Laptop Node – Laptop Display, Single Video Stream, Single Audio Stream • Minimal Node – Compact Display, Single Video Stream, Single Audio Stream • What Hardware? • Cameras, Microphones, Speakers, Display, Input Devices • Get Audio Correct! • Software Requirements? • Python 2.2, wxPython, GT2.0, pyGlobus

  38. 1.0 Virtual Venues Static Media Configurations Assumed Multicast Technology Single Server assumption Virtual Venues Client Web Browser Nodes Non-extensible single reference platform AG 1.1 1.2 PIGs introduced Applications layered outside of AG software 2.0 Virtual Venues Dynamic Media Configurations Capability Brokering Functionality Integrated Data Storage Support for highly scalable deployments Multicast Addressing Topological Simplicity (connections as URLs) Virtual Venues Client Streamlined Client Integrated Grid Security Workspace Docking Application Development Interfaces Exposed Nodes Nodes defined in terms of resources Management UI Interfaces exposed for building new Services Broader set of Reference Platforms Applications Venue Hosted Collaborative Apps Network Services Summary of Changes from 1.0 to 2.0

  39. Technology Details: Windows (2000, XP) Linux Globus Toolkit 2.X Web Services We prefer Python Partners Tools Globus toolkit Python CoG kit (LBNL) LBNL Intergroup Communications (LBNL) Condor ClassAds Project Strategy Open Source Project Model Standard Tools CVS, Bugzilla Access Grid Project Meetings First Tuesday of each month Argonne Institutional Venue Next meeting April. 1st, 2003, 10-12am CST. Access Grid 2.0 Development

  40. Access Grid 2.0 Timeline • Code Available now from: • :pserver:anonymous@ag-cvs.mcs.anl.gov:/cvsroot co AccessGrid • 2.0 Alpha 4 Available now! • Virtual Venues Server • Transitional Venue Server for AG1.X  AG2.0 Migration • https://vv2.mcs.anl.gov:9000/Venues/default (The Access Grid Lobby) • Basic Node Services • Virtual Venues Client Software • Venues Management UI • Beta 2.0 March 14th, 2003 • Final 2.0 Toolkit April 15th, 2003

  41. From Installation To Connection Ti Leggett Access Grid 2.0

  42. Prerequisites • Python 2.2 • Win32 Extensions • Logging Module • wxPython 2.4.0 • Globus • http://www.mcs.anl.gov/fl/research/accessgrid/software/software.html

  43. Linux Ships with RedHat 7.3 and 8.0 For earlier versions, build your own RPMs from SRPMs Windows ActiveState Python comes standard with Win32 Extensions Python 2.2

  44. Linux Need wxGTK and wxPythonGTK Windows Only need wxPython wxPython

  45. Linux gpt Globus pyGlobus Windows WinGlobus pyGlobus pyDNS Globus

  46. Globus Linux Post Installation • To finalize you must run /usr/lib/globus/setup/setup-gsifollowed by /usr/lib/globus/setup/globus_simple_ca_<number>/setup-gsi -default • To start using you must either logout or source the proper globus shell script in /etc/profile.d/globus.{sh|csh}

  47. Globus Certificates Windows • Use the provided script to generate a request • %GLOBUS_LOCATION%\bin\certreq.cmd • Start\Programs\Windows Globus\Get a Certificate • Copy from a UNIX host using the Globus Configuration program

  48. Globus Certificates Windows (con’t) • certreq.cmd • Use the defaults where provided • DNS domain (i.e., mcs.anl.gov) • Full Name (i.e., Ti Leggett) • Mail userreq.pem to the address reported back

More Related