1 / 11

Bosco : Enabling Researchers to Expand Their HTC Resources

Bosco : Enabling Researchers to Expand Their HTC Resources. The Bosco Team: Dan Fraser, Jaime Frey, Brooklin Gore, Marco Mambelli , Alain Roy, Todd Tannenbaum , Derek Weitzel Dan is the Open Science Grid (OSG) Production Coordinator & Campus Infrastructure Lead Condor Week May 3, 2012.

juliet
Download Presentation

Bosco : Enabling Researchers to Expand Their HTC Resources

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Bosco: Enabling Researchers to Expand Their HTC Resources The Bosco Team: Dan Fraser, Jaime Frey, Brooklin Gore, Marco Mambelli, Alain Roy, Todd Tannenbaum, Derek Weitzel Dan is the Open Science Grid (OSG) Production Coordinator & Campus Infrastructure Lead Condor Week May 3, 2012

  2. The Open Science Grid http://display.grid.iu.edu Both Inter- and Intra- campus bridging The Open Science Grid (OSG) has focused much of its effort on campuses from its inception All OSG computing power comes from campuses and National Laboratories OSG has a footprint on over 100 campuses and labs in the US and abroad

  3. OSG Campus Focus One step at a time • Focus on the Researcher (…or Artist) • What can we do to increase the throughput of your computing?

  4. Bosco: Part of The OSG Campus Infrastructure Initiative • Community Building (just beginning) • Support for campus infrastructure builders • Email support, blogs, online training, … • http://twiki.grid.iu.edu/bin/view/CampusGrids/WebHome • How-to center for community expertise • How-to support application environments (coming) • Matlab, “R”, Amber, Workflow environments … • Share DHTC Best Practices • Distributed High Throughput Computing • Set up a campus infrastructure • Utilize HTTP caching (Squid) • Enable researchers to access DHTC (Bosco)

  5. Researchers may (or may not) be using a local cluster A Campus Researcher Workstation (Linux) LocalCluster

  6. Bosco Extends the Researcher’s Reach A Campus OtherCampuses … PBS … Researcher Workstation (Linux) Condor Bosco -SSH Access -No grid cert needed ! LocalCluster

  7. But Wait! That’s not all … A Campus OtherCampuses XSEDE … PBS … Researcher Workstation (Linux) Condor Bosco GLOW / CHTC Engage OSG LocalCluster Nebraska, … OSG Connector VO’s OSG Cloud CommercialClouds Grid Certificate

  8. Bosco v1 (June) is designed for researchers Same as the GlideinWMS Model • Download • Untar • Bosco_install • Bosco_cluster -add (hostname, Qsize) • Bosco_cluster -test • Submits a job, identifies problem areas • Jobs submitted using Condor syntax • The submit model does not change

  9. Under the hood of Bosco Bosco uses SSH to submit pilot jobs to worker nodes (WNs). WNscommunicate back to the researcher’s workstation… • Integrated combination of: • Campus Factory – glide-in (U Nebraska) + • Condor pieces (some under devel) + • SSH + • Glue + • Easy interface + • Documentation

  10. Campus Infrastructure Direction Submit Locally, Run Globally • Help the researcher use local resources • Run on a local campus cluster • Run on several local clusters • Use local authentication credentials • Use/share resources with acollaborator on another campus • Access to the national cyberinfrastructure • OSG (and also XSEDE) resources

  11. OSG YOU can be part of the action Fraser at anl.govBgore at morgridgeinstitute.org We may even come to your campus

More Related