1 / 16

Extending CERN Computing to Volunteers: LHC@home Consolidation and Outlook

Explore the history, applications, challenges, and outlook of the LHC@home project, which utilizes volunteer computing resources through BOINC to support data reconstruction and analysis for the Large Hadron Collider. Discover the benefits of volunteer computing, community engagement, virtualization, and the future prospects of LHC@home.

bernita
Download Presentation

Extending CERN Computing to Volunteers: LHC@home Consolidation and Outlook

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ExtendingCERN computingtovolunteers LHC@homeconsolidationandoutlook DavidCameron(UniversityofOslo/ATLAS),LaurenceField,Nils Høimyr(CERN-IT) Ivan Reid (Brunel University London/CMS)

  2. Outline Why volunteercomputing? BOINCoverview LHC@home • • • – – – History and applications Consolidation Server infrastructure Challengesand outlook •

  3. Whyvolunteercomputing? TheWLCGhaslimited resources • – – Fully committed to LHC data reconstructionand analysis Stillneed alotmore computing forsimulations onsmaller datasets Use additionalfree* resources – 100Khostsachievable for large projects • Supportforvirtualisation-CernVM • Community engagement • – – Outreachchannel Community participationandsupport *Attractingandinteractingwithvolunteers has acost

  4. BOINC “BerkeleyOpenInfrastructureforNetworkComputing” Softwareplatformfordistributedcomputingusingvolunteered computerresources Client –serverarchitecture Freeandopensource Usedfor • • • • SETI@home Climateprediction.net Einstein@home LHC@home … – – – – – http://boinc.berkeley.edu LHC@homeconsolidationandoutlook

  5. BOINC andVirtualisation BOINCdistributes VMs toclientmachines alongwith awrapper application • The BOINCclient installationfor Windows now includes Virtual Box • LHC@homeconsolidationandoutlook

  6. Somehistory Started with in 2004for the 50thanniversaryofCERN.Runningthe Sixtrackapplicationforbeamsimulationsofthe stabilityofprotonorbits in the LHC accelerator Test4Theory wasadded asa newBOINCprojectin 2011,itpioneeredthe useofvirtualisationtorun physicssimulations onavirtualmachine (CernVM) onvolunteerdesktops Joined byATLASandother LHCexperiments from2014,alsousing CernVM and CernVMFS, a distributedhttp filesystem Effort tostreamline andconsolidateindividualinitiatives onseparate BOINCprojectstoacommon project andtointegratewithregular simulationworkflowsaswell as batchcomputing infrastructure • • • •

  7. Project status LHC@homeconsolidated • AsingleBOINCprojectwithmultipleapplications – Accelerator physics simulations (Sixtrack)as nativeBOINC app Simulations fromATLAS, CMS, LHCb andTheory running underCernVM andVirtualBox Jobmanagementbackendintegrated withHTCondor– potentially wide range of (low-IO/high CPU) applications ● ● ●

  8. Applications Sixtrack(beamsimulations) NativeBOINCapplication, Linux, MAC,Windows andAndroid Theory (MCevents) running underCernVMinVirtualBox on Linux,MACandWindows ATLAS(Eventsimulations), available asnativeBOINC application for Linux,or underCernVMinVirtual Box onLinux,MACand Windows LHCb (Beauty physics simulations) runningunderCernVM in VirtualBox onLinux,MACandWindows CMS(Eventsimulations) running underCernVMinVirtualBox on Linux,MACandWindows (currently testing using a singularity container within the VM) • • • • •

  9. LHC@homeserver setup • Server setup nowscalable Load-balanced webfrontend Dedicated file upload/downloadservers Legacy assimilationandvalidatorserverforSixtrack – – – RemotesubmissionfromHTCondor • Implementedfor Sixtrackusing Boinc-CondorGAHP RunCondor directly in VM forother applications ATLASviaARC-CE andsharedfile buffer – – – LHC@homeconsolidationandoutlook

  10. TheVacuumModel CernVM Experiment Framework Agent Inline withthe cloud approach • • Commonapproaches Reducecosts • • Both development and operation Untrusted resource • • • Authentication– VCCS(Volunteer CA) Validation– DataBridge orBOINC

  11. Recentactivity

  12. Volunteer computingchallenges Volunteerbase not increasing • – – CompetitionfromBitcoinminingareal issue More useofmobile devices BOINCcommunity stable • – Importanttoevolvethesoftwarestack andkeepengagingwith thecommunity Institute desktops and idleservermachines have anunexploited potential • – Ref.ATLAStalk @ CHEP 2018 https://indico.cern.ch/event/587955/contributions/2937192/

  13. BOINCcommunity contributions TheBOINCsoftwaremovedfromBerkeleytoGithubin 2016andnowfollowsacommunityOpenSourcegovernancemode The LHC@hometeamatCERNhascontributedtothenew governancemodel andtheBOINCworkshopin Paris lastyearwhere animprovedcommunitymodel wasbootstrapped NewWebRTCBOINCclientGUI(proofofconcept) asalternativeto nativeGUI MaintenanceofRedHat/FedoraBOINCclient,nowat7.10.22OthercontributedBOINC codeupdateshavebeen bugfixesand improvementstotheBOINCservercomponents(e.g.forscheduling, HTCondorgatewayandGDPRcompliance) ThefutureofBOINCdependsoncontributionsfromthecommunity of BOINCprojects! • • • • • • LHC@homeconsolidationandoutlook

  14. References http://cern.ch/lhcathomehttp://boinc.berkeley.edu • • Questions? LHC@homeconsolidationandoutlook

  15. 16

More Related