00:00

Computing and Data Model for ET Symposium 2024

In preparation for the ET Symposium 2024, a series of workshops and milestones have been outlined to address various aspects related to computing and data models. Key areas include requirements collection, computing infrastructures, low latency workflows, data management, and more. Emphasis is also placed on sustainability, open-data practices, and the management of ET data. Collaboration across multiple work packages is crucial in achieving the project objectives.

acea
Download Presentation

Computing and Data Model for ET Symposium 2024

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. ET ET- -PP WP8 PP WP8 Computing and data model WP8 co-chairs: Nadia Tonello, Achim Stahl ET Symposium2024

  2. ET-PP WP8 Computing and Data models ET-PP Workshops Due date WPs M8.1 Workflows Requirements collection and constraints: computing and data Sep 2023 Oct 2023 WP8 milestones M8.2 Computing Infrastructures availability for ET workflows, characteristics WP9 Aug 2024 July 2024 On site infrastructure, computing and data model Aug 2025 WP6 M8.3 Low latency and offline workflows and computing model Dec 2025 WP6 M8.4 Data management, access, policy and implementation July 2026 WP2, WP6 M8.5 Deliverables Lead Due date WP8 Documents D8.1 . Computing and Data Requirements UniGe Feb 2024 Feb 2024 Computing and Data Model UniGe Feb 2026 D8.2 Data Access Implementation Guidelines IFAE July 2026 D8.3 ET Symposium - May 2024 2

  3. EiB-WP8 workshops ET-PP M M8 8. .1 1Computing Computingand Host: GenevaDate:26th-27th October Agenda:https://indico.ego-gw.it/event/590/ anddata datarequirements requirements Sustainability Sustainabilityworkshop Co-locatedwiththeETannual meeting16-17 Nov 2023 Paul’sreport Focus on computing aspects: optimization of software, workflows and computing resources, reproducibility, automation. Carbon emissions related to computing is identified as challenging but crucial. Expertiseisneeded. workshopparticipation participation(WP (WP9 9) ) ET Symposium - May 2024 3

  4. EiB-WP8 second workshop in preparation ET-PP M M8 8. .2 2Computing ComputingInfrastructures Host: Napoli(thanksSilvio!) Infrastructuresavailability availabilityfor forET ETworkflows, workflows,characteristics characteristics Date Date:July 2024 to bedecidedasap a. a. 3 3- -4 4- -5 5 b. b. 8 8- -9 9- -10 10 c. c. 29 29- -30 30- -31 31 Agenda Agendato to be WP8+EiBDiv3, withthecontributionofWP9 - Computing resources(following therequirementscoming fromMDCsetc. ) - Sustainabilityof thedifferent options bedefined definedasap asap ET Symposium - May 2024 4

  5. Name of project officer: Name(s) of monitors: Ioannis ANDREDAKIS ET-PP Y1 Review Maria Alessandra PAPA ET-PP General General comments commentsof ofthe - Data Data access access plan plan for ET should conform to modern standards and the EU values of FAIR. The endorsement of the open-data practices fortheET data mustbeclearer. - Avoidtreating thiskindof monumental scientificinstrumentsasproprietary. - Follow theplanning path: a) background information necessary to understand the landscape inwhich the planning/ designhappens b) specificationsof the requirements for what is beingdesigned, + explanation ofsuch requirements c) analysis of options inrelation tothe requirements d) justificationof the final choice. - Addan explicitreflection and discussionof the'lessons 'lessonslearned learned’(from Virgo) - Consider the global global aspect aspect: Gravitational wave detectors do not operate as single entities but rather as a network. thereview reviewto toconsider consider ET Symposium - May 2024 5

  6. D1.2 DMP review ET-PP Deliverable 1.2 – REJECTED (reviewed by EC and outside experts) Secondpayment FROZEN until approval A new version ofthe document is in preparation Contributionsfrom all WPs: May 10th Creation of a new DMP: May 13th To be circulated for comments: May 17th Final submission: May 29th • • • • • ET Symposium - May 2024 6

  7. D1.2 DMP comments ET-PP - • • What data ? organization/policy documents environmental monitoring channels, auxiliary instrument channels, electronics,main interferometerchannels, calibration,controlchannels administrative/financial data How much ? When will it be produced ? Who writes it ? How long does it have to bestored for? Who may have access to it? subset of ET-PP? all of ET-PP? International partners ? Will it be updated/will there be different releases ? s a version-control system necessary ? If there is no decision taken yet, who will take this decision, when and under what considerations Too Too simple simple document comprehensive DMP including updated information document - prepare a more Change the title of the deliverable to “management for the ET-PP data” and make sure that the distinction with the ET data isclear. • - - All All WPs WPs will produced by WP1 with comments from WP8 will need need to to contribute contribute - D1.2 - - Guidelines Guidelines to to follow theveryearly stage! follow should be clear from ET Symposium - May 2024 7

  8. WP8 new contribution to D1.2 ET-PP New detailed template (HE) https://b2drop.bsc.es/index.php/s/EGgJ4TbSCNzQXHy Table 1: List of datasets (data types) Table 1: List of datasets (data types) Strategy: list everything that we will touch as WP8-EiB and then define responsibilities (ET-PP; ET-O, …) - - - - Deliverables Deliverables: list and scope – what they are for? Who will access them? How? Milestones Milestones: workshops content management, indigo, …. Minutes Minutes: B2DROP, indigo, calendar, report and follow-up Mock Data Challenges Mock Data Challenges: management system, report, support tools, requirements gathering, size, responsibilities, … Code for data management Code for data management (workflows, procedures, files transfer, metadata management….) Code for scientific analysis Code for scientific analysis / other kind of code (who is responsible of managing what?) Training material Training material and documentation on computing model and data access Monitoring Monitoringand accounting (?) …. - - - - - ET Symposium - May 2024 8

  9. A final good news ET-PP Resources Resources available 20-200TB for 3 years + 3 VMs for testing purposes  MDC management/support Planned to test functionalities and usability of proposedservices (ET AAI needed). Supportguaranteed for ET-PP duration Migration toa more stable-definitive solution forall ET. B2DROP filesharing tool hosted at BSC adoptedby EIB/WP8 intesting phase Offered for testing to WP10, according totheir requirements. availablefrom the Spanish Supercomputing Network at BSC: ET Symposium - May 2024 9

  10. ET-PP Thank you! ET Symposium - May 2024 10

More Related