1 / 26

Sébastien Denvil, A. Caubel, MA Foujols, O.Marti, P. Brockmann, M. Mancip, M. Morgan

Climate Modeling Framework. Sébastien Denvil, A. Caubel, MA Foujols, O.Marti, P. Brockmann, M. Mancip, M. Morgan (IPSL Climate Modeling Center). Laboratories and funders. IPSL Earth System Model (ESM). Tropospheric chemistry & aerosols (INCA). Emissions. Physic – Transport

dchisholm
Download Presentation

Sébastien Denvil, A. Caubel, MA Foujols, O.Marti, P. Brockmann, M. Mancip, M. Morgan

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Climate Modeling Framework Sébastien Denvil, A. Caubel, MA Foujols, O.Marti, P. Brockmann, M. Mancip, M. Morgan (IPSL Climate Modeling Center) Integrated Modelling Technology workshop. June 2011

  2. Laboratories and funders Integrated Modelling Technology workshop. June 2011

  3. IPSL Earth System Model (ESM) Tropospheric chemistry& aerosols (INCA) Emissions • Physic – Transport • Atmosphere (LMDZ) • Surface (ORCHIDEE) • Ocean (NEMO/OPA) • Sea ice (NEMO/LIM2) • Coupler (OASIS) Land use Global climate Carbon / CO2(ORCHIDEE, NEMO/PISCES) Volcanoes Solar irradiance Stratospheric chemistry / ozone (REPROBUS) Various kind of Model Impacts studies Dynamical Downscaling (RCM) Regionalclimate Statistical Downscaling Integrated Modelling Technology workshop. June 2011

  4. IPSL Earth System Model (ESM) Tropospheric chemistry& aerosols (INCA) Emissions • Physic – Transport • Atmosphere (LMDZ) • Surface (ORCHIDEE) • Ocean (NEMO/OPA) • Sea ice (NEMO/LIM2) • Coupler (OASIS) Land use Global climate Carbon / CO2(ORCHIDEE, NEMO/PISCES) Volcanoes Solar irradiance Stratospheric chemistry / ozone (REPROBUS) Various kind of Model Impacts studies Dynamical Downscaling (RCM) Regionalclimate Statistical Downscaling Integrated Modelling Technology workshop. June 2011

  5. IPSL Earth System Model (ESM) Tropospheric chemistry& aerosols (INCA) Emissions • Physic – Transport • Atmosphere (LMDZ) • Surface (ORCHIDEE) • Ocean (NEMO/OPA) • Sea ice (NEMO/LIM2) • Coupler (OASIS) Land use Global climate Carbon / CO2(ORCHIDEE, NEMO/PISCES) Volcanoes Solar irradiance Stratospheric chemistry / ozone (REPROBUS) Various kind of Model Impacts studies Dynamical Downscaling (RCM) Regionalclimate Statistical Downscaling Integrated Modelling Technology workshop. June 2011

  6. Climate modeling framework drivers (1) • Get the right source code files, versions • Set the right parameters for compilation • Set up the input, use correct versions of datasets • Manage long production runs and R&D runs • Manage the output, post processing, figures • Perform integrity testing on model configurations • Make it simple to organize and share models • Be able to reproduce your actions later Integrated Modelling Technology workshop. June 2011

  7. LMDz 0.5° (50 Km) Climate modeling framework drivers (2) CMIP5 (Coupled Model Intercomparison Projet phase 5) 3TB distributed IPCC AR5 (Intergovernmental Panel Climate Change, Assesment Report 5) • Storage law scenario 565 TB • Storage high scenario 1000 TB • CMIP5 Distribution (25-50%) (140-280) (250-500) TB • Storage Total 700-1500 TB Integrated Modelling Technology workshop. June 2011

  8. Climate modeling framework drivers (3) • Move the data a minimum, keep them close to supercomputing centres if possible • When data needs to be moved do it quickly and with a minimum amount of human intervention • Keep a track of what has been produced, particularly what is on deep storage • Exploiting a federation of sites (HPC centers, clusters, …) Integrated Modelling Technology workshop. June 2011

  9. Information Model as a common ground In deployment currently In production currently Dashboard/Data access portal Execution Environment : Flexible, Modular and Interoperable Post processing Simulations Preparation Model Assembling Component Building Metadata and Configuring Data - DB Integrated Modelling Technology workshop. June 2011

  10. SCIENTIFIC PARTNER OR HPC COMPUTING CENTRES ... CCRT (CEA) IDRIS (CNRS) IPSL Meteo-France CORE (CMIP5+PMIP3+*MIP) R&D HTTPS / X509 HTTPS / X509 HTTPS / X509 PRODIGUER WEB SERVERS (IPSL) HTTPS / OpenID HTTPS / X509 HTTPS / X509 ESG GATEWAY IS-ENES METAFOR HTTPS / OpenID HTTPS / OpenID HTTPS / OpenID PRODIGUER COMMUNITY (Scientists, Researchers, Students) Integrated Modelling Technology workshop. June 2011

  11. Machines and storage at CCRT platine platine cesiumpost-treatmentinteractive and batch $LOCALTMPDIR $LOCALTMPDIR Machines titane titanefrontale mercure0xfrontendinteractive and batch mercure1x SX8R mercure2xSX9 Storage spaces Important files $HOME $WORKDIR $WORKDIR $WORKDIR Work Space Temporary $SCRATCHDIR $SCRATCH $TMPDIR $SCRATCHDIR $CSCRATCHDIR cp, getfer/putfer RESULTS dods $DMFDIR dmput/dmget dods_cp DEEP ARCHIVE Integrated Modelling Technology workshop. June 2011

  12. Machines and storage at IDRIS ulampost-treatment babelfrontend babel Machines brodiefrontend brodiex SX8 vargas vargasfrontend Storage spaces $HOME $HOME $HOME Important files $WORKDIR $WORKDIR $WORKDIR Work Space $TMPDIR $TMPDIR $TMPDIR $TMPDIR Temporary $HOMEGAYA mfput/mfget mfput/mfget RESULTS gaya dods $HOME dmput/dmget dods_cp DEEP ARCHIVE Integrated Modelling Technology workshop. June 2011

  13. Layered Schema of the underlying library Integrated Modelling Technology workshop. June 2011

  14. One Job for all configurations • Shell script functions, lightweight • HPC centers, 6 architectures • Workflow topology driven by configuration files • 3 persons needed to maintain • 30+ users (training sessions) • Weakness : • robustness to batch error handling & quota issues • need a supervisor • solution : message queuing Integrated Modelling Technology workshop. June 2011

  15. SVN servers Models sources Frontend Description of simulation Create and Submit the job Extraction (models and configuration) Job OK OK Job OK OK Compilation Access to storage server Computing machine Access to storage server RUN codes MPMD/MPI/ OpenMP Get Restart files Input files Put Restart files Ouput files Job OK Job OK OK OK NO NO STOP STOP NO End of simulation OK STOP Integrated Modelling Technology workshop. June 2011

  16. Frontend Description of simulation Create and Submit the job Extraction (models and configuration) Job OK OK Job OK OK Compilation Computing machine Access to storage server Access to storage server RUN codes MPMD/MPI/ OpenMP Get Restart files Input files Put Restart files Ouput files Job OK Job OK OK OK NO NO STOP STOP NO NO End of simulation Process outputs frequency OK OK Web access Access to storage server NO Visualization Analysis Process outputs STOP Results OK Analysis cluster Integrated Modelling Technology workshop. June 2011

  17. ApacheX509/OpenIDPythonPylonsJavascriptJqueryJSON Apache/phpJavascriptFerret netcdf opendap Dashboard and data access Integrated Modelling Technology workshop. June 2011

  18. Trusting Web Service Integrated Modelling Technology workshop. June 2011

  19. Portal Layers and Technologies Applications HTML+AJAX Architecture Stack Pylons Web Service Interfaces REST Query Interfaces SqlAlchemy DB Persistence Relational DB CIM Document Model XML Schema CIM Persistence eXist XML db • Under active development • 3 persons to develop/maintain • 100+ users • Mature technologies • Easy to add functionalities Integrated Modelling Technology workshop. June 2011

  20. Simulation Execution Environment (e.g. IGCM) What IF a layer goes down ? ... S 3 S 1 S 2 S N Events 100=Start 101=Stop Output .ini .netCDF Input .ini .netCDF .make Prodiguer Data Node Prodiguer Web Services Evolution : Durable Message Queuing SIMULATION MACHINE Prodiguer Simulation Monitor FIREWALL HTTPS / X509 Integrated Modelling Technology workshop. June 2011

  21. Simulation Execution Environment (e.g. IGCM) What IF a layer goes down ? ... S 3 S 1 S 2 S N Message Queue protocol AMQP Events 100=Start 101=Stop Output .ini .netCDF Input .ini .netCDF .make Message Queue library RabbitMQ • A standard ala HTTP • Supported Message Patterns: • Reliable Fire & Forget; • Broadcast; • File Transfer; • Supported by industry players • Parallel & scalable; • Persistence – i.e. durable • Multi-OS – i.e. ubiquitous; • Python – py-amqlib / txAMPQ Prodiguer Data Node Prodiguer Web Services Evolution : Durable Message Queuing SIMULATION MACHINE Prodiguer Simulation Monitor FIREWALL HTTPS / X509 Integrated Modelling Technology workshop. June 2011

  22. Evolution : Common Information Model http://metaforclimate.eu/trac/browser/CIM/tags/version-1.5 Why What How Model Model Experiment Simulation Input: Coupling Output: Data Software Component 1..* 0..* 0..1 Parent Requirement Conformance Name Properties Description Coupling Framework 0..* Child Integrated Modelling Technology workshop. June 2011

  23. Evolution : Common Information Model Data Software ISO Shared Quality Grids Activity Integrated Modelling Technology workshop. June 2011

  24. Lessons learned • To mitigate properly out of resources issues (cpu time exceeded, quota exceeded, key pieces off line, etc…) • You need agile workflow process that can reconfigure part of its settings to overcome related issue • A supervisor is mandatory to eliminate last few cases where a single job on its own can‘t handle error (when he has been killed) • To have an information model is a good idea • If none exist build your own • Don’t underestimate post-processing and data management burden • Build strong partnership with HPC providers is key to robustness Integrated Modelling Technology workshop. June 2011

  25. Evolution : Common Information Model CIM Tools Consumption Consumption Production CIM Applications Architecture Stack Web Service Interfaces CIM Tools Query Interfaces (CIM Document Model) CIM Persistence HTML+AJAX Pylons REST XML Difference Xquery XML-Schema eXist XML db HTML+AJAX Plone REST Faceted Browse Sparql RDF-S or OWL triplestore HTML+AJAX Django REST Creation Django queryset Django ORM Relational DB (Spot the common factor: three groups, all python) Integrated Modelling Technology workshop. June 2011

  26. Focus on software technology aspects, not on physics. • present the lessons learned • what is good in the concept • what is less good and what would do now if you had to redo it • For framework and workflow orchestration tools, discuss • maintainability • extensibility • and sustainability of the proposed solutions • How many computer specialists are needed to maintain and operate the framework ? • Is it easy to add functionalities ? • Is the User Community broad enough ? • What are the support / funding perspectives for a given technology ? Integrated Modelling Technology workshop. June 2011

More Related