Wp1 grid workload management
This presentation is the property of its rightful owner.
Sponsored Links
1 / 11

WP1 Grid Workload Management PowerPoint PPT Presentation


  • 82 Views
  • Uploaded on
  • Presentation posted in: General

WP1 Grid Workload Management. Massimo Sgaravatto INFN Padova http://www.infn.it/workload-grid. Activities 2001. Driven by deliverables D1.1 Report on current technology Survey on existing Grid tools and frameworks

Download Presentation

WP1 Grid Workload Management

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Wp1 grid workload management

WP1Grid Workload Management

Massimo Sgaravatto

INFN Padova

http://www.infn.it/workload-grid


Activities 2001

Activities 2001

  • Driven by deliverables

    • D1.1 Report on current technology

      • Survey on existing Grid tools and frameworks

        • C. Anglano (TO), T. Ferrari, F. Giacomini (CNAF), F. Prelz (MI), M. Sgaravatto (PD)

    • D1.2: Definition of architecture

      • Internal WP1 architecture document

        • F. Giacomini (CNAF) main author

      • Participation to ATF to define the global EDG architecture

    • D1.3: Initial Workload Management System (1st release)

      • Code released to EDG-Integration Team


1 st release what and who

1st Release (what and who)

  • UI (User Interface) - DATAMAT

    • Command line for job management operations

    • Job Description Language (JDL) to specify job characteristics and requirements

  • RB (Resource Broker) – Catania

    • Responsible to choose the “best” resources where to submit jobs based on the constraint specified in the JDL and characteristics and status of resources (published in the Grid Information Service and Replica Catalog)


1 st release what and who1

1st Release (what and who)

  • JSS (Job Submission Service) – Padova

    • Responsible for job management operations

  • II (Information Index) – Milano

    • First filter to the Grid Information Service

  • LB (Logging & Bookkeeping) – CESNET

    • “State machine” view of each job

  • WP1 – WP2 interfaces - CNAF, PISA

  • Packaging - CNAF, PISA

  • Coordination (internal and with the other WP’s) - F. Prelz, M. Sgaravatto


Other 2001 activities

Other 2001 activities

  • Grid Accounting – Torino

    • Economy based model

    • Implementation of a first prototype on-going

  • Advance reservation and co-allocation - CNAF

    • Globus GARA evaluation


Planning for 2002

Planning for 2002

  • Bug fixes, improvement of functionalities

    • RB – Catania

    • JSS – Padova

    • II – Milano

  • Support for interactive jobs

    • RB – Catania

    • JSS - Padova

  • Grid accounting - Torino

    • Implementation of a prototype system and integration with the workload management system


Planning for 20021

Planning for 2002

  • Analysis of new and smarter scheduling strategies – Catania

  • Integration of network information in the matchmaking process within RB – CNAF, Catania, Torino

  • Advance reservation and co-allocation - CNAF

  • Triggering of data transfers – Catania, Torino

    • Add the ability to evaluate network throughput and decide on the convenience of transferring data to provide better scheduling options (this may involve some form of network bandwidth reservation)


Planning for 20022

Planning for 2002

  • Support for partitionable jobs

    • Padova

  • Job dependencies

    • CNAF

  • WP1 – WP2 interfaces

    • Pisa

  • Packaging of WP1 software, Participation to EDG-IT

    • CNAF, Pisa


Resources for year 2002

Resources for year 2002

  • Travel

    • Travel in Italy: 104 K€

      • 8 WP1 2-day meetings (Milano)

        • CT (2 people), CNAF (3 people), PD (4 people), PI (2 people), TO (4 people)

      • Integration activities (3 weeks)

        • CT (1 people), MI (1 people), CNAF (2 people), PD (1 people), PI (2 people), TO (2 people)

      • TB INFN-GRID and coordination activities (20 days)

        • MI (1 people), PD (1 people)

      • Conferences and workshops (5 days)

        • MI (1 people), PD (1 people), PI (1 people), TO (2 people)


Resources for year 20021

Resources for year 2002

  • Travel abroad: 153 K€

    • 3 EDG workshops (Paris, Edinburgh, ??)

      • CT (2 people), CNAF (3 people), MI (2 people), PD (4 people), PI (2 people), TO (4 people)

    • GGF4 - Toronto (4 days)

      • CT (1 people), CNAF (1 people), MI (1 people), PD (1 people), TO (1 people)

    • GGF6 - USA (4 days)

      • CT (1 people), CNAF (1 people), MI (1 people), PD (1 people), TO (1 people)

    • SC2002 – USA (1 week)

      • MI (1 people), PD (1 people)

    • 7 PTB – CERN

      • MI (1 people), PD (1 people)

    • Coordination – CERN

      • MI (1 people, 20 days), PD (1 people, 15 days)

    • Collaboration with Globus and GGF developers on Information Services

      • MI (1 people, 2 weeks)

    • Collaboration with Globus and GGF developers on Scheduling

      • CT (1 people, 2 weeks)

    • Collaboration with Condor developers

      • PD (1 people, 2 weeks), CNAF (1 people, 2 weeks)

    • Releases - CERN

      • CT (1 people, 5 weeks), PI (1 people, 5 weeks), CNAF (1 people, 7 weeks)


  • Login