Management of a cooperative cache in grids l.jpg
This presentation is the property of its rightful owner.
Sponsored Links
1 / 18

Management of a Cooperative Cache in Grids PowerPoint PPT Presentation


  • 125 Views
  • Uploaded on
  • Presentation posted in: General

Management of a Cooperative Cache in Grids. Yonny Cardenas, Jean-Marc Pierson & Lionel Brunie LIRIS – INSA de Lyon/CNRS FRANCE. Outline. Introduction Grid Cache Model Cache Operations Cache Information Model Cache Service Implementation Conclusion. DATA. DATA. DATA. DATA.

Download Presentation

Management of a Cooperative Cache in Grids

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Management of a cooperative cache in grids l.jpg

Management of a Cooperative Cache in Grids

Yonny Cardenas, Jean-Marc Pierson

& Lionel Brunie

LIRIS – INSA de Lyon/CNRS

FRANCE


Outline l.jpg

Outline

  • Introduction

  • Grid Cache Model

  • Cache Operations

  • Cache Information Model

  • Cache Service Implementation

  • Conclusion

-


Data in grids l.jpg

DATA

DATA

DATA

DATA

Data in Grids

  • Grids need to operate and control large and numerous data in a distributed way.

  • Grid data dissemination requires important network and storage resources (data replica)

  • A significant quantity of these data are used only for a limited period of time (temporary data).

  • Without global coordination, these resources are used in an inefficient way.

-


Coordinated cache l.jpg

Coordinated Cache

CACHE

  • Caching has been demonstrated effective to manage temporary data.

  • Collaborative caches permit to reuse and to share data in distributed environments.

  • Multiple cache management mechanisms.

  •  Need to integrate such isolated caches into a global and coordinated grid service

CACHE

CACHE

-


Grid caching l.jpg

Grid Caching

  • Grids need high flexibility to change dynamically the parameters and schemes of collaborative caches

  • We propose a software infrastructure for managing coordinated caches

  • Operates and controls dynamically different cache mechanisms and cache schemes in grid.

  • Collaborative cache capacities are extended to manage distributed data

CACHE

CACHE

CACHE

CACHE

-


Cache model l.jpg

Coordination

Cooperation

Operations

Control

Storage

Cache Model

-


Storage layer l.jpg

Coordination

Cooperation

Operations

Control

Storage

Storage Layer

  • Interacts with the storage resources used by the cache

  • Abstraction layer that allows isolated and heterogeneous storage mechanisms interoperate.

-


Control layer l.jpg

Coordination

Cooperation

Operations

Control

Storage

Control Layer

  • Controls and monitors the requests to the data and transmits them to the storage layer

  • Individually applies particular control methods and policies for internal cache management

-


Cooperation layer l.jpg

Coordination

Cooperation

Operations

Control

Storage

Cooperation Layer

  • Supports intercache “classical” data requests.

  • Extends cache interactions to aspects related to monitoring and coordination of caches

  • Exposes its operations in a standard way accessible by a wide variety of clients

     Cache grid Service

-


Coordination layer l.jpg

Coordination Layer

  • Operates a coordinated management of multiple caches

  • Configures and establishes different mechanisms of collaboration (replication, fragmentation, migration…)

  • Collects and provides content and monitoring information :

    • description of cache content

    • data activity (accesses, transfers, etc)

    • cache activity (requests, replacements, etc)

Coordination

Cooperation

Operations

Control

Storage

-


Access operations publish data l.jpg

Access OperationsPublish Data

data

organization

cache

organization

PUT ?

cache

PUT

PUT ?

cache

PUT ?

GRID

cache

data

data

organization

-


Access operations retrieve data l.jpg

data

cache

organization

data

cache

GET ?

GET ?

cache

GRID

GET ?

cache

data

organization

Access OperationsRetrieve Data

-


Monitoring and management operations l.jpg

organization

cache

data

organization

cache

GRID

cache

Collective

Coordinator

cache

data

organization

Monitoring and Management Operations

Monitoring operations

  • data description

  • processed requests

  • transfers

  • replacements

  • used storage resource

  • Etc.

    Management operations

  • Set replacement method

  • Set default time to live

  • Set cache group

  • Set cache coordinator

  • Set collective work mode

  • Etc.

-


Information model l.jpg

Information Model

  • Storage information

    • storage resource

    • storage use

  • Cache information

    • Cache group

    • Cache coordinator

    • Cache replacements

    • Cache requests

  • Data information

    • data actions

    • data permissions

    • metadata

  • Transfers information

  • Defines the information to be exchanged between the components of the system

  • Represented as an XML DTD

-


Cache service implementation 1 2 l.jpg

DATA

DATA

LCS

DATA

DATA

Cache Service Implementation (1/2)

  • Local Cache Service (LCS) implemented as a grid service

  • Supports cache information exchange (XML)

  • Supports inter cache operations

    • Access Operations

      • Collective data retrieval

      • Collective data publication

      • Data content description

      • Transfers using GridFTP

-


Cache service implementation 2 2 l.jpg

LCS

LCS

LCS

Cache Service Implementation (2/2)

  • Monitoring Operations

    • Cache capacity

    • Data requests

  • Management operations

    • Dynamic configuration of replacement method

    • Dynamic configuration of data time to live

    • Dynamic configuration of cache groups

  • WSRF compliant

  • Developed using Globus Toolkit 4.1

  • Deployed in three French laboratories

  • -


    Conclusion l.jpg

    Conclusion

    • Grids manipulate large volumes of large data.

    • Collaborative cache can operate and organize such data for reuse and sharing.

    • In this work, a basic infrastructure is proposed for the coordinated management of collaborative caches.

    • This infrastructure operates and dynamically controls multiple cache mechanisms and cache schemes disseminated over a grid.

    • The main components of the proposed infrastructure are: a management reference model, an information cache model, a set of generic cache operations.

    • A set of tests are under progress to evaluate the volume of resources consumed by the system and the performance benefits.

    -


    Management of cooperative cache in grids l.jpg

    Management of Cooperative Cache in Grids

    Thank you !


  • Login