Ssb aggregation
This presentation is the property of its rightful owner.
Sponsored Links
1 / 14

SSB Aggregation PowerPoint PPT Presentation


  • 86 Views
  • Uploaded on
  • Presentation posted in: General

SSB Aggregation. Jacobo Tarragón IT/SDC September 23 rd , 2013. goals. integrate SAM site status computations into SSB reuse virtual metrics system. challenges. SAM metrics can’t be managed manually SSB Virtual columns are not flexible enough to implement SAM computations. the idea.

Download Presentation

SSB Aggregation

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Ssb aggregation

SSB Aggregation

Jacobo Tarragón

IT/SDC

September 23rd, 2013


Goals

goals

integrate SAM site status computations into SSB

reuse virtual metrics system

SSB Aggregation


Challenges

challenges

SAM metrics can’t be managed manually

SSB Virtual columns are not flexible enough to implement SAM computations

SSB Aggregation


The idea

the idea

  • provide a generic aggregation system on top of the current virtual metrics

    • arbitrary operations: AND, OR, …

    • horizontal: m1, m2, m3 for i1

    • vertical: i1, i2, i3 on m1

  • bootstrap SAM metrics from the profile description

SSB Aggregation


Design

design

  • new Virtual Collector

    • regular virtual metrics + SAM metrics

  • SAM metrics bootstrapped on every run

    • read profiles from POEM API

    • get or create metrics on the fly

SSB Aggregation


Bootstrapping 1 2

bootstrapping (1/2)

{ “name”: “ATLAS_CRITICAL” “algorithm”: “CE * SRMv2” “metrics”: { “CE”: [{“name”: “m1”, “FQAN”: “f1”}, {“name”: “m2”, “FQAN”: “f1”}], “SRMv2”: [{“name”: “m3”, “FQAN”: “f1”},{“name”: “m4”, “FQAN”: “f1”}] }}

(AND *) Site Status for ATLAS_CRITICAL(OR +) Site Flavour Status CE for ATLAS_CRITICAL (AND *) Service Flavour Status CE for ATLAS_CRITICAL m1_f1, m2_f1 (OR +) Site Flavour Status SRMv2 for ATLAS_CRITICAL (AND *) Service Flavour Status SRMv2 for ATLAS_CRITICAL m3_f1, m4_f1

SSB Aggregation


Bootstrapping 2 2

bootstrapping (2/2)

  • source metrics provided by MSG collector

  • vertical aggregations mapping provided via metric

  • complex operations need additional levels of aggregation

    (CE + CREAM-CE) * SRMv2(AND *) Site Status (OR *) Combined Flavour Site Status (OR *) Site Flavour StatusCE (OR *) Site Flavour Status CREAM-CE (OR *) Site Flavour status SRMv2

SSB Aggregation


Example start

example (start)

ATLAS_CRITICAL

site status metric

Arbitrary vertical aggregation

(service-country metric)

SSB Aggregation


Example site status

example (site status)

(CE + CREAM-CE + OSG-CE) * (SRMv2 + OSG-SRMv2)

Step aggregation:

Combined flavour status

Flavour status metric

(vertical aggregation over service status)

SSB Aggregation


Example flavour status

example (flavour status)

SSB Aggregation


Example service status

example (service status)

MSG metrics

SSB Aggregation


Good things

good things

  • SAM virtual metrics are stored as regular virtual metrics

    • minimal schema changes to store aggregation description

  • any metric may be a source metric, aggregations can get as complex as needed

SSB Aggregation


Not so good things

not-so-good things

reusing the SSB data loading system introduces a delay

a flavour can’t tell if a service testing one of its metrics must be considered

SSB Aggregation


To do

to do

move algorithm definitions to POEM

integrate old virtual collector

availability values

vertical aggregations visualization

SSB Aggregation


  • Login