frontier at bnl n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
FroNTier at BNL PowerPoint Presentation
Download Presentation
FroNTier at BNL

Loading in 2 Seconds...

play fullscreen
1 / 12

FroNTier at BNL - PowerPoint PPT Presentation


  • 177 Views
  • Uploaded on

FroNTier at BNL. Implementation and testing of FroNTier database caching and data distribution. John DeStefano, Carlos Fernando Gamboa, Dantong Yu Grid Middleware Group RHIC/ATLAS Computing Facility Brookhaven National Laboratory April 16, 2009. What is FroNTier?.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'FroNTier at BNL' - ipo


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
frontier at bnl

FroNTier at BNL

Implementation and testing of FroNTier database caching and data distribution

John DeStefano, Carlos Fernando Gamboa, Dantong YuGrid Middleware Group

RHIC/ATLAS Computing Facility

Brookhaven National Laboratory

April 16, 2009

what is frontier
What is FroNTier?

A distribution system for centralized databases

  • Web service provides read access to database
  • Supports N-Tier data distribution layers
  • Developed by Fermilab for CDF data
  • Adapted by CMS at CERN
  • Used for distributing conditions data
frontier architecture
FroNTier architecture

CMS: FroNTier server with tiered Squids to cache database data

Image source: CERN Courier, http://cerncourier.com/cws/article/cnl/27615

frontier prerequisites and components
FroNTier prerequisites and components

FroNTier:

  • Java
  • Tomcat
  • Ant (optional, for development)
  • Xerxes XML parser (optional, for development)
  • Oracle JDBC driver libraries
  • FroNTier servlet

Cache:

  • Squid
  • Custom shared object libraries (deprecated)
  • HW prereqs/recommendations: 100+ GB, 2+ GB, 64-bit
initial test bed single node

Initial test bed: single node

Oracle Conditions database(one node)

2 active connections permitted

Frontier servlet

Squid cache

BNL LHC-OPN

Remote Squid/Frontier client requests

WAN

initial test bed two nodes

Initial test bed: two nodes

Oracle Conditions database(one node)

Frontier servlet

"Launchpad" node

Site server node

Squid cache(accelerator mode)

Squid cache

Short expiration time increasedfrom 10 minute to 1 hour

BNL LHC-OPN

Remote Squid/Frontier client requests

WAN

aglt2 results dual node configuration

AGLT2 Results:Dual-node configuration

Feb. 27 – March 2, muon reconstruction, 3 cosmic data (89507, 91060 and 91639) used:

20266 cosmic data jobs, 600 maximum job submission rate from UofM

83 crashes (all from 91060 data)

11115 cosmic data jobs, 738 maximum job submission rate from UofM

35 crashes

37626 cosmic data jobs, 738 maximum job submission rate from UofM

82 crashes; test terminated by Squid log size crash

Network glitches may have contributed to results

current test bed configuration

Current test bed configuration

Oracle Conditions database(one node)

Frontier servlet

Frontier servlet

"Launchpad" node

"Launchpad" node

Squid cache(accelerator mode)

Squid cache(accelerator mode)

F5 Big-IP Load Balancer

BNL LHC-OPN

WAN

Remote Squid/Frontier client requests

recent test activity from great lakes tier 2
Recent test activity from Great Lakes Tier 2

Two local Squid nodes at AGLT2

Connecting to load-balancing Frontier alias at BNL

    • 1-hour sample (4/7/09 6-7 AM): 414,000 load-balanced cache hits seen on Squids at BNL
  • Graph data courtesy of AGLT2 Cacti: Shawn McKee, University of Michigan
future plans
Future plans
  • Additional scalability tests for Reconstruction and Analysis jobs
  • Possible addition of more cache nodes to BNL test bed
  • Aid to additional T2s and other sites interested in testing
  • Implement Oracle/Frontier triggers to guarantee cache freshness and coherency, based on Oracle data modification times (Dave Dykstra at Fermi, Tier 0 DBAs at CERN)
references and resources
References and resources
  • CERN Frontier sitehttp://frontier.cern.ch/
  • CERN CMS TWiki: Squid for CMShttps://twiki.cern.ch/twiki/bin/view/CMS/SquidForCMS
  • Frontier at BNL:https://www.racf.bnl.gov/docs/services/frontier
  • US ATLAS Admins TWiki: Tier 2 Frontier configurationhttps://www.usatlas.bnl.gov/twiki/bin/view/Admins/SquidT2
  • BNL Frontier Mailing List:https://lists.bnl.gov/pipermail/racf-frontier-l
acknowledgments
Acknowledgments
  • RACF GCERobert Petkus, James Pryor
  • RACF GridCarlos Gamboa, Xin Zhao, Dantong Yu
  • US ATLAS Physics Application SoftwareShuwei Ye, Torre Wenaus
  • SLACWei Yang, Douglas Smith
  • FermilabDave Dykstra
  • TRIUMFRod Walker