1 / 8

Persistency Framework News for ATLAS

Persistency Framework News for ATLAS. Andrea Valassi (IT-ES) For the Persistency Framework team ATLAS Database Meeting , 7 th April 2011. Outline and summary. Recent developments and releases POOL, CORAL, COOL ( release s since Dec 2010 talk at ATLAS sw week )

ondrea
Download Presentation

Persistency Framework News for ATLAS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Persistency Framework Newsfor ATLAS Andrea Valassi (IT-ES) For the Persistency Framework team ATLAS Database Meeting, 7th April 2011

  2. Outline and summary • Recent developments and releases • POOL, CORAL, COOL (releases since Dec 2010 talk at ATLAS sw week) • Largest activity was on CORAL • Work in progress and open questions

  3. LCG 59b for ATLAS (Jan 2011) • Main motivation: POOL, CORAL, COOL patches • Previously expected in Dec 2010 internal release for SPI (delayed) • Complete the port to icc, drop support for Windows vc7 and slc4 • Upgrade to ROOT 5.26.00e, Qt 4.6.3p1 • POOL 2.9.11 • Many fixes and enhancements for ATLAS in collection packages • Support ROOT 5.28 streaming optimizationsin RootStorageSvc • CORAL 2.3.14 • Avoid ORA-24327 loop on network glitch (bug #58522) • Give precedence to CORAL_AUTHENTICATION[DBLOOKUP]_PATH over current directory for XML file lookup (bug #76297) • Internal consolidation of C++ tests (CppUnit) and qmtest setup • [NB: the 2.3.13 internal tag and 2.3.12 CMS tag are not included in any LCG release] • COOL 2.8.8 • Improve handling of NaN floats and doubles (bug #72147) • For full details see the release notes on TWiki

  4. LCG 60 for LHCb (Jan 2011) • Main motivation:upgrade in ROOT • Add builds with icc(for LHCb online) • Upgrade to ROOT 5.28.00 • Streaming optimizations in ROOT I/O (supported by POOL 2.9.11) • Mistake in ROOT builds adds a dependency on pcre (bug #77476) • POOL 2.9.11a • Rebuild of previous POOL 2.9.11 (for ATLAS in LCG 59b) • CORAL 2.3.14a • Rebuild of previous CORAL 2.3.14 (for ATLAS in LCG 59b) • COOL 2.8.8a • Rebuild of previous COOL 2.8.8 (for ATLAS in LCG 59b) • For full details see the release notes on TWiki

  5. LCG 60a for ATLAS (Feb 2011) • Main motivation:upgrade in Frontier client and ROOT • Upgrade to Frontier client 2.8.0 with performance optimizations • Upgrade to ROOT 5.28.00a • Fix pcre dependency issue (bug #77476) • Fix segmentation fault for empty containers (bug #77747) • POOL 2.9.12 • StorageSvc patch to allow writing built-in types via PersistencySvc • RootStorageSvc patch to adapt to ROOT fix for segmentation fault • CORAL 2.3.14b • Rebuild of previous CORAL 2.3.14a (for LHCb in LCG 60) • COOL 2.8.9 • Fix thread reentrancy issues in getenvand setenv (bug #78519) • For full details see the release notes on TWiki

  6. LCG 60b for ATLAS (Mar 2011) • Main motivation:upgrades in ROOT and Qt • Upgrade to ROOT 5.28.00b: fix I/O crash for vectors (bug #79235) • Upgrade to Qt 4.6.3p2: fix corrupted headers (bug #79099) • POOL 2.9.13 • RootStorageSvc and CollectionUtilities patches from/for ATLAS • CORAL 2.3.15 • Several fixes in OracleAccess • Avoid retrial loop if “ORA-28001 password expired” (bug #77440) • Throw (do not return false) if OCI fails in Cursor::next (bug #78178) • Internal changes in handling of different schemas • COOL 2.8.9a • Rebuild of previous COOL 2.8.9 (for ATLAS in LCG 60a) • For full details see the release notes on TWiki

  7. CORAL “network glitch” issues • Different issues reported by all experiments • e.g. ORA-24327 “need explicit attach” in ATLAS/CMS (bug #58522) • Fixed with a workaround in CORAL 2.3.13 (released in LCG 59b) • e.g. OracleAccess crash after losing session in LHCb (bug #73334) • Fixed in current CORAL 2.3.16 candidate (see below) • Work in progress since a few months (A.Kalkhof, R.Trentadue, A.V.) • Catalogued different scenarios and prepared tests for each of them • Prototyped implementation changes in ConnectionSvc and plugins • Current priority: fix crashes when using a stale session • May be caused both by network glitch and user code (bug #73834)! • A major internal reengineering of the plugins is needed (replace references to SessionProperties by shared pointers) • Done for OracleAccess in 2.3.16 candidate, pending for other plugins • The patch fixes single-thread issues; MT issues are still being analyzed • Next: address actual reconnections on network glitches • e.g. non serializable R/O transaction: should reconnect and restart it • e.g. DDL not committed in update transaction: cannot do anything

  8. More work in progress • Address recent bugs reported by the experiments • e.g. performance penalty from COOL exceptions (bug #79937) • API extensions to CORAL and COOL in the pipeline • e.g. many payload per IOV, replace ATLAS CoraCool (task #10335) • This breaks binary compatibility to previous releases • When will be a good time for ATLAS (offline/online) to release this? • Reviewing other pending requests for enhancements to plan ahea • What are the highest priorities from ATLAS (e.g. in COOL)? • CORAL performance studies and optimizations • e.g. comparison of Frontier and CORAL server • e.g. studies of solid state disks with IT-DB • Is there any other R&D that could be useful for ATLAS? • Prepare future changes in the development infrastructure • Port from CMT to cmake (with SPI and LHCb) • Move out of CVS eventually (to start with, of “LCG CVS”)

More Related