Online and Data Quality Monitoring
1 / 26

Online and Data Quality Monitoring - PowerPoint PPT Presentation

  • Uploaded on

Online and Data Quality Monitoring. Eduardo Rodrigues University of Glasgow LHCb VELO Software meeting, CERN, 6 April 2009. Online coordination : Kurt Rinnert Data Quality coordination : Eduardo Rodrigues

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about ' Online and Data Quality Monitoring' - jensen

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

Online and Data Quality Monitoring

Eduardo Rodrigues

University of Glasgow

LHCb VELO Software meeting, CERN, 6 April 2009

Online coordination: Kurt Rinnert

Data Quality coordination: Eduardo Rodrigues

Contributors: Eduardo (cluster monitoring), Sadia (track monitoring), Marco & Silvia (vertex monitoring), Marco (alignment monitoring), Malcolm (monitoring occupancy in HLT), Sara (Noisy & Dead strips), Abdi (noise vs voltage), James & Abdi (Landau fitting), Grant (Gain monitoring), Tomasz (TELL1 algorithm monitoring), Paula.

Monitoring: outline

  • A lot of recent work and progress – thanks everyone !

  • Monitoring algorithms:

    - Most algorithms fairly stable

    - A couple of new kinds on the block: e.g. gain monit., “expert” noise monit.

  • Monitoring analysis scripts:

    - area with main effort  a lot of new tools available

  • Wiki pages with documentation and HowTo’s are also being updated

Eduardo Rodrigues

Monitoring: algorithms packages

“VELO moni group”


  • Package for “high-level” (= ZS) data

  • 6 monitoring algorithms in CVS- 3 related to cluster monitoring: “standard”, “expert”, for HLT

    - 1 for time-alignment studies (sampling)

    - 1 for track-based monitoring

    - 1 relevant to monitoring of closing

  • Alignment monitoring part of track-based monit. algorithm

  • Vertex-based monitoring taken from Tr/TrackMonitors


  • Package for NZS data

  • Several algorithms for error banks / noise / pedestals / TELL1s / … monitoring

  • New algorithm for gain monitoring

Eduardo Rodrigues

Monitoring: scripts package VetraScripts

“VELO moni group”

  • Centrally collect scripts, macros, Python modules for monitoring and data quality analyses

  • Area on critical path a couple of months ago

  • Glad to see so much effort went into this recently: - 37 macros/scripts in CVS!(we may even need some clean-up due to large overlaps in code)

  • If you still have handy private scripts then let us know … ;-)

  • And please commit your code, even if not in its “final” version(remember it’s a CVS repository)


Eduardo Rodrigues

Online presenter (1/2)


  • Monitors ZS as well as NZS data

  • 2 monitoring tasks exist: - VeloDAQMon: clusters, noise, TAE, errors - VeloBeamMon: beam position for closing - track-based & alignment monitoring will either be added to VeloDAQMon or will get its own task

  • VELO online monitoring depends on Vetra project - has to follow faster release cycle of Online project by patching the current installation :S

Eduardo Rodrigues

Online presenter (2/2)

  • Now much easier to efficiently declare several pages (using new handy tools from Nicola for manipulating HistDB)

  • Available pages at present: default cluster monit., TAE monit. and per TELL1 noise pages

  • Implementation of pages is not yet complete. But it’s much easier compared to the past

  • Page layouts and histograms display options will evolve once we have user feedback

Eduardo Rodrigues

Online presenter: snapshots (1/2)


Eduardo Rodrigues

Online presenter: snapshots (2/2)


Eduardo Rodrigues

Online presenter: cluster-based monitoring

1 page inpresenter











  • # of clusters per event

  • # of strips per cluster

  • Cluster ADC value (all sensors)

  • Cluster ADC value (R sensors)

  • Cluster ADC value (f sensors)

  • # of clusters for sensor “i”(1 plot produced per sensor if nClus>0)

  • # of strips per cluster versus sensor

  • Cluster ADC value versus sensor

  • Active chip links versus sensor










Eduardo Rodrigues

Online presenter: track-based monitoring

Module mismatch

Biased residuals vs sensor


Local f coordinate

Presenter layout

 pop-up pages when clicking on each histo:

Original histo + “Used sensors” histo

The 8 histos related with residuals mean and s for R and f and A- and C-side

(clicking disabled)

Original histo + eta & f histos(global coords.)

Eduardo Rodrigues

Online presenter: vertex monitoring

Presenter layout

PV left-right delta x

PV position x

PV position y

PV position z

  • TrackVertexMonitor in Tr/TrackMonitors

  • (Need to include this algo. In the Vetra monitoring sequence)

Eduardo Rodrigues

New VeloExpertClusterMonitor algorithm

Abdi, James

  • New algo in Velo/VeloRecMonitors for “expert” cluster monitoring

  • Creates histograms of the ADCs for each sensor

  • Makes plots for raw and on-track clusters

  • Splits sensors into different regions of r, q and f

  • Histograms are viewed by new script (in Velo/VetraScripts)

Eduardo Rodrigues

New script (1/2)

Abdi, James

  • Displays plots of the ADCs of clusters and the number of strips in a cluster

  • ADCs are fitted with a Landau-Gaussian convolution to find MPV and FWHM

Eduardo Rodrigues

New script (2/2)

  • Also plots MPV vs sensor number

  • ADC values are angle corrected in the case of on-track clusters

Eduardo Rodrigues

Gain calibration (1/3)

Grant, Kazu

Can the “full header swing” (FHS) be used for this purpose? As long as low/high header distributions are distinct (like plot below) this is a clearly-defined and stable quantity.

Monitor the gain of links:

Initially through by looking at link headers

Next will look at test-pulse data

Goal is to calibrate links:

Can we somehow normalize link gains to some standard value?

Would be useful for eventual dE/dx measurements

Full Header Swing (FHS)

“Header-Low” distribution

Eduardo Rodrigues

“Header-High” distribution

Gain calibration (2/3)

Code to make these plots works with Vetra v7r0, and is in CVS of Velo/VeloDataMonitor, with ROOT macros in Velo/VetraScripts.

Can be used to quickly spot bad links

ROOT code in Velo/VetraScripts is able to plot:

FHS, FHS scaled by link noise

Average header value, average header value scaled by noise

RMS of HH, HL distributions

Link headers with unusually high (>600) and low (<400) ADC counts

Eduardo Rodrigues

Gain calibration (3/3)

Unusually high/low ADC counts:

Avg headers:

Link header distributions:

RMS of HH/HL distributions:

Eduardo Rodrigues

VELO monitoring & analysis GUI

Eduardo, Karol, Kurt, Paula

  • Consensus on how to run monitoring/analysis jobs: 1) run a PVSS recipe 2) “on button” run of a corresponding Vetra task 3) GUI to ease the display/analysis of histograms produced

  • Status of matters 1 month ago:- PVSS recipes exist since long (renamed recently)

  • In the meantime:- PVSS button to run Vetra task defined by Karol

    - New VELO monitoring GUI- has received many contributions ever since

Eduardo Rodrigues

VeloMoniGUI: snapshots (1/2)

Eduardo Rodrigues

VeloMoniGUI: snapshots (2/2)

Eduardo Rodrigues

Next on the TODO list (1/2)

  • Update on Vetra/Brunel monitoring sequences: - Not all algorithms set to run in our monitoring sequences - On-/off-line specific options to be checked(keep in mind that one needs .opts files online!)

  • Installation of Vetra and monitoring packages for shifters:- Regularly updated - But needs better handling: e.g., never change anything locally that is not in CVS or immediately committed to CVS ;-) - Some issues for the online version?

  • Discussion of shifters tasks: - we need to start thinking about our monitoring procedures at the pit - important for VELO shifters … and you’ve just learned this morning that we will have shifts very soon to start the training

Eduardo Rodrigues

Next on the TODO list (2/2)

  • We need to collect reference plots!- If you haven’t done so yet, please get in touch with me to get this sorted by the end of this week

  • Tutorials:- We recently had (on the 13th March) a first Vetra tutorial - More tutorials are foreseen, with special emphasis on monitoring

  • Documentation – my usual blabla: - Update twiki, remove old & obsolete pages, converge on overlapping pages, etc. - There’s been some activity. To be continued …

Eduardo Rodrigues

Outlook (apologies if I’m not aware of very latest updates)

Eduardo Rodrigues

Any comments?

Eduardo Rodrigues