1 / 28

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

ADAQA An Accelerator Data Acquisition & Analysis Framework Bolko Beutner, Helge Brands, Rasmus Ischebeck. The Past Accelerator Data Acquisition Design Ideas The Present Available Tools Demo The Future Data Acquisition with Large Data Sets at 100 Hz.

uriah-holmes
Download Presentation

Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ADAQAAn Accelerator Data Acquisition & Analysis FrameworkBolko Beutner, Helge Brands, Rasmus Ischebeck • The Past • Accelerator Data Acquisition • Design Ideas • The Present • Available Tools • Demo • The Future • Data Acquisition with Large Data Sets at 100 Hz Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA 1

  2. What Came Before… • (my personal collection of accelerator data acquisition) • TESLA Test Facility at DESY, Hamburg • Access to accelerator process variables from MATLAB, C++ (read/write) • Easy to write data acquisition software, scan parameters, record variables… • Data stored in .MAT, ASCII & ROOT files • No common data format • Experts required to set up scan, analyze data… • SLAC LINAC at Stanford, California • VAX-based control system • Scan software to determine the dependency of a variable on a parameter • On-line display & fits • Writes MATLAB 4 files for further analysis Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA 2

  3. Design Goals • Have a universal scan and data acquisition software • Well-tested scan core • Universal GUI to set up scan easily • Specialized GUIs for easy access for regularly performed scans • Error checking and treatment • Common HDF5-based file format for easy access from any data analysis code • Automatic generation of logbook entries • Link to auxiliary information on accelerator configuration • Synchronized data acquisition Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA 3

  4. Data File Format • Hierarchical format to store Instruments • Based on HDF5 • Readable from Matlab, Root, Mathematica… Rasmus Ischebeck www.nexusformat.org 4

  5. Accelerator Data Acquisition • Many accelerator measurements consist of the following tasks: • Control 0…N actuators • Acquire 1…M measurements • Analyze data • Important features • On-line analysis • Reasonable error handling • Robust code for use by other persons than the programmer Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA 5

  6. ADAQA Layers • ADAQA consists of several separate building blocks • Applications, written by different programmers, make use of the same data acquisition code • Instruments gather connected devices • Logbook • Common data storage format • Online model* • Device information server* • Synchronized data acquisition • ongoing work, not yet ready for prime time Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA 6

  7. ADAQA Layers • Tree-like structure: • Many devices (roots) • One data acquisition core (trunk) • Many applications (branches) • Building blocks can be exchanged Applications Data Acquisition Devices Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA Wikipedia 7

  8. Synchronized Data Acquisition • All VME crates for diagnostics are equipped with an Event Receiver • Connected with a star topology network to the Event Generator • Supported for: • BPMs, Bunching monitor, RF, … • Ongoing work: • Laser shutter, oscilloscopes, cameras Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA Sven Nordquist 8

  9. ADAQA Applications • ScreenMonitorTool • General Purpose Scan Tools • Specialised Scan Tools • Slice Emittance • Optics Matching • Slit Scan • … • “Do it yourself! - Scan Tools

  10. ScreenMonitorTool • General purpose camera display andanalysis tool • In every day use for different kinds of cameras and screen monitors Dione and Saturn http://www.ciclops.org

  11. General Purpose Scan Tool

  12. the future…

  13. Scan Templates • Scans can be stored in Template files • The last scan is always stored as template • “Repeat Last Scan…”-Button • Data files are scan templates as well • All scans can be exactly repeated • Templates can handed over to the scan tool at startup • example: extracted charge vs. gun phase scan

  14. Specialised Scan Tools

  15. Specialised Scan Tools

  16. Automatised logbook entries

  17. Scan Tools Summary • General and specialised scan tools are possible with ADAQA • a wide variety of tools is available • Common data format • Templates • data files are templates – for all tools • Actions • e.g. automatic screen insertion or background subtraction • Analysis functions • Automatic logbook entries

  18. Do it yourself! - Scan Tools knob{1} = LoadKnobDefinition('ManagementKnob'); % setup Knob and Instrument knob{1}.SetpointValues = [1, 2.4, 3, 3.78, 92]; % scan setpoints instrument{1} = LoadInstrumentDefinition('SwissFEL_Meeting_Demo'); Setup.Function = 'scan'; % define scan setup Setup.Repeat = 10; % “shots” per scan step Info.Author = 'Beutner'; % human readable info Info.Title = 'SwissFEL Meeting Demo'; Info.Purpose = 'this is a small scan tool for demo...'; [DAQFileName, Setup, knob, instrument, Info] = ... daq(Setup,knob,instrument,Info); % execute scan % …insert your analysis code here…

  19. Image based measurements: today control room IOC EPICS Control+Data camera workstation AFS Helge Brands

  20. Image based measurements: today control room IOC EPICS Control+Data camera workstation • Problems: • available buffers on IOC are not used • „lost“ of measured data • high frequencies can‘t be reached • high CPU load on workstations AFS Helge Brands

  21. Image based measurements : future control room IOC EPICS Control+Preview camera workstation Results DATA Results+Data AFS Compute-Node Helge Brands

  22. Why? • less radiation • higher recording speed (10Hz/100Hz) • independent of the workstation (CPU and memory) • system is similar to SLS (Tomcat, in operation, 1* PCO Edge) Helge Brands

  23. Why? • less radiation • higher recording speed (10Hz/100Hz) • independent of the workstation (CPU and memory) • system is similar to SLS (Tomcat, in operation, 1* PCO Edge) BUT Helge Brands

  24. Technical values more storage needed example: ~30TB/week Helge Brands

  25. Specs Helge Brands

  26. Current situation • WHLA: each Camera-IOC has 1GB/s (enough for 10Hz) • 3 PCO Edge in operation + 1 PCO Edge in preperation • upload to AFS max 50MB/s • software is ready for 100Hz • needed network speed 10GBit/s for 100 Hz • other GIGE cameras can be used too • additional compute nodes should be planned • storage policies are needed Helge Brands

  27. ADAQA ADAQA • Project started in 2008, always between 5 and 10 developers • Written mostly in Matlab • 89093 lines of code (including code sourced from MathWorks Central and other external sources) • Performed 22775 scans, resulting in 558 GB of data • A joint project between the Controls, Beam Dynamics & Diagnostics Sections at PSI Diagnostics Beam Dynamics Controls Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA 31

  28. Outlook • We are looking forward to many new applications for SwissFEL! • Thank You to: • all ADAQA programmers and users, in particular Eduard Prat, Marta Divall, Peter Peier, Marc Guetg, Gian Luca Orlandi, Bennie Smit & Thomas Schietinger • support from Jan Chrin & Babak Kalantari Bolko Beutner, Helge Brands, Rasmus Ischebeck: ADAQA Sven Nordquist 32

More Related