1 / 14

Progress June-December 2017

Progress June-December 2017. Experiment Control & Data Reduction June – December 2017 Progress. Data Reduction. Full Development Team Simon Heybrock, Owen Arnold, Lamar Moore Temporary Development Effort Anton Piccardo-Selg (October 2017 – January 2018). 2.

wayneh
Download Presentation

Progress June-December 2017

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Progress June-December 2017 Experiment Control & Data Reduction June – December 2017 Progress

  2. Data Reduction Full Development Team Simon Heybrock, Owen Arnold, Lamar Moore Temporary Development Effort Anton Piccardo-Selg (October 2017 – January 2018) 2

  3. Instrument 2.0 Shipped in Mantid • Work is about optimized high-level geometry and operations for geometry access in data reduction • Much, much faster than before for reads, but also for writes! • Subsequent work now commenced on porting Instrument View to Instrument 2.0 started November 2017 3

  4. Scanning Collaboration with ILL Sub-project collaboration started February 2017. Agreed as follows: • ESS to provide infrastructure changes to Mantid to allow step scans • ILL to provide high-level functionality (loaders, algorithms etc.) • ILL to add to user program, optimize and stress test 2017-2018 4

  5. Scanning Collaboration with ILL Success! Image below November 2017. D2B • 250 Scan Points • 128 Tubes • 128 Pixels per Tube 5

  6. Distributed Data Reduction: Infrastructure • Providing common concepts that abstract algorithm authors from the low level details of MPI approach • Topics are too detailed to present here. Lamar Moore & Simon Heybrock major contributors. • Proved to work on real workflows 6

  7. Distributed Data Reduction: Distributed Load Event Nexus • New approach for distributed and load balanced parsing of Event Nexus files. • Promising scalability, currently under test at ISIS and ESS • Further optimizations needed 7

  8. Distributed Data Reduction: Sparse MD Data Structures Started a 3-month sub project to elicit understand and design for ESS multi-dimensional needs. Must get this right or will throttle processing for several technique areas • Lead by Anton Piccardo-Selg • Sparse and Histogram data handling under consideration • Several promising approaches already established • Prototyping underway Space filling curve for an adaptive mesh 8

  9. Nexus Geometry • New Nexus Geometry Proposal • Joint project ID/DM • Prototyping started over summer 9

  10. Experiment Control Staff Full Development Team Michael Hart, Nikhil Biyani Steering Freddie Akeroyd, Mark Koennecke, Owen Arnold 10

  11. Lewis • Two major releases 1.1 and 1.2 since start of June • Adopted by ISIS/IBEX for all development • Support for multiple access protocols • scanf support • Control server now runs in it’s own thread • Better support for EPICS stream protocol (read timeout) 11

  12. Nicos with InstrumentView • Live motion updates based on moveable devices 12

  13. Nicos with InstrumentView • Displaying events streamed via kafka • Displaying histograms streamed via kafka (in progress) 13

  14. Upcoming ECP Activities • Ongoing support for NICOS at V20 and Utgard • Synchronize NICOS to EPICS polling • RPM for NICOS • Collaborative work with FRMII NICOS team with Mantid 14

More Related