1 / 16

The Role of DANSE at SNS

The Role of DANSE at SNS. Steve Miller Scientific Computing Group Leader. January 22, 2007. SNS Progress Update. NeXus – producing NeXus files and using NeXus routinely Data Reduction – operational for first three instruments, initially via command line, now via IDL GUI tools

harken
Download Presentation

The Role of DANSE at SNS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Role of DANSE at SNS Steve Miller Scientific Computing Group Leader January 22, 2007

  2. SNS Progress Update • NeXus – producing NeXus files and using NeXus routinely • Data Reduction – operational for first three instruments, initially via command line, now via IDL GUI tools • Commissioning Support – providing utilities on an as needed (regular) basis • Data Management – Adapted ICAT for accommodating individual users and groups, created a “check-in” utility as a proposal system proxy • Data Portal • Utilizes user and group permissions • Currently supports data browsing and metadata search • ISAW visualization tools adapted for use with the portal • Prototype version of the ‘Remote Display Conduit’ operational • Working with HFIR and LANSCE to make their data available via the portal • Simulation • McStas integrated with SNS portal and can demonstrate running jobs via MPI on the TeraGrid – works in progress DANSE Workshop 1/22-23/07

  3. Upcoming SNS Talks: • John Ankner – Software Commissioning and Development for the SNS Liquids Reflectometer • ReflPak integration with SNS • Pete Peterson – Status of the SNS/DANSE Reduction Effort • SNS Common Library • Jim Kohl – The SNS Portal: Web-Based Visualization, Analysis and Simulation • These will give more insight into SNS status, direction, and needs DANSE Workshop 1/22-23/07

  4. DANSE Workshop 1/22-23/07

  5. SNS Computing Hardware in Place SW Development Support User Support Instruments & Remote Instruments Support Portal Server Repository and Web Server Dev Portal Software Repository Analysis Computer Application Server Compute Server Development Server Data Server Database Server Dev Database Server Dev Data Server Analysis Computer Data Storage Metadata Catalog Metadata Catalog Data Storage DANSE Workshop 1/22-23/07

  6. SNS Science Goal for FY07 • Demonstrate new science on first three instruments! • Currently able to reduce data from these instruments • Using the following analysis software: • DAVE for the Backscattering Spectrometer • Reflectometers – planning to use ReflPak (installed @ SNS) • Various legacy software starting to surface (mostly FORTRAN) • Needs are arising for new, advanced analysis software, or for extending existing software – this presents opportunities for DANSE DANSE Workshop 1/22-23/07

  7. Facility Schedule DANSE Workshop 1/22-23/07

  8. Instrument Commissioning Software Support Event data histogramming tools Data exploration Data reduction Calibration Tools Create NeXus files DANSE Workshop 1/22-23/07

  9. Instrument Support Pattern Emerging… • Transform Initial Data to NeXus data • Perform data reduction • Discover that which needs to be automated • Produce support tools – currently using IDL • Make community or legacy code available for analysis • Currently very little time for SNS to produce analysis software… DANSE Workshop 1/22-23/07

  10. Pathway for Transforming Raw Data • Event Histogramming • Detector to Pixel mapping • Instrument Geometry • Metadata extraction • Create NeXus file • Catalog and Store • Reduce Data • All subsystems functional to some degree DANSE Workshop 1/22-23/07

  11. Future Work for FY 07 • NeXus • Instrument Definitions for next instruments • Complete automated “Live Cataloging” • Serve SNS, HFIR, and LANSCE (NPDF) initially • Data Reduction • Support for next instruments • Data Management • Long term storage utilizing HPSS • ICAT-3 development with ISIS • Testing • Live Cataloging • Data browse and search • “check-in” utility DANSE Workshop 1/22-23/07

  12. Future Work Continued • Portal Development • Continue Application Manager development • Continue “Weeerd-X” integration and test • Continue TeraGrid integration for running McStas • Add more data visualization and inspection tools • Incorporate data reduction within the portal • Support more data formats for visualization DANSE Workshop 1/22-23/07

  13. The Scientific Data Management Center for Enabling Technologies (SDM) – Arie Shoshani (~$3.3M/yr) • Kepler for data workflows, “Dashboard”, Data Mining, SRM • Center for Technology for Advanced Scientific Component Software (TASCS) – David Bernholdt (~$3.0M/yr) • CCA • Center for Enabling Distributed Petascale Science (CEDPS) – Ian Foster (~2.4M/yr) • Pyglobus, web services, application hosting service – K. Jackson • Interactions with SNS actively being defined DANSE Workshop 1/22-23/07

  14. Grid Computing • Continue to work closely with Neutron Science TeraGrid Gateway (NSTG) located at ORNL • Running distributed version of McStas • Utilizing MPI with event mode data being produced • Enabling McStas via SNS portal and will utilize a community account • Open Science Grid • Discussions with Ruth Pordes regarding collaborations and SBIR topics • Future – to put OSG software stack on NSTG • Providing grid computing seen as key to supporting a large computing user base – we’re still learning how to do this DANSE Workshop 1/22-23/07

  15. McStas Simulation Work • Meeting last week with the McStas development team at SNS • Attending: Peter Willendrup, Emmanuel Farhi, Kim Lefmann, Vickie Lynch, Meili Chen, Pete Peterson, Mark Hagen, Jiao Lin • Topics discussed: • NeXus Support • Event Mode data and file merging • Portal access to McStas • Sample kernels • Parallel and Distributed computing DANSE Workshop 1/22-23/07

  16. Summarizing the Role of DANSE at SNS • Providing analysis code to support instruments as they begin commissioning – getting “first science” from instruments is crucial! • Code re-use and sharing – taking first steps with the SNS common library, NeXus compatibility, and data reduction • Integration with SNS portal – how to add DANSE apps to this portal • Compatibility with grid computing – TeraGrid and OSG in particular • Compatibility with SciDAC efforts which SNS will be involved DANSE Workshop 1/22-23/07

More Related