Introduction to the NEEShub

1. Introduction to the NEEShub Ellen M. Rathje University of Texas at Austin NEEScomm IT Development Team

2. Welcome to NEEShub! We’ve got a HUB for that!

3. NEEShub • Project Warehouse: data repository • Tools and resources: • Databases • Simulation Tools • Reports • Simulation: info on simulation • Collaborate: group space, wish list

4. My NEEShub page Dashboard for your NEEShub activities Your Groups Your current tools sessions Your Projects in the Warehouse Your contributions to the NEEShub

5. My NEEShub page Dashboard for your NEEShub activities Your Wishes Your Messages The tools you use most often Your Tickets

6. Your NEEShub Spaces There are different levels of sharing and collaboration within NEEShub NEEShub Project Warehouse (private/ public) Group Spaces (restricted) Home Directory (private)

7. The Project Warehouse

8. The Project Warehouse A centralized data repository for managing, sharing, storing, and publishing research data

9. The Project Warehouse A centralized data repository for managing, sharing, storing, and publishing research data Drawings Mat’l Descriptions Data Descriptions Photos Publications

10. The Project Warehouse • Every project is created with the same structure • This provides consistency between projects and aids in the navigation of project information

11. The Data Model The model governing the organization of data within a project • Project Experiment Trial Repetition • A project represents an entire research project, which consists of a suite of tests and associated simulations • Each test is set up as an individual experiment • Within each experiment there are several trials or separate events for which data is measured • If the same trial is performed more than once, it may have multiple repetitions

12. Data Organization The model governing the organization of data within a project Project NEES-GC: Seismic Risk Mitigation for Port Systems Experiments Pile-Wharf Connection Test Sept 2007 Centrifuge Test of PV Drains Mar 2007 Crane Shake Table Test Nov 2009 Trials Sine1 Sine2 Sine3 Cyclic Load Shake1 Shake2 Repetitions Rep1 Rep1 Rep1 Rep1 Rep1 Rep1

13. Data Organization The model governing the organization of data within a project

14. The Project Warehouse A centralized data repository for managing, sharing, storing, and publishing research data

15. Types of Sensor Data Remember the data within the Project Warehouse is PUBLIC • For each repetition within a trial, there are four data folders that are automatically created • Unprocessed data (data collected by Equipment Site) • Raw voltages, channel names, potentially non-standard formats (e.g., binary files) • Converted data • Measurement units, instrument names • Corrected data • Filtering, baseline corrections, removal of bad data • Derived data • Corrected data plus values derived from measured data ASCII files recommended for all sensor data Put all channels into a single ASCII file

16. Data Requirements Data cannot be shared without proper documentation • Experiment Documentation • Metadata fields within the Project Display • Experimental Setup Report placed in Documentation folder • Sensor Measurement Data • Unprocessed • Converted • Corrected • Derived Uploaded by Researcher within 6 months of experiment Uploaded by Site within 1-month of experiment Uploaded by Researcher within 6 months of experiment Minimum data requirements: unprocessed data and sensor data in engineering units!

17. Project Warehouse Tools The nuts and bolts • The Project Editor • Edit project and upload files through web interface • The Project Explorer for NEES (PEN) • Efficient upload/download for bulk file management • Files organized offline and then uploaded • inDEED Data Viewer • Facilitates browsing/viewing/investigating data within Warehouse without download • Use inDEED data file format https://nees.org/tools/indeed/wiki/CSVFileFormat Today we will have hands-on exercises to demonstrate these tools

18. The Project Editor Projects are created using the Project Editor

19. Project Explorer for NEES (PEN2.1) Enhancing bulk upload of files

20. inDEED Data Viewer Facilitating data queries

21. inDEED Specimen Authoring Tool

22. Enhanced Projects Projects with Data Visualization

23. Enhanced Projects Projects with Data Visualization • Definition of Enhanced • Metadata fields in Project Display are complete (including drawings, material properties) • Project includes at least one visualization of data • inDEED is currently the only visualization tool that allows for viewing data within the NEEShub without download

24. Project Warehouse User Guide One-stop shop for documentation related to project warehouse

25. Curation An important process to ensure long-term re-use of data • Curation is requested by researcher at the experiment level • Should initiate within 6-months of an experiment • Digital Object Identifier (DOI) • Assigned at experiment level after curation • Data Papers in EERI EQ Spectra • New manuscript type focused on describing datasets

26. Databases • Collections of NEES and non-NEES data with a common theme • Data contained in figures in articles published by ACI Structural and Materials Journals and the Journal of Earthquake Engineering

27. Databases • Currently databases must be generated manually with earthquake engineers working together with NEEScomm IT team • Currently developing an auto-contribute feature (DataStore) • What databases are you interested in seeing? • Do you have a database you would like to contribute?

28. Group Spaces

29. Group Space An easy way to share content and conversation • Groups can be: • Public, restricted, or private • Purpose • To facilitate conversation, collaboration, and data sharing between group members • Discussions, wiki posts, and files are in one central location available to all group members • Generate a webpage for your project • Features • Wiki, messaging, discussion boards, and file sharing via the dropbox

30. Creating/Finding Groups

31. Project Groups • A group is automatically created for all projects created in the Project Warehouse • Group name has Project in title • Membership is controlled by project team members listed in the Project Editor

32. Group Space/Overview An easy way to share content and conversation About section can be expanded into a web page for your project

33. Group Space/Wiki An easy way to share content and conversation

34. Group Space/Discussion An easy way to share content and conversation

35. Group Space/Data Sharing An easy way to share content and conversation

36. Group Space Tools The nuts and bolts • SynchroNEES • A graphical user interface for transferring files • Local PC to/from NEES Group workspace • Local PC to/from NEES Personal workspace

37. NEEShub: Simulation Section

38. NEEShub: Simulation Tools

39. NEEShub: Simulation Wiki

40. NEEShub: Computational Models

41. Access to HPC Resources Access to: Kraken, Ranger, OpenScienceGrid, Steele and Hansen (Purdue)

42. NEEShub: a community • Contribute tools and resources to share with the community • Submit tickets to get problems/issues resolved • Submit wishes about things you would like to see on the NEEShub

43. NEEShub: a community

44. Contact Information • Cyberinfrastructure Release Committee (CRC) • Chair: Ellen Rathje (e.rathje@mail.utexas.edu) • Members: JoAnn Browning, Juan Caicedo, Shirley Dyke, Rudi Eigenmann, Tom Hacker, Ayhan Irfanoglu, Santiago Pujol • NEEScomm IT Director • Dawn Weisman (dweisman@purdue.edu) • Data Curator • Standa Pejsa (spejsa@purdue.edu)

45. Questions