1 / 13

NCAR/CISL/SCD User Forum

NCAR/CISL/SCD User Forum. Using the Mass Store Subsystem Efficiently May 19, 2005 Mike Page Consulting Services Group mpage@ucar.edu. Efficient Usage. NCAR Users CISL SCD.

meryle
Download Presentation

NCAR/CISL/SCD User Forum

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NCAR/CISL/SCDUser Forum Using the Mass Store Subsystem Efficiently May 19, 2005 Mike Page Consulting Services Group mpage@ucar.edu

  2. Efficient Usage NCAR\ Users CISL\ SCD

  3. Currently stores two petabytes of data Library of Congress (printed collection) 10 Terabytes Mass Store holds 200 * Library of Congress Data holdings increasing exponentially 1986 - 2 Tb 1997 - 100 Tb 2002 - 1000 Tb 2004 - 2000 Tb NCAR Mass Store Subsystem(MSS)

  4. Planning, planning, planning CSG/MSSG assistance available Is it a file server? Recommended file sizes Recommended volume of metadata operations Other keys to efficient usage Be selective in the data stored on the MSS Avoid repetitive reads/writes Choose class of service and retention periods according to value of data NCAR Mass Store Subsystem Capacity vs. Demand

  5. File purge policies If: • you are no longer active on any project • your project closes • you are no longer employed by UCAR/NCAR • you are doing periodic maintenance of your MSS files • You can: • delete your MSS files yourself • request that the SCD delete your files • change the project number to an active account • transfer ownership of the files to another user • transfer the data between the MSS and other media • 1 Terabyte > 300 DVDs • transfer data to another network location

  6. How to access information on your MSS holdingshttp://www.scd.ucar.edu/docs/mss/MSSholdings.html

  7. MSS Summary Report

  8. Summaries

  9. Class of Service

  10. msread msread [-eof] [-f fmt] [-l n] [-nomail] [-noretry] [-nowait] \ [-nowarn] [-R] [ -r rpass] [-u usrnm] loc_flnm [MSS_flnm] mswrite mswrite [-C cos[ [-c cmnt] [-eof] [-f fmt] [-l n] [-m n] \ [-nomail] [-noretry] [-nowait] [-P proj_num] [-r pass] \ [-t n] [-v vmn] [ -w pass] loc_flnm [MSS_flnm] msrcp msrcp [-a[sync] -cl[ass] cos -n[oreplace] -pe[riod] n \ -pr[oject] proj_num -rpwd rpass -wpwd wpass -R -V[ersion]] \ source_file [source_file...] target Mass Store Access from Command Line and Batch Scripts

  11. f90 -L /usr/local/lib -l mss test.f msread - retrieve file from mass store and make it local mswrite - write local file to mass store msrecall - wait for specific async read/write to complete mswait - check status of all queued async reads/writes to complete mserror - get error messages for last failed read/write MSS Access from User Applications

  12. The End

More Related