Unt digital library storage architectures for digital collections
This presentation is the property of its rightful owner.
Sponsored Links
1 / 7

UNT Digital Library Storage Architectures for Digital Collections PowerPoint PPT Presentation


  • 78 Views
  • Uploaded on
  • Presentation posted in: General

September 27, 2010. UNT Digital Library Storage Architectures for Digital Collections. History. Similar to most academic libraries Library manages library infrastructure Average growth in technology needs Investment in high-end SAN solution Moving happily along… Until….

Download Presentation

UNT Digital Library Storage Architectures for Digital Collections

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Unt digital library storage architectures for digital collections

September 27, 2010

UNT Digital LibraryStorage Architectures for Digital Collections


History

History

  • Similar to most academic libraries

  • Library manages library infrastructure

  • Average growth in technology needs

  • Investment in high-end SAN solution

  • Moving happily along…

  • Until…

LOC - Storage Architectures for Digital Collections


Unt digital library program

UNT Digital Library Program

  • Sudden growth in digital content acquisition

    • Web archiving

    • Digitization projects

    • Born digital content

  • Unknown growth patterns

  • Unplanned system architectures

LOC - Storage Architectures for Digital Collections


Interim solutions

Interim Solutions

  • Scale out existing infrastructure

    • Not scalable at growth rate because of $$$

  • Build R&D infrastructure using new technologies

    • PetaBox infrastructure

    • Low-end SATA arrays

    • Great for R&D but weren’t adequate for production services

LOC - Storage Architectures for Digital Collections


Regrouped efforts

Regrouped Efforts

  • Define needs based on real patterns

  • Collaborative partnership with UNT Library Core IT services and Digital Library

  • Give and take on both sides

    • Moved to write once digital object model

    • Data spread across logical volumes and nodes

    • Just in time lookup of digital object locations

    • Abstract storage in application logic instead of overcoming with complex storage architectures

LOC - Storage Architectures for Digital Collections


Current solutions

Current Solutions

  • Large investment in Dell SATA based iSCSIInfrastructure ( MD3000i – 500 TB)

  • Arrays have different configurations based on need (6 different arrays)

  • Different RAID configuration based on system and data integrity needs (RAID-5, RAID-6 primarily)

  • Add new storage volume to DL environment, don’t grow existing volumes

  • Rebalance digital objects as storage arrays are replaced

  • Replicate across systems with technology neutral replication framework

LOC - Storage Architectures for Digital Collections


Next step

Next Step

  • Scale it up!!!

  • Invest in geographically separate replication location:

    • Tape infrastructure

    • iRods

    • Not managed by UNT (hopefully)

LOC - Storage Architectures for Digital Collections


  • Login