slide1 n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) W GISS-18 September 2004 PowerPoint Presentation
Download Presentation
Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) W GISS-18 September 2004

Loading in 2 Seconds...

play fullscreen
1 / 26

Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) W GISS-18 September 2004 - PowerPoint PPT Presentation


  • 115 Views
  • Uploaded on

Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) W GISS-18 September 2004 Beijing, China. Storage Technologies. Online Storage Direct Attach Storage (DAS) Storage directly attached to server Network Attach Storage (NAS)

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) W GISS-18 September 2004' - engelbert-nathanial


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1

Archive Task Team (ATT)

Disk Storage

Stuart Doescher, USGS

(Ken Gacke)

WGISS-18

September 2004

Beijing, China

storage technologies
Storage Technologies
  • Online Storage
    • Direct Attach Storage (DAS)
      • Storage directly attached to server
    • Network Attach Storage (NAS)
      • TCP/IP access to storage typically with CIFS and NFS access
    • Storage Area Network (SAN)
      • Dedicated high speed network connecting storage devices
      • Storage devices disassociated from server
storage technologies1
Storage Technologies
  • Direct Attach Online Storage
    • Disk is direct attached to single server
    • System Configuration
      • SCSI or Fibre Channel
        • RAID Fibre Channel devices are typically SAN ready
      • Just a Bunch of Disk (JBOD)
      • Redundant Array Independent Disk (RAID)
    • High Performance on the local server
    • Manageability
      • Simple Configuration
      • Resource reallocation requires physical move of controllers and disk
storage technologies2

Host A

Host C

File System

File System

File System

Storage Technologies

Direct Attached

100Mb Network (FTP/NFS)

Host B

100MB FC

storage technologies3
Storage Technologies
  • Direct Attach Online Storage
    • Advantages
      • High performance on local server
      • Good for image processing and database applications
    • Disadvantages
      • Data sharing limited to slower network performance
      • Difficult to reallocate resources to other servers
storage technologies4
Storage Technologies
  • NAS Online Storage
    • Disk attached on server accessible over TCP/IP Network
    • System Configuration
      • Fibre Channel RAID Configurations
      • Switched Network Environment
    • Performance
      • Network Switches and/or dedicated network topologies
    • Reliability
      • NAS Server performs a single function thereby reducing faults
      • RAID, Mirror, Snapshot capabilities
    • Easy to Manage
storage technologies5

Host A

Host B

Host C

File System

File System

File System

Share Files

Storage Technologies

Network Attached

1Gb Network (NFS/CIFS)

NAS

Server

storage technologies6
Storage Technologies
  • Network Attach Online Storage
    • Advantages
      • Easy to share files among servers
        • Network Storage support NFS and CIFS
        • Servers can use existing network infrastructure
      • Good for small file sharing such as office automation
      • Availability of fault protection such as snapshot and mirroring
    • Disadvantages
      • Slower performance due to TCP/IP overhead
      • Increases network load
      • Backup/Restore to tape may be difficult and/or slow
      • Does not integrate with nearline storage
storage technologies7
Storage Technologies
  • SAN Online Storage
    • Disk attached within Fabric Network
    • System Configuration
      • Fibre Channel
      • RAID Configurations
    • Scalable High Performance
    • High Reliability with redundant paths
    • Manageability
      • Configuration becomes more complex
      • Logical reallocation of resources
storage technologies8
Storage Technologies

Redundancy SAN Configuration

Fibre

Switch

100Mb Network

Host A

Host B

Fibre

Switch

Host C

(DMF)

storage technologies9
Storage Technologies
  • SAN Online Storage Architecture
    • Disk Farm
      • Multiple servers share large disk farm
      • Server mounts unique file systems
    • Clustered File Systems
      • Multiple servers share a single file system
      • Software Required – Vendor solutions include
        • SGI CXFS
        • ADIC StorNext File System
        • Tivoli SANErgy
storage technologies10

Logical

reallocation

of disk

Storage Technologies

Disk Farm SAN Configuration

100Mb Network

Host A

Fibre

Switch

Host B

Host C

storage technologies11
Storage Technologies
  • SAN Risks
    • Cost is higher than DAS/NAS
    • Technology Maturity
      • Solutions are typically vendor specific
      • Application software dependencies
    • Infrastructure Support
      • Complexity of Architecture
      • Management of SAN Resources
      • Sharing of storage resources across multiple Programs/Projects
storage technologies12
Storage Technologies
  • SAN Benefits
    • Administration flexibility
      • Logically move disk space among servers
      • Large capacity drives can be sliced into smaller file systems
      • Scales better than direct attach
      • Integrate within nearline configuration
    • Data Reliability
      • Storage disassociated from the server
      • Fault Tolerant with Redundant Paths
    • Increase Resource Utilization
      • Reduce the number of FTP network transfers
      • Logically allocate space among servers
storage technologies13

Clustered

File System

Tape Library

Storage Technologies

SAN with Nearline Configuration

Fibre

Switch

1Gb Network

Host A

Host B

CXFS

Host C

DMF/CXFS

cr1 san nearline architecture

2Gb Fibre

1Gb Fibre

Disk Cache

/dmf/edc 68GB

/dmf/doqq 547GB

/dmf/guo 50GB

/dmf/pds 223GB

/dmf/pdsc 1100GB

Tape Drives

8x9840

2x9940B

CR1 SAN/Nearline Architecture

Ethernet

DMF Server

Product Distribution

future seamless silo architecture

DMF

FTP (lxs37)

PDS

Tape Library

8x9840

3x9940B

Future Seamless/Silo Architecture

Ethernet

CIFS

Mount

Data Servers

TP9300S

3TB

TP9400

Web/Extract

storage technologies14
Storage Technologies
  • Multi Tiered Storage Vision
    • Online
      • Supported Configurations
        • DAS – Local processing such as image processing
        • NAS – Data sharing such as office automation
        • SAN – Production processing such as product generation
      • Data accessed frequently
    • Nearline
      • Integrated within SAN
      • Scalable for large datasets and less frequently accessed data
      • Multiple Copies and/or Offsite Storage
storage technologies15
Storage Technologies
  • SAN – Final Thoughts
    • SAN Technology Maturity
      • SAN solution should be from a single vendor
    • Program/Project SAN solution benefits
      • Decrease storage requirements
      • Increase performance
      • Increase reliability
      • Increase flexibility of resource allocations
      • Increase cost (hardware/software)
      • Increase configuration complexity
storage architecture decisions
Storage Architecture Decisions
  • Optimized by individual program and program manager, not the enterprise.
  • Requirements Factors
    • Reliability – Data Preservation
    • Performance – Data Access
    • Cost – $/GB, Engineering Support, O&M
    • Scalability – Data Growth, Multi-mission, etc.
    • Compatibility with current Architecture
  • Evaluated and recommended through engineering white papers and weighted decision matrices.
additional reference materials
Additional Reference materials
  • 0403 Storage Matrix.doc
  • 040419 SAN Forum.ppt
  • 0407 storage overview.ppt
  • EDC CR1 Storage Architecuture.ppt