1 / 25

Intelligent Storage Systems

Intelligent Storage Systems. Module 1.4. Module Objectives. After completing this module, you will be able to: Describe components of intelligent storage system List benefits of intelligent storage system Explain intelligent cache algorithms and protection

Download Presentation

Intelligent Storage Systems

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Intelligent Storage Systems Module 1.4

  2. Module Objectives After completing this module, you will be able to: • Describe components of intelligent storage system • List benefits of intelligent storage system • Explain intelligent cache algorithms and protection • Describe intelligent storage array implementation • High-end storage array • Mid-range storage array Intelligent Storage System

  3. What is an Intelligent Storage System Intelligent Storage Systems are RAID arrays that are: • Highly optimized for I/O processing • Have large amounts of cache for improving I/O performance • Have operating environments that provide: • Intelligence for managing cache • Array resource allocation • Connectivity for heterogeneous hosts • Advanced array based local and remote replication options Intelligent Storage System

  4. Benefits of an Intelligent Storage System Intelligent storage system provides several benefits over a collection of disks in an array (JBOD) or even a RAID arrays: • Increased capacity • Improved performance • Easier data management • Improved data availability and protection • Enhanced Business Continuity support • Improved security and access control Intelligent Storage System

  5. Intelligent Storage System Front End Back End Physical Disks Cache FC SAN Components of an Intelligent Storage System Host Connectivity Intelligent Storage System

  6. FC SAN Intelligent Storage System: Front End Intelligent Storage System Host Front End Back End Physical Disks Cache Connectivity Ports Controllers Intelligent Storage System

  7. Front End Command Queuing A D C B A D C B A D C I/O Requests I/O Processing B Order Front-End Cylinders Controller Without Optimization (FIFO) A D C B A D B C A D C I/O Requests I/O Processing B Order Front-End Cylinders Controller With command queuing Intelligent Storage System

  8. FC SAN Intelligent Storage System: Cache Intelligent Storage System Front End Back End Physical Disks Host Cache Connectivity Intelligent Storage System

  9. Write Operation with Cache Write-through Cache Cache WriteRequest Acknowledgement Write-back Cache WriteRequest Acknowledgement Acknowledgement Intelligent Storage System

  10. Read Operation with Cache: ‘Hits’ and ‘Misses’ Data found in cache = ‘Hit’ Cache ReadRequest No data found = ‘Miss’ Cache ReadRequest Intelligent Storage System

  11. Cache Management: Algorithms • Least Recently Used (LRU) • Discards least recently used data • Most Recently Used (MRU) • Discards most recently used data New Data Oldest Data Intelligent Storage System

  12. Cache Management: Watermarking • Manage peak I/O requests “bursts” through flushing/de-staging • Idle flushing, High Watermark flushing and Forced flushing • For maximum performance: • Provide headroom in write cache for I/O bursts 100 % HWM LWM Idle flushing High watermark flushing Forced flushing Intelligent Storage System

  13. Cache Data Protection • Protecting cache data against failure: • Cache mirroring • Each write to the cache is held in two different memory locations on two independent memory cards • Cache vaulting • Cache is exposed to the risk of uncommitted data loss due to power failure Intelligent Storage System

  14. FC SAN Intelligent Storage System: Back End Intelligent Storage System Host Front End Back End Physical Disks Cache Connectivity Controllers Ports Intelligent Storage System

  15. FC SAN Intelligent Storage System: Physical Disks Intelligent Storage System Host Front End Back End Physical Disks Cache Connectivity Intelligent Storage System

  16. LUN 0 LUN 0 LUN 1 LUN 1 What the Host Sees – RAID Sets and LUNs Host 1 Intelligent Storage System Front End Back End Physical Disks Cache Connectivity FC SAN Host 2 Intelligent Storage System

  17. LUN Masking • LUN masking is access control mechanism • Process of masking LUNs from unauthorized access • Implemented on storage arrays • Storage group logical entity that contains one or more LUNs and one host Intelligent Storage System

  18. Also referred as Active-active arrays I/O’s are serviced through all the available path Following are high-end array capabilities: Large storage capacity Huge cache to service host I/Os Fault tolerance architecture Multiple front-end ports and support to interface protocols High scalability Ability to handle large amounts of concurrent I/Os Designed for large enterprises Controller Controller A B LUN Port Port ISS Implementation: High-end Storage Systems Active-Active Configuration Active Active Host Storage Array Intelligent Storage System

  19. Controller Controller A B LUN Port Port Midrange Storage Systems • Also referred as Active-passive arrays • Host can perform I/Os to LUNs only through active paths • Other paths remain passive till active path fails • Midrange array have two controllers, each with cache, RAID controllers and disks drive interfaces • Designed for small and medium enterprises • Less scalable as compared to high-end array Active-Passive Configuration Active Passive Host Storage Array Intelligent Storage System

  20. Module Summary Key points covered in this module: • Intelligent Storage Systems features • Components of Intelligent Storage Systems • Cache management algorithms • Intelligent Storage System implementation • High-end storage array • Mid range storage array Intelligent Storage System

  21. Concept in Practice: EMC CLARiiON • Support for UltraFlex technology • Scalable from up to 960 disks • Supports flash drives • Supports different types and sizes of drives, and RAID types (0, 1, 1+0, 3, 5, 6) • Supports up to 16 GB of available cache memory per controller (Storage Processor) • Enhances availability with non disruptive upgrade and failover • Ensures data protection through mirrored write cache and cache vaulting • Supports storage-based local and remote data replication • Through SnapView and MirrorView software Intelligent Storage System

  22. Storage Processor Storage Processor Multi-Core Processors Multi-Core Processors 4 Gb/s Fibre Channel Front-End CPU CPU CPU CPU CPU CPU CPU CPU FC Module FC Module CPU CPU CPU CPU CLARiiON Messaging Interface (CMI) CPU CPU CPU CPU FC Module FC Module Multi-Lane PCI-Express Bridge Link FC Module FC Module FC Module FC Module Power Supply SPS Memory Memory iSCSI Module iSCSI Module Fan Fan Fan Fan iSCSI Module iSCSI Module SPS Power Supply CPU Module CPU Module I/O Complex I/O Complex 4 Gb/s Fibre 4 Gb/s Fibre 4 Gb/s LCC 4 Gb/s LCC Channel Back-End Channel Back-End 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC CLARiiON CX-4 Architecture Intelligent Storage System

  23. EMC Symmetrix • Incrementally scalable to 2,400 disks • Supports Flash-based solid-state drives • Dynamic global cache memory (16 GB–512 GB) • Advanced processing power (up to 130 PowerPC) • Direct matrix Architecture • High data processing bandwidth (up to 128 GB/s) • Data protection with RAID 1, 1+0 (also known as 10 for mainframe), 5, and 6 • Storage-based local and remote replication • Through TimeFinder and SRDF software Intelligent Storage System

  24. ESCONhost attach Fibre Channelhost attach FICON, GigE, iSCSIhost attach FICON, GigE, iSCSIhost attach FICON, GigE, iSCSIhost attach FICON, GigE, iSCSIhost attach Fibre Channelhost attach ESCONhost attach ESCON Director FC Director Multi-Protocol CD Multi-Protocol CD Multi-Protocol CD Multi-Protocol CD FC Director ESCON Director Cntl Cntl Cntl Cntl Cntl Cntl Cntl Cntl Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Control and communications Signals Environmental control and status signals Environmental control and status signals 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory Control and communications Signals FC (Back-End) FC (Back-End) FC (BE or FE) FC (BE or FE) FC (BE or FE) FC (BE or FE) FC (Back-End) FC (Back-End) Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Cntl Cntl Cntl Cntl Cntl Cntl Cntl Cntl A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B Symmetrix Fibre Channel disk devices Symmetrix Fibre Channel disk devices Fibre Channel back-end director * Fibre Channel back-end director * Fibre Channel back-end director * Fibre Channel back-end director * Symmetrix Fibre Channel disk devices Symmetrix Fibre Channeldisk devices Battery backup Unit Modules Cooling Power supplies Service Processor Modem UPS Direct Matrix Architecture Intelligent Storage System

  25. Check Your Knowledge • What are the parts of an Intelligent Storage System? • What are the differences between a high-end and midrange storage array? • What is the difference between a read cache hit and a read cache miss? • What is the difference between Least Recently Used and Most Recently Used algorithms? • What is the difference between Write-through and Write-back cache? Intelligent Storage System

More Related