1 / 61

THE ART OF STORAGE NETWORKING

THE ART OF STORAGE NETWORKING. 美国飞康软件公司简介. FalconStor Inc. NASDAQ 上市公司( FALC) 总部位于 Melville, New York 由 Cheyenne 软件公司的资深人员组成 成功地将 ARCserve 软件提升为企业备份首选方案 在存储、操作系统、网络方面具有丰富经验 提供 网络存储基础架构 软件 集中并虚拟化存储资源 ( SCSI, FC, iSCSI, SSA, InfiniBand..)

nydia
Download Presentation

THE ART OF STORAGE NETWORKING

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. THE ART OF STORAGE NETWORKING

  2. 美国飞康软件公司简介 • FalconStor Inc. NASDAQ 上市公司(FALC) • 总部位于 Melville, New York • 由 Cheyenne 软件公司的资深人员组成 • 成功地将 ARCserve 软件提升为企业备份首选方案 • 在存储、操作系统、网络方面具有丰富经验 • 提供 网络存储基础架构 软件 • 集中并虚拟化存储资源 (SCSI, FC, iSCSI, SSA, InfiniBand..) • 通过 SAN (IP, iSCSI, FC) or NAS (NFS, CIFS) 提供存储服务 Confidential

  3. Explosive Data Storage Growth 1,600 15¢ per MB 1,400 1,200 1,000 800 Petabytes 87% CAGR 600 400 2¢ per MB ($20,000 per TB) 200 0 1998 1999 2000 2001 2002 • Represents disk storage capacity sold annually as estimated by IDC • Storage costs as projected by Dataquest. Confidential

  4. Fundamental Shift in IT Spending Source: IDC By 2003, Server will become peripheral to Storage – Forrester Research Confidential

  5. Centralized Management of Storage Capacity & Storage Services. Cost of Distributed Data Management becomes Prohibitive SAN Centralized Management of Storage Capacity. Source: IDC & CIBC World Markets Confidential

  6. With Less (TCO) Do More (ROI) Today’s Business Climate Confidential

  7. 传统存储架构面临的挑战 • 复杂的存储异构环境 • 传统 SAN 和 NAS 的争议 • 功能强大的独立存储设备各自为政 • 传统 SAN 的安全机制，令人担忧 • 存储服务(SSP) 成本高居不下 • 从传统存储迁移到SAN，工程巨大 • 异地容灾投资巨大 Confidential

  8. 我们的理念 提供企业级强大的 网络存储基础架构 软件 实现存储虚拟化、资源服务和管理 Confidential

  9. Oracle Snapshot Agent SANergy Integration MS ExchangeSnapshot Agent Capacity On-Demand D5 D4 O.S. Integration D1 D3 D2 IP SAN FC SAN Management Block & File Access IP/iSCSI Fibre Channel Mirroring Snapshot Replication TimeMark Backup Virtualized Storage Pool NFS Service Enabler CIFS D1 D2 D4 In-Band Storage Aggregation D3 D5 ExistingLUN w/Data SCSI, FC, iSCSI, InfiniBand* Network Storage Infrastructure withEnd-to-End (O.S. - Storage) Manageability Confidential

  10. IPStor Servers 将存储与服务器分离 CIFS Folder • I/O 接 口 灵 活 SCSI, FC, iSCSI, Infiniband* • 设 备 中 性Compaq,EMC,Fujitsu,Hitachi,IBM,NEC,SUN.. • 独 立 传 输 SAN/IPtm, iSCSI, FC IPStor NAS Clients IPStor SAN/IP Client IPStor iSCSI Client IPStor FC Client IP SAN (LAN MAN WAN) Fibre Channel SAN Java Management Console SCSI iSCSI* Disks FC Disks SCSIDisks Storage Farm TapesLibrary Confidential

  11. Performance Security Availability Scalability Manageability Compatibility Reliability Network Storage Infrastructure • In-band Storage Virtualization • Vendor and Interface Agnostic SCSI, FC, iSCSI, Infiniband • Block[SAN] and File[NAS] Access • Protocol Agnostic FC, IP/iSCSI, CIFS, NFS • Operating System Integration • Platform Agnostic Win2K, Linux, Solaris, AIX.. • Generic Management Services • Backup, Mirroring, Snapshot, Replication, Capacity-On-Demand.. • Enterprise Integration Confidential

  12. Server-based (Distributed)Storage Management Cost Model App Server App Server App Server Management Cost ~= (Software + Labor + Hardware) x (Total #App-Servers) + 6.7 IT Managers per 2TB of storage Confidential

  13. Network-based (Consolidated)Storage Management Cost Model Consolidate Storage Services App Server App Server App Server Consolidate Storage Hardware IPStor Server FC, IP/iSCSI, CIFS, NFS Management Cost ~= (Software + Labor + Hardware) x (Total # IPStor Servers) + 1 IT Manager per 2 TB Storage Confidential

  14. IPStor’s Open Architecture • Evolve from a Server-Attached model … Objectives: Server and Storage Consolidation Improve Storage Utilization/Efficiency Gain Advanced Storage Services: Virtualization, Mirroring, Snapshot, faster Backup, etc. Lower TCO, Simplify Management Servers App Servers Users Ethernet LAN SCSI or Fibre Channel JBOD, RAID, TAPE Confidential

  15. IPStor’s Open Architecture Questions: Where to add Storage Services How to connect the storage back to the servers? • Detach the storage to form a separate Storage Farm Storage Farm Server Farm App Servers Users Ethernet LAN SCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential

  16. IPStor Servers FC Switch SCSI IPStor’s Open Architecture • Add IPStor Servers to manage the storage with intelligence • Scalable, Highly-Available, Low-Latency, Virtualized Storage Pool • Add physical storage to the pool without affecting existing logical allocation • Supports SCSI, Fibre Channel, iSCSI, and future InfiniBand Storage Farm Server Farm App Servers Users Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential

  17. IPStor’s Open Architecture • Create Virtual Drives from the available Storage Pool • Virtualize across drive, cabinet, protocol, and vendor boundaries • Just-in-time space management (Capacity On-Demand) Storage Farm Server Farm App Servers IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential

  18. IPStor’s Open Architecture • Add Storage Services such as: • Mirroring, Remote Replication, Snapshot, Zero-impact Backup… • All run on IPStor servers: no impact on App Servers Storage Farm Server Farm App Servers IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential

  19. IPStor’s Open Architecture • Provision the Virtual Drives to App Servers via Fibre Channel SAN • Key-based Authentication ensures totally secured access • Authenticated Diffie-Hellmann Algorithm Storage Farm Server Farm FC Switch FC SAN App Servers IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential

  20. IPStor’s Open Architecture • App Servers NOT conveniently connected to Fibre Channel? • Performance, Cost, Location, Platform Interoperability… ? Storage Farm Server Farm FC Switch FC SAN App ServersNot on FC SAN IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential

  21. IP SAN (iSCSI) Fast or Gigabit Ethernet Ethernet Switch IPStor’s Open Architecture • IPStor provides native IP-based SAN connectivity • Leverage existing Ethernet infrastructure and know-how • Ease of deployment and maintenance Storage Farm Server Farm FC Switch FC SAN IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential

  22. IPStor’s Open Architecture • IPStor SAN Clients (Windows NT, W2K, Linux, Unix…) • Provides Key-based security, automated configuration, and multi-path fail-over IP SAN (iSCSI) Fast or Gigabit Ethernet Storage Farm Server Farm Ethernet Switch FC Switch FC SAN IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential

  23. IPStor’s Open Architecture • Further consolidate File Servers with NAS (file share) support • CIFS/SMB and NFS for Windows and Unix clients • Unified SAN and NAS under a single storage infrastructure IP SAN (iSCSI) Fast or Gigabit Ethernet Storage Farm Server Farm Ethernet Switch FC Switch FC SAN IPStor Servers Users FC Switch SCSI Ethernet LAN NAS Folders SCSI, iSCSI, or Fibre Channel Based JBOD/RAID/TAPE Confidential

  24. IPStorTM软件架构 IPStor Server Management ServicesSNMP, Java NAS Client IPStor SAN Client Application Application Storage ServicesHA, Mirror, Replicate, Snapshot.. Operating System Operating System NAS (NFS,CIFS) I/O Virtualization SCSI driver Native NetworkRedirector Client Management Host Adapter Driver SANSCSI SANSCSI SCSI driver iSCSI iSCSI Fibre Channel Target Mode Driver Fibre Channel HBA Driver SAN/IP TCP TCP SAN/IP Host AdapterDriver TCP IP IP IP SCSI iSCSI FC,SSA Infiniband… IP SAN (LAN, MAN, WAN) Tape Fibre ChannelSAN Confidential

  25. Performance and Benchmark TM Software. That makes the difference! Confidential

  26. Scaleable Performance • IPStor’s Zero-Memory-Copy architecture ensures optimal throughput with no cache-memory • Small footprint (4 MB Flash) • Light demand on RAM (128 MB) • 64*66 PCI, one Gigabit Ethernet NIC w/ Jumbo Frame • Sequential R/W over 110 MB/s • Small packet I/O over 12,000 IO/s • 64*66 PCI, two Gigabit Ethernet NIC w/ Jumbo Frame • Sequential R/W over 180 MB/s • Small packet I/O over 15,000 IO/s • 64*66 PCI, one 1Gb FC HBA • Sequential R/W over 90 MB/s • Small packet I/O over 8,000 IO/s • 64*66 PCI, one 2Gb FC HBA • Sequential R/W over 180 MB/s • Small packet I/O over 23,000 IO/s Confidential

  27. 数据传输延迟分析 在千兆以太网上，将 # commands 设置为 3(IOMeter 参数)，IPStor 的SAN/IP 协议将产生 ~0.1ms 延迟。当I/O数据的大小超过4KB时， 这个延迟就显得微不足道了。 如果这个延迟比硬盘的巡道时间小很多的话，在并行I/O的情形下，这个延迟对应用将不会产生什么影响。 Confidential

  28. Independent Benchmark Results ExtremeLabs, Inc. “ExtremeLabs, Inc. performed three benchmark test series on FalconStor’s IPStor SAN. The results were chilling: IPStor SANs under test conditions outperformed local subsystems, and was rarely the source of any disk I/O latency as perceived by the benchmarks. The difference in performance between server I/O using a local disk subsystem and the IPStor SAN ranged from a rare 0.6% latency to a 7.2% gain in performance over local disk I/O.” - www.extremelabs.com Confidential

  29. IPStor Product Family • Advanced Solution Functionality • Snapshot • Disaster Tolerance • Zero-Impact backup • ……………… Base Solution Functionality • Virtualization • Connectivity • HA IPStor Full Version Capacity (735GB, 1000GB, above IPStor eLite Functionality Confidential

  30. IPStor’s Target Market • Optimize Storage Capacity Utilization • Eliminate Vendor Lock-In and Isolation • Maximize Interoperability, Connectivity • Reclaim Locked-up Free Space • Minimize the Deployment and Sustain Cost of Storage Services • SAN & NAS Unification • Volume Management • Backup/Recovery • Data Replication • Maximize Business Continuity (Availability) • SERvivorautomatic stand-in for failed application server • DynaPathreal-time recovery from path/link failure • Active-Active Fail-Overreal-time recovery from appliance failure • Mirroringreal-time recovery from disk failure • Replicationrecovery from site failure • TimeMark/TimeViewtrack/restore disk image by time (< 3 minutes) • Zero-Impact Backup/Restorebackup/restore data at 100 GB/Hour per LTO Confidential

  31. IPStor Solution TM Software. That makes the difference! Confidential

  32. Availability of Storage OS/Platform Neutral: NT, Win2K, Unix, Linux, Intelx86, Sun, RISC… SAN and NAS Provisioning App Server App Server App Server … Connectivity Neutral: FC, iSCSI, IP, InfiniBand … High-Availability (Failover) FC, IP, iSCSI SAN IPStor Java Management Console Virtualized Storage Pool Protocol/Vendor Neutral Virtual Storage Pool (SCSI, iSCSI, FC, SSA, JBOD, RAID…) Confidential

  33. Deferred investment of space 25%-100% Over Provisioning Minimal Over Provisioning $$$ Space Time Availability of Storage: High Utilization Efficiency Allocated, unused spaceUpfront investment Space Time • Non-Virtualized Model(No Dynamic Resizing) • Wasted Unusable pre-allocated Space • Upfront investment of total cost • Over-provisioning: Bad habit • Virtualized Model with Dynamic Resizing • Just-in-time allocation of needed space • Deferred investment of total cost of storage • Over-provisioning is eliminated Confidential

  34. Before … After Frequently Used Data StaleData Stale Data Migrate FC or IP SAN Free Space Allocate from IPStor Server Availability of Storage:Capacity-On-Demand (COD) Option • Optimize storage usage based on policy • Compress stale data • Migrate stale data • Enlarge virtual disk • Eliminate system downtime caused by “out-of-storage” • Reduce backup window • Transparent to application Frequently Used Data Stale Data Compress Free Space IPStor Physical Disks Virtual Disks Confidential

  35. Availability of Service - Active-Active Failover Eliminate Single Point Of Failure (SPOF) Clustered App Servers with optional IPStor SAN Client for Key-based Security and Discovery Clustered App Servers withIPStor SAN Client (IP/iSCSI Protocol) CIFS/NFSClients • End-to-end redundancy • Zero downtime for • HW/SW failures • Scheduled maintenance • Storage Expansion • Storage Migration • Cost of downtime • 1% Downtime is almost 4 days a year, costing $187 Million • Most business may never recover a 4 day outage Ethernet Switches IPStor Appliances in Active-Active Fail-Over mode heartbeat Fibre Channel Switches Dual Port RAID NAS NAS Mirrored Confidential

  36. Availability of Storage:Key-based Authentication App Servers withIPStor SAN Client • Centralized Management via a Java-based Console • Precise R/W access control • Encrypted management traffic • Key-based Authentication • Shared Secret Generated with Authenticated Diffie-Hellmann • Eliminates security hole of LUN-masking • Simplifies Zoning complexity • IP SAN Compatible with IPSec, 3rd Party VPN, etc. for complete data encryption R-Only R&W VPN IP SANLAN, MAN, WAN FC SAN VPN Industry’sFirst Encrypted Mgmt Session Java Management Console IPStor Serverand Virtual Storage Pool Confidential

  37. Stand-By Server SERvivor-Automatic recovery from Server failure Oracle DB2 Notes DynaPath -Automatic recovery from Path failure FC SAN IPStor Server IPStor Server IPStor Server Active-Active Fail-Over Automatic recovery from Appliance failure Real-Time Mirroring Automatic recovery from Diskfailure Data Center Disaster Recovery Site Business Continuity - Availability Replication over IP MAN/WAN Confidential

  38. Backup Consolidation • LAN Free Backup: preserves your existing backup procedure • Serverless Backup: Data Mover enables data to travel directly from disk to tape. • Zero-Impact: FalconStor’s unique approach to simplify backup/restore while achieving maximum performance Industry’sFirst Confidential

  39. Backup Consolidation: LAN-free Backup (on-site) withOff-the-Shelf Backup ApplicationsandTape Library/Drive Attached to IPStor Server LAN App. Server App. Server Backup Data Flow Backup App Backup App Virtual Disk Local Disk IP and/or FC SAN IPStor Server Virtual Disk Tape Library/Drive and RAID/JBOD attached to IPStor Server Off-the-shelf Backup Applications (e.g. Networker, ARCserve, Backup-Exec..) can perform ordinary backup/restore to/from a Tape Library/Drive attached to the IPStor Server over the IP-SAN. The Tape Library/Drives and the IPStor virtual disk appear as if there were locally attached to the App. Servers. To facilitate the sharing of Tape Library (with multiple Slots and Tape Drives) by multiple backup servers/applications on the network, vendor-specific hardware/software is needed to virtualize and partition the Tape Library. Confidential

  40. Backup Consolidation: Server-less Backup (on-site)Off-the-Shelf Backup Application,IPStor’s “Data Mover”andTape Library/Drive Attached to IPStor Server LAN App. Server App. Server Backup Data Flow Backup App Backup App 3rd Party Copy Command Local Disk Data Mover IP and/or FC SAN IPStor Server Virtual Disk Tape Library/Drive attached to IPStor Server To expedite data transfer between the virtual disk and tape, off-the-shelf Backup Applications (e.g. ARCserve) can issue 3rd Party Copy Command to instruct the Data Mover to read the designated sectors from the Virtual Disk and write them to the tape library/drive. To facilitate the sharing of Tape Library (with multiple Slots and Tape Drives) by multiple backup servers/applications on the network, vendor-specific hardware/software is needed to virtualize and partition the Tape Library. Confidential

  41. D: D: FC or IP SAN Step 1:Snapshot Request Step 2:Ack: Oracle inSnapshot Mode Total Time:A few seconds Step 4:Signals Oracle to resumesNormal Mode Step 3: Backup Starts; Snapshot Engaged Automatically BakBone Backup Consolidation: Zero-Impact Backup (on-site)Off-the-Shelf Linux Backup ApplicationandTape Library/Drive Attached to IPStor Server Industry’sFirst! Oracle D: virtual disk Step 5: Snapshot Backup continues at high speed while Oracle operates in normal mode. Over 100GB Per Hour Per Tape Drive verified. IPStor Server ‘DemoIPStor2’ D: Tape Library/Drive attached to IPStor Server virtual disk Confidential

  42. With IPStor TimeMark: Restore using Last Night’s Backup … Oops! Virus attack at 5:15PM 9:00AM TimeMark 10:00AM TimeMark 5:00PM TimeMark Business Continuity - Availability • Memorize Disk Image Periodically or On-Demand based on TIME • Provides a fast ‘undo’ function for data processing • Quickly restore disk to the designated state based on TIME • Enables incremental block-level backup of Oracle/Exchange.. Without IPStor TimeMark: Mission Critical Data Instant Roll-back To 5:00PM Mission CriticalData Business Interruption = Hours & Today’s work is lost! Business Interruption = Minutes & Today’s work is intact. Confidential

  43. R Backup Consolidation: Zero-Impact Backup (off-site)Off-the-Shelf Linux Backup ApplicationandTape Library/Drive Attached to IPStor Server LAN Backup Data Flow App. Servers IP-SAN (LAN,MAN,WAN) IPStor Server IPStor Server Linux Backup App Replication over IP R Tape Library/Drive attached to IPStor Server Data Center Disaster Recovery Center 1) The system administrator can replicate the data to the Disaster Recovery Center (or Vault). 2) The administrator in the DR Center can utilize off-the-shelf Linux Backup Applications (e.g. NetVault, NetBackup, etc.) on the IPStor Server to perform high-speed Snapshot (Point-In-Time Image) backup/restore of the virtual disks assigned to the application/file servers. Confidential

  44. Duplication of Data:Real-time Mirroring via Fibre Channel LAN App. Servers FC and/or IP SAN IPStor Server IPStor Server Real-time Mirroring Fibre Channel SAN M M Data Center Disaster Recovery Center Storage Device in the Data Center and the Disaster Recovery Center can have different interface (SCSI, SSA, FC), configuration (RAID-X, JBOD) Confidential

  45. R R R R Duplication of Data: Asynchronous Replication over IP LAN/MAN/WAN LAN Data Access Flow App. Servers IP-SAN (LAN,MAN,WAN) IPStor Server IPStor Server Linux Backup App Replicate Data over IP P P Tape Library/Drive attached to IPStor Server Data Center Disaster Recovery Center Storage Device in the Data Center and the Disaster Recovery Center can have different interface (SCSI, SSA, FC), configuration (RAID-X, JBOD) Confidential

  46. P R R P Duplication of Data: IP-based Remote Disaster Recovery LAN Data Access Flow App. Servers IP-SAN (LAN,MAN,WAN) IPStor Server IPStor Server Linux Backup App Tape Library/Drive attached to IPStor Server Data Center Disaster Recovery Center If Primary system fails, the Replica can be promoted as Primary for emergency access over IP. Confidential

  47. R R Duplication of Data: IP-based Remote Disaster Recovery LAN App. Servers IP-SAN (LAN,MAN,WAN) IPStor Server IPStor Server Linux Backup App Re-synchronize Data P P Tape Library/Drive attached to IPStor Server Data Center Disaster Recovery Center When Primary Data Center is back alive, a Reverse Replication process can re-synchronize the difference (updated data). Confidential

  48. Duplication of Data: Distributed to Centralized Only delta (changes) are replicated to remote site. T3 Line (45 Mb/s) can sustain 10 GB/h of data transfer. IPNetworkLAN, MAN, WAN IPStor Server IPStor SAN Client IPStor SAN Client disk arrays EMC or others Local Mirroring (RAID 1 or LVM) Local Mirroring (RAID 1 or Dynamic Disk) Application level mirorr will take up CPU time. But only when data is being migrated. Corporate Data Center Remote Replication Site Enterprise Customers Confidential

  49. Enterprise Level Management • End-to-end Performance Monitoring and Diagnostics • Cross-platform • Anytime-anywhere Administration • Usage Report • Integration with Tivoli NetView, HP Openview, CA Unicenter, etc. Confidential

  50. SAN & NAS 统一 App Server withIPStor SAN Client App Server using NFS or CIFS • 通过CIFS 和 NFS共享企业文件 • 最大限度利用存储资源 • SAN 和 NAS 从公用得存储池中分配磁盘块 • 为SAN and NAS提供公共服务 • Mirror, Snapshot, Replication, COD, Zero-Impact Backup.. • 统一的硬件和软件的管理 IP-SAN (LAN,MAN,WAN) IPStor Server NAS Access SAN Access Common Storage Resources for NAS & SAN Confidential

More Related