1 / 16

File Storage in the 21 st Century Gregory Gurevich Technical Director March 2009

File Storage in the 21 st Century Gregory Gurevich Technical Director March 2009. ExaStore® Clustered NAS. Exanet product vision. Traditional NAS. Clustered FS. Simple Scalable Standard Enterprise-class. Complex Scalable Proprietary APIs HPC-focused. Simple Limited Standard

chaela
Download Presentation

File Storage in the 21 st Century Gregory Gurevich Technical Director March 2009

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. File Storage in the 21st Century Gregory Gurevich Technical Director March 2009

  2. ExaStore® Clustered NAS Exanet product vision Traditional NAS Clustered FS Simple Scalable Standard Enterprise-class Complex Scalable Proprietary APIs HPC-focused Simple Limited Standard Enterprise-class

  3. About Exanet Storage solution company founded in 2000 • Selling enterprise Clustered NAS solutions • Over 120 customers, over 170 systems in production • Over 7PB Installed • Target Markets: HPC, CAD / CAM, Digital Media, Web 2.0 • Over 20 unique patents in distributed file system technology • Largest installations – Nokia (600TB), BNF (600TB), Digitiliti (320TB) Technology • Clustered NAS and NAS Gateway with best price performance • Data Protection: Snapshots, Replication and Remote Monitoring • Virtual Volumes, Auto-Load Balancing, Adaptive Caching Key partnerships • Certified with major vendors for NAS Gateway option Exanet OpEx Rival OpEx Capacity

  4. Exanet Worldwide Customers COMPANY CONFIDENTIAL

  5. ExaStore clustered NAS LAN Enterprise-Class Solution High Performance Single file system Virtualized Storage Unlimited Capacity Single pool of storage

  6. Distributed file system WRITE • Features: • Single file system • Automatic striping across LUNs • Automatic I/O balancing • Benefits: • High utilization of HW resources (CPU, cache memory, LUNs) • Expand capacity and/or performance as needed with no impact on users or applications Session is initiated, new file is written thru VIP File is striped across LUNs ExaFS

  7. Adaptive caching READ READ READ Session is initiated, new file is read thru VIP. Parts of file are read from cache and disk leaving behind cache pages • Features: • Distributed cache • Adapts to workload: read/write, small/ large items • Benefits: • High metadata performance • High throughput • Enhanced scalability • Enables non-uniform access Subsequent read ops are served from cache ExaFS

  8. File system performance • Solution: • Aggregate small files for more efficient write operations • Directory read ahead – improve directory listing & browsing • Per-volume option for auto-distribute files to domains • Read cache propagation • Challenges: • Small file ops are slow • Multiple clients reading large files concurrently Utilize all hardware resources - Distributes data and metadata across all nodes Multiply system throuput by adding nodes Optimize storage performance - Aggregates small files into large writes 400MB/sec 400MB/sec 400MB/sec 400MB/sec

  9. Why we do so great? • Distributed architecture • Utilize computing resources of system components to their limits • Adaptive cache • Maximize performance through adaptive cache management – flexible allocation of read write cache, strong meta data bias, optimized for small and large file performance • Coalescing • Use large chunks, reduce the amount of transactions to storage • Localized allocation policy • Highly sophisticated adaptive algorithm which minimize interconnect traffic

  10. Why we do so great? (cont.) • Simple and efficient data flow • Every file can be read and cached by any of the distributed instances of ExaStore • Read cache propagation • Every instance of the distributed ExaStore may read and cache the data which is accessed by the clients that connected to it • Adaptive read ahead • Data read ahead – sequential reading, brings ahead to cache all the next data ranges to be read by the client • Directory read ahead – helps a lot for large directory that sequential behavior may spend quite a time

  11. Scalable Performance & Capacity • Capacity: • 500TB with 2-nodes • Over 128 billion files • Auto load balancing • Utilization monitoring • Performance: • Over 3,5 GB/sec* • >400,000 IOPS* • Adaptive caching • Performance monitoring High Capacity High Performance NOTE: All numbers relate to 8 nodesExaStore scales beyond

  12. Doing More with Less Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Exanet DX48 Traditional NAS Vendor 90% utilization 60% utilization 1PB

  13. ExaStore® Clustered NAS System KeyFeatures • Available in 2, 4, 6 and 8 nodes • EX1500 Server based on Quad-core • 1 or 10 Gigabit Ethernet • NFS, CIFS, FTP, AD/NIS/LDAP, SNMP • ExaVolumes, ExaSnapshots, ExaRestore ExaBalance, ExaSync, ExaMonitor Customer Benefits • Integrated scalable NAS • Up to 160% savings in power & cooling • 3X more net disk space in same footprint • Manage storage without addl. HW/SW

  14. Enterprise NAS key features • Virtual Volumes • Logical provisioning • >750TB, >128 billion files • Snapshots • 1,500 per vol, user-accessible • Instant DR for volumes, 1 min. frequency • Client Load Balancing • Automatic distribution, adapts to workload • Automatic failover w/o need for trunking • Block Based Replication • Standard Backup • Use standard backup application agents • Network backup, server-free, LAN-free

  15. Simplified Management • ExAdmin – Centralized management console • ExaMonitor – Built-in performance, capacity & HW monitoring, alerting, history • Call Home • Low TCO Remote support thru VPN speeds up problem resolution

  16. Performance Gap Leverage Commodity Hardware • Harness innovation of new hardware technologies • Servers, CPUs, memory, I/O bus • Disks, storage interfaces • Open architecture - Components can be added / replaced • Significant cost savings and performance value • Virtually no end-of-life

More Related