Using samba with a commercial clustered file system
This presentation is the property of its rightful owner.
Sponsored Links
1 / 22

Using Samba with a Commercial Clustered File System PowerPoint PPT Presentation


  • 116 Views
  • Uploaded on
  • Presentation posted in: General

Using Samba with a Commercial Clustered File System. Agenda. Isilon Clustered Storage Overview Developing OneFS Samba and OneFS Clustering Samba Future Requirements. Isilon OneFS Cluster. Work. Vert-Specific. Single file system (1.6 PB) Fully symmetric peers 3 to 96+ nodes

Download Presentation

Using Samba with a Commercial Clustered File System

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Using samba with a commercial clustered file system

Using Samba with a Commercial Clustered File System


Agenda

Agenda

  • Isilon Clustered Storage Overview

  • Developing OneFS

  • Samba and OneFS

  • Clustering Samba

  • Future Requirements


Isilon onefs cluster

Isilon OneFS Cluster

Work

Vert-Specific

  • Single file system (1.6 PB)

  • Fully symmetric peers

    • 3 to 96+ nodes

  • Fast intra-cluster network

    • InfiniBand

  • Multi-protocol access

    • CIFS

    • NFS

    • FTP

    • HTTP/WebDAV

    • Local userspace

Vertical-Specific Imagery for this sequence

3


What makes isilon onefs special

What Makes Isilon OneFS Special?

  • Single pool of storage

  • Granular data protection

    • Down to the file level

    • 8x mirroring or +4 recovery

  • Easy to manage and grow

    • Add additional nodes in 60 seconds

    • Automated data balancing

  • Extreme performance for concurrent access

  • POSIX and Windows semantics supported

4


Isilon iq network architecture

Isilon IQ Network Architecture

Servers

NFS, CIFS,

FTP, HTTP

Servers

(optional 2nd switch)

(optional 2nd switch)

Servers

Client/Application Layer

Standard Gigabit Ethernet Layer

Isilon IQ Storage Layer

Intracluster Communication Infiniband or GigE Layer

5


Writing a file with isilon iq

Writing a File with Isilon IQ

Servers

NFS, CIFS,

FTP, HTTP

Servers

(optional 2nd switch)

(optional 2nd switch)

(optional 2nd switch)

Servers

Work

Vert-Specific

6


Writing a file with isilon iq1

Writing a File with Isilon IQ

(optional 2nd switch)

Work

Vert-Specific

7


Writing a file with isilon iq2

Writing a File with Isilon IQ

Servers

NFS, CIFS,

FTP, HTTP

Servers

(optional 2nd switch)

(optional 2nd switch)

(optional 2nd switch)

Servers

Reading a File with Isilon IQ

Work

Vert-Specific

8


Using samba with a commercial clustered file system

Servers

NFS, CIFS,

FTP, HTTP

Servers

(optional 2nd switch)

(optional 2nd switch)

Servers

Reading a File with Isilon IQ

Work

Vert-Specific

9


Developer perspective

Developer Perspective

No Control

Full Control

  • File system

  • Kernel

  • Node’s userspace applications

  • Customer environment

    • Domain topology

    • Domain policy

  • CIFS client

  • NFS client

10


Samba in onefs

Samba in OneFS

2.2

3.0.24

Used over 4 years –

through

Isilon Kernel Supported Samba Requirements

  • Native Windows ACL storage & enforcement

  • Native createfile() syscall implementation

  • Alternate Data Streams

  • Snapshots with Volume Shadow Copy Service (VSS)

  • Zero-copy writes and other performance improvements

11


Samba in onefs continued

Samba in OneFS Continued…

  • Cluster coherent share-mode locking

  • Cluster coherent oplocks

  • Cluster coherent byte-range locks (in development)

  • Per-share case-sensitivity

  • Unicode normalization insensitive

  • Site locator support

  • Change notify

  • And more…

12


Ifs clustering protocols

IFS Clustering Protocols

smbd

nfsd

httpd

ftpd

bash

IFS

Distributed Lock Manager

(DLM)

Group Management Protocol

(GMP)

13


Onefs distributed locking under samba

OneFS Distributed Locking [under Samba]

Distributed Lock Manager

  • Expressive

    • Arbitrary contention tables

  • Two-tier model

    • Each node responsible for subset of cluster locks

    • Local lock caching

  • Properly Models

    • Share mode locks

    • Oplocks

  • Multi-protocol support without customized applications

14


Onefs group membership under samba

OneFS Group Membership [under Samba]

Group Management Protocol

  • Rich predicates

    • More than just node “available” / “unavailable”

    • Operations based off health of node

      • Individual I/O directions: Readable / Writeable

    • Predicates dependent on full cluster state

      • Degraded read as last resort

  • Group changes integrate with other modules

    • I/O automatically routed to available nodes

    • DLM can renegotiate

15


Ctdb on clustered file systems

CTDB on Clustered File Systems

Leverage Existing Technology

  • CTDB is a promising solution for POSIX clustered file systems

  • Some file systems extend capabilities

    • Native distributed locking mechanism

    • Native cluster membership tracking

    • Native ACLs and other feature obviate need for specific TDBs

  • Native solutions benefit from

    • Performance tuning

    • Build on existing testing and deployment

  • Samba should benefit from these capabilities when available

16


Samba 3 wish list

Samba 3 Wish List

Moving forward…

  • Abstract interface for TDB based solutions

    • Kernel based solutions and CTDB coexisting

    • Existing examples

      • iNotify for Linux

      • NTFS VFS layer in Samba 4

    • Beneficial to other vendors

17


Samba 3 wish list1

Samba 3 Wish List

Moving forward…

  • Increase communication

    • Share our features and bug fixes

    • Minimize parallel development

    • Vendor specific branches?

    • Ease merge burden

18


What we give back to the community

What We Give Back to the Community

Enterprise Testing and Deployment

  • Dedicated Windows enterprise QA team

    • Hundreds of bugs found

    • Integration in complex domain topologies

  • Real world deployment in large production environments

    • 50,000+ Users

    • 300+ Domain Controllers

  • Feature development

    • Windows 2008 Server Authentication

19


Isilon customers and leadership

Isilon Customers and Leadership

Select Customers

Recognition

"Isilon's clustered storage products will play a critical role in meeting the capacity and throughput requirements of leading applications.”

Richard Villars, Vice President of Storage Systems Research, IDC


Future

Future

2008 and Beyond

  • CIFS/Samba improvements

    • Many interesting challenges ahead

    • Clustered performance

      • Closer integration with world-leading clustered storage solution

  • Customer Focus

    • Our customers continue to push the envelope of Samba development

  • Growth

    • Continue to get more involved with Samba community

    • We need more protocols developers! (Come join us!)

21


Questions

Questions?

  • Steven Danneman

    • [email protected]

  • Tim Prouty

    • [email protected]

Contact


  • Login