1 / 54

TDC 564 Local Area Networks Lecture 8 IP-based Storage Area Network

TDC 564 Local Area Networks Lecture 8 IP-based Storage Area Network. Course Outline. IP over FC (RFC 2625) IP-SAN iSCCI (RFC 3720) IP and FC-SAN Interworking FC Encapsulation (RFC 3643) FCIP (RFC 3821) – FC over IP iFCP (RFC 4172). RFC 2625 – IP and ARP over FC.

eljah
Download Presentation

TDC 564 Local Area Networks Lecture 8 IP-based Storage Area Network

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TDC 564Local Area Networks Lecture 8IP-based Storage Area Network TDC564-08

  2. Course Outline • IP over FC (RFC 2625) • IP-SAN • iSCCI (RFC 3720) • IP and FC-SAN Interworking • FC Encapsulation (RFC 3643) • FCIP (RFC 3821) – FC over IP • iFCP (RFC 4172) TDC564-08

  3. RFC 2625 – IP and ARP over FC • FC supports multiple higher layer protocols, and SCSI is the most widely used one. • Needs/Applications of IP over FC: • Access data in SAN from IP-based servers • interworking between NAS and SAN • RFC 2625 addresses two issues. • A scheme to encapsulate IP and ARP packets inside the FC frame (as the FC payload) • A procedure to resolve the address mapping TDC564-08

  4. SAN SAN IP over FC (RFC 2625)App-1: accessing SAN from IP-based servers FC-based Storage Device FC/IP Gateway Data Data IP IP IP IP L2 L2 RFC 2625 RFC 2625 PHY PHY FC FC FC TDC564-08

  5. SAN SAN IP over FC (RFC 2625)(App-2: interworking between SAN and NAS) NAS-based Storage Device FC/IP Gateway FC/IP Gateway Data Data IP IP IP IP IP IP L2 L2 RFC 2625 RFC 2625 L2 L2 PHY PHY FC FC FC PHY PHY TDC564-08

  6. FC Address Resolution • Three steps schemes • ARP - IP to MAC • MAC => World-Wide Port Name (WW_PN) • FC-ARP - WW_PN => Port_ID • Optional Header is used for Network Header by RFC 2625 D_NAA (4) Dst. Network Address (60) 16 bytes S_NAA (4) Src. Network Address (60) Format of Network Header NAA: Network Address Authority unused (12 bits) IEEE 802.3 MAC Address (48 bits) Format of Network Address (WW_PN) TDC564-08

  7. RFC 2625: IP and ARP over FC (1) ARP Request (broadcast) - Sender HW (MAC) Address = HW(A) - Sender IP Address = IP(A) - Target HW (MAC) Address = ?? - Target IP Address IP(B) A FC SAN FC switch C B D TDC564-08

  8. RFC 2625: IP and ARP over FC (2) ARP Reply (unicast): - Sender HW (MAC) Address = HW(B) - Sender IP Address = IP(B) - Target HW (MAC) Address = HW(A) - Target IP Address IP(A) A C B D TDC564-08

  9. RFC 2625: IP and ARP over FC (3) FC-ARP Request: - Requester N_Port_Name (WW_PN) - Requester N_Port_ID - Responder N_Port_Name (WW_PN) - Responder N_Port_ID = ?? A C B D unused (12 bits) IEEE 802.3 MAC Address (48 bits) WW_PN TDC564-08

  10. RFC 2625: IP and ARP over FC (4) FC-ARP Reply: - Requester N_Port_Name - Requester N_Port_ID - Responder N_Port_Name - Responder N_Port_ID A C B D TDC564-08

  11. Advantages of IP for SAN TDC564-08

  12. IP Network Capabilities TDC564-08

  13. IP-SAN Protocols TDC564-08

  14. FC -SAN IP IP IP - SAN Storage Devices TDC564-08

  15. IP - Storage Area Network (SAN) • IP storage networking – carrying storage traffic over IP • Uses TCP, a reliable transport for delivery • Can be used for local data center and long haul applications • Two primary IETF protocols/standards: • iSCSI – Internet SCSI – allows block storage to be accessed over a TCP/IP network as though it were locally attached • FCIP – Fibre-Channel-over-IP – used to tunnel Fibre Channel frames over TCP/IP connections IP TCP iSCSI SCSI Data IP TCP FCIP FC SCSI Data TDC564-08

  16. Internet SCSI (iSCSI) • iSCSI is a proposed industry standard that allows SCSI block I/O protocols (commands, sequences, and attributes) to be sent over a network using the popular TCP/IP protocol. • A way to access storage across an IP network as though it was locally attached. • Transports SCSI protocol commands and data across an IP network • Cisco and IBM co-authored original iSCSI protocol draft • iSCSI Protocol is a standard maintained by the IETF • IP Storage (IPS) Working Group • RFC 3720 TDC564-08

  17. iSCSI TDC564-08

  18. iSCSI over TCP/IP SCSI Command Command Data Command Data TCP Header TCP Payload TDC564-08

  19. iSCSI Applications • Connectivity : iSCSI can be used for DAS or SAN connections. • iSCSI capable devices could be placed on an existing LAN (shared with other applications) in a similar way to NAS devices. • iSCSI capable devices could be attached to a LAN which is dedicated to storage I/O (in other words an IP SAN), or even on a LAN connected to only one processor (like a DAS). TDC564-08

  20. iSCSI Protocol Stack iSCSI TCP Offload Engine (TOE) iSCSI Host Bus Adapter (HBA) Software iSCSI Data Data Data Host Processing SCSI SCSI SCSI iSCSI iSCSI TCP Driver IP Driver iSCSI TCP TCP Adapter Card Driver IP IP Ethernet Ethernet Ethernet PHY PHY PHY Host Bus Adapter (HBA) TDC564-08

  21. iSCSI Performance Consideration TDC564-08

  22. iSCSI Benefit TDC564-08

  23. Host Bus Adapter (Fibre Channel) QLogic PCI-EXPRESS 4Gb 1PT Fibre Host Bus Adapter – STD FW •  PCI-Express • •  1 Port (Fibre Channel) •  Data Rate: 4Gb •  Standard Firmware Price Quote: $951 Source: http://www.cdw.com TDC564-08 TDC564-08 23 11/05/07

  24. Host Bus Adapter (iSCSI) The QLE4060C iSCSI Host Bus Adapter (HBA) provides connectivity to SANs over Ethernet and TCP/IP network infrastructures for PCI Express bus-based servers. Using a widely deployed and familiar networking technology, iSCSI can lower the total cost of ownership to better manage and support storage networking. Source: http://www.cdw.org Price quote: $815 10/100/1000BaseT PCI TDC564-08

  25. iSCSI Storage Promise Technology VTrak M-Class iSCSI RAID Price quote: $4,929 Source: //www.cdw.com Network: Gigabit Ethernet (2) Protocol: TCP/IP, iSCSI Capacity: 16-drive bay (500G – 1TB per drive) TDC564-08

  26. IP iSCSI Application Data Data SCSI SCSI SCSI iSCSI iSCSI FCP FCP TCP TCP FC 0-2 FC 0-2 IP IP Storage Device Layer2 Layer2 iSCSI Gateway PHY PHY Server Cisco iSCSI Configuration Example TDC564-08

  27. Multi-TCP Sessions TDC564-08

  28. HBA: Multi-Path I/O LUN: Logical [Storage] Units TDC564-08

  29. HBA iSCSI vs. Software iSCSI • No performance advantage of using iSCSI HBA • Throughput • Round trip time • Significantly higher cost of iSCSI HBA • $800 vs. $100 (Server NIC) • What are the advantages of iSCSI HBA? • Answer: CPU Utilization (off-load) • Reference: http://download.intel.com/network/connectivity/products/iSCSIcomp0407.pdf TDC564-08

  30. Is IP-SAN similar to NAS? What are the advantages, if any, of IP-SAN vs. NAS? TDC564-08

  31. Performance Analysis: iSCSI vs. NAS(software based – no HBA) iSCSI NFS http://technomagesinc.com/pdf/ip_paper.pdf TDC564-08

  32. Sequential Read/Write Tests • Conclusion: • Comparable performance in character read/write and block write • Significant advantage of iSCSI in block read (20-25%) TDC564-08

  33. Small Files Read/Write TDC564-08

  34. IOGen Test (Emulation of Database) TDC564-08

  35. FC-SAN vs. iSCSI • Since the iSCSI appliance attaches to the existing Ethernet network, NAS and iSCSI are very similar in network architecture • However, the performance would be significantly different. • Both iSCSI and SAN use Block I/O to transport data, whereas NAS uses File I/O. • SAN offers better performance (c.f. NAS), but is more expensive and requires a higher skill set to implement. iSCSI and NAS offer better pricing and skills may already be in place to implement them. • Both SAN and iSCSI offer the performance benefit of Block I/O. TDC564-08

  36. Case Study: FC-SAN vs. iSCSI http://www.promise.com/marketing/whitepaper/file/2_MClass-iSCSI%20SCSI%20and%20Fibre-10-07-05.pdf TDC564-08

  37.  4G bps TDC564-08

  38. FC SAN FC SAN IP IP TCP FCIP FC SCSI Data FC over IP • The encapsulation of Fibre Channel frames into IP packets and tunneled through an existing TCP/IP network infrastructure, in order to connect remote islands of FC-based SANs TDC564-08

  39. FC Frame Encapsulation (RFC 3643) • Describes the common Fibre Channel (FC) frame encapsulation format and a procedure for the measurement and calculation of frame transit time through the IP network SOF FC Frame Body EOF Encapsulation Header TDC564-08

  40. FC Encapsulation Header Q: Why is time stamp needed in the FC encapsulation header? TDC564-08

  41. FC Encapsulation TDC564-08

  42. FCIP (RFC 3821) Fibre Channel Over TCP/IP (FCIP) describes mechanisms that allow the interconnection of islands of Fibre Channel storage area networks over IP-based networks to form a unified storage area network in a single Fibre Channel fabric TDC564-08

  43. FCIP Protocol Stacks TDC564-08

  44. SAN SAN IP FC over IP an IP tunnel for FC-based SAN Application: interconnect SAN over IP-WAN. Data Data SCSI SCSI FCP FCP FCIP FCIP FCP FCP FC 0-2 FC 0-2 TCP TCP FC 0-2 FC 0-2 IP IP IP L2 L2 L2 PHY PHY PHY TDC564-08

  45. FCIP Configuration Example TDC564-08

  46. Internet Fiber Channel Protocol (iFCP) • iFCP – RFC 4172 (Sept. 2005) • iFCP is a protocol that uses the FCP over IP networks to interconnect FC-based storage devices. • It is considered a gateway protocol, while FCIP is considered a tunnel protocol. TDC564-08

  47. iFCP (RFC 4172) • iFCP specifies an architecture and a gateway-to-gateway protocol for the implementation of fibre channel fabric functionality over an IP network. • This functionality is provided through TCP protocols for fibre channel frame transport and the distributed fabric services specified by the fibre channel standards. • The architecture enables internetworking of fibre channel devices through gateway-accessed regions with the fault isolation properties of autonomous systems and the scalability of the IP network TDC564-08

  48. iFCP Network Example TDC564-08

  49. iFCP (RFC 4172) IP F-port F-port iFCP GW iFCP GW Gateway approach Application: interconnect SAN over IP-WAN. Data Data SCSI SCSI FCP FCP FCP FCP FC 0-2 FC 0-2 iFCP iFCP FC 0-2 FC 0-2 TCP TCP IP IP IP L2 L2 L2 PHY PHY PHY TDC564-08 TDC564-08 49 11/05/07

  50. iFCP TDC564-08

More Related