1 / 23

S oftware D efined N etworking for Big D ata A pplications

S oftware D efined N etworking for Big D ata A pplications. 指導教授：王國禎 博士 學生 ：徐逸懷 連懷恩 賴寬 嶧 洪維藩 張晏誌 國立交通大學網路工程研究所 行動計算與寬頻網路實驗室. Outlines. SDN: Software-Defined Network Motivation Related Works Design approach OpenFlow Mininet Schedule

neith
Download Presentation

S oftware D efined N etworking for Big D ata A pplications

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Software Defined Networking for Big Data Applications 指導教授：王國禎 博士 學生：徐逸懷 連懷恩 賴寬嶧 洪維藩 張晏誌 國立交通大學網路工程研究所 行動計算與寬頻網路實驗室

  2. Outlines • SDN: Software-Defined Network • Motivation • Related Works • Design approach • OpenFlowMininet • Schedule • References

  3. SDN: Software-Defined Network • SDN separates the control plane from the data plane in network switches and routers.

  4. Motivation – Why SDN in Data Center? Google is using OpenFlow on custom-designed hardware for all the internal networks it runs connecting its global data centers, said UrsHolzle, senior vice president of technology infrastructure at Google, speaking in a keynote at the second annual Open Networking Summit 2012. [1]

  5. Motivation – Why SDN in Data Center? Virtual data center network. Application awareness. Better scalability for cloud environment. Faster VM migration.

  6. Motivation – Virtual Data Center Network VMware will acquire Nicira for approximately $1.05 billion in cash plus approximately $210 million of assumed unvested equity awards. “Tenants or customers utilizing the software-defined datacenter can have their own virtual datacenter with an isolated collection of all the compute, storage, networking, and security resources that they are used to. This is what the software-defined datacenter is all about, and it is the architecture for the cloud.” [2]

  7. Motivation – Virtual Data Center Network Security and privacy between different applications. Better QoS management. For operators of data centers, it will be easier to reconfigure the network equipments.

  8. Motivation – Application Awareness Guohui Wang et al. [3] have shown that by the help of SDN, the time to perform a MapReduce task can have a reduction up to 70% in their test case. Optimizing the routing and bandwidth resource between applications. Giving different priority to control messages and data transferring packets.

  9. Motivation – Better Scalability Traditional LAN (spanning tree protocol, ARP, forwarding table) limits the scalability of data centers. With SDN, a connection between two hosts can use duplicate paths simultaneously. Faster recovery from network failure.

  10. Motivation – Faster VM Migration Faster network reconfiguration after migration; transparent to applications [4]. 48 bits PMAC: dcid.pod.position.port.vmid 32 bits PIP: privateNetworkId.dcid.subnetid.hostid

  11. Related Works • The classification tree of SDN

  12. Related Works

  13. Design Approach • Our design approach is composed of three parts: • Virtual network and flow request • Network resource allocation algorithm • Network topology research

  14. Design Approach – Virtual Network and Flow Request • Every application, including all its VMs and storage nodes form a virtual network, and assigned with a virtual network number. • Every virtual network has a head node who will submit a flow request to the SDN controller. The controller then allocate the network resource to all the virtual networks according to their flow requests. • The Priority of control messages and data transferring packets.

  15. Design Approach – Network Resource Allocation Algorithm • For every connection in the network, we find all the possible paths between these two nodes and sort these paths by their cost in a non-decreasing order. • The principle is, when some competing connections can not be satisfied with their minimum cost paths, we choose the next minimal cost path among all the competing connections and see if the demand can be satisfied. • More like a circuit switch.

  16. Design Approach – Network Resource Allocation Algorithm • Packet priority. • When there are some nodes added in or removed, some flow requests are updated, or a network failure happens, we should run an update algorithm. The update algorithm would be the subset of the aforementioned algorithm and it should be fast enough that we can apply it on-line.

  17. Design Approach – Network Topology Research • What is the best strategy when we apply the SDN scheme to the traditional data center network topology like Tree, VL2, Fat-Tree, and BCube? • Is there a better network topology when we apply the SDN scheme to the data center?

  18. OpenFlowMininet • Mininet creates scalable (up to hundreds of nodes, depending on your configuration) software-defined (e.g. OpenFlow) networks on a single PC by using Linux processes in network namespaces [10]. • It allows you to quickly create, interact with, customize and share a software defined network prototype, and provides a smooth path to running on hardware [10]. • Build in Stanford University.

  19. OpenFlowMininet • Display nodes: nodes • you can ping from host 0 to host 1: h2 ping -c 1 h3

  20. Schedule • 第一年： • 蒐集相關文獻，並歸納比較 • 熟悉SDN的模擬工具 • 提出適用於data center的SDN網路架構，並與 　傳統非SDN的網路做比較 • 第二年： • 實做出我們的SDN網路架構，並利用Hadoop 等適用於big data的程式來初步評估效果 • 除了提升效能外，為我們的方法增加更多特 　性，如QoS management, Inter-data center SDN

  21. Schedule • 第三年： • 加入更多來自big data的application來評估調整我們的方法 • 將最新的文獻加入比較 • 與其他子計畫的項目整合

  22. References [1] http://www.eetimes.com/electronics-news/4371179/Google-describes-its-OpenFlow-network [2] http://www.vmware.com/nl/company/news/releases/vmw-nicira-07-23-12.html [3] Guohui Wang, T.S. Eugene Ng, and AneesShaikh. 2012. Programming your network at run-time for big data applications. In Proceedings of the first workshop on Hot topics in software defined networks (HotSDN '12). ACM, New York, NY, USA, 103-108. [4] Mann, V.; Vishnoi, A.; Kannan, K.; Kalyanaraman, S.; , "CrossRoads: Seamless VM mobility across data centers through software defined networking," Network Operations and Management Symposium (NOMS), 2012 IEEE , vol., no., pp.88-96, 16-20 April 2012 [5] Fonseca, P.; Bennesby, R.; Mota, E.; Passito, A.; , "A replication component for resilient OpenFlow-based networking," Network Operations and Management Symposium (NOMS), 2012 IEEE , vol., no., pp.933-939, 16-20 April 2012 [6]Simeonidou, D.; Nejabati, R.; Azodolmolky, S.; , "Enabling the future optical Internet with OpenFlow: A paradigm shift in providing intelligent optical network services," Transparent Optical Networks (ICTON), 2011 13th International Conference on , vol., no., pp.1-4, 26-30 June 2011

  23. References [7] Farias, F.N.N.; Salvatti, J.J.; Cerqueira, E.C.; Abelem, A.J.G.; , "A proposal management of the legacy network environment using OpenFlow control plane," Network Operations and Management Symposium (NOMS), 2012 IEEE , vol., no., pp.1143-1150, 16-20 April 2012 [8] KwangtaeJeong; Jinwook Kim; Young-Tak Kim; , "QoS-aware Network Operating System for software defined networking with Generalized OpenFlows," Network Operations and Management Symposium (NOMS), 2012 IEEE , vol., no., pp.1167-1174, 16-20 April 2012 [9] Yan Pu; Yilong Deng; Nakao, A.; , "Cloud Rack: Enhanced virtual topology migration approach with Open vSwitch," Information Networking (ICOIN), 2011 International Conference on , vol., no., pp.160-164, 26-28 Jan. 2011 [10] http://yuba.stanford.edu/foswiki/bin/view/OpenFlow/Mininet

More Related