1 / 24

NetSearch : Googling Large-scale Network Management Data

NetSearch : Googling Large-scale Network Management Data. Group 2 Members Samuel lawer Wenbo han Huan yan Pei yan Shrey Yadav Shuai yu Shine pandita. OUTLINE. Introduction Overview and Syntax of Data Sets Netsearch Methodology Evaluation Application Relation to FCAPS

mary-figueroa
Download Presentation

NetSearch : Googling Large-scale Network Management Data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NetSearch: Googling Large-scale NetworkManagement Data Group 2 Members Samuel lawer Wenbohan Huanyan Pei yan Shrey Yadav Shuaiyu Shine pandita

  2. OUTLINE • Introduction • Overview and Syntax of Data Sets • Netsearch Methodology • Evaluation • Application • Relation to FCAPS • Conclusion

  3. Introduction What is Netsearch? • It is a search and information retrieval tool design to work on network measurement and monitoring data sets.

  4. Overview and Syntax of Data Sets • LOGS • An example is a router syslog which captures information about network conditions and the hardware component involved such as link and protocol state, high voltage or temperature etc.

  5. Overview and Syntax of Data Sets • Device alarms • In many cases, layer-1 alarms indicate the root causes of upper layer issues. This is an example of layer 1 alarms. • Some network devices generate alarms when certain events occur. Data from here usually contains time and location information. An example is SONET alarms.

  6. Overview and Syntax of Data Sets • Control Plane Monitoring. • Control plane refers to the learning of routes by routers. For better network performance we monitor the exchanges of information between routing protocols.

  7. Netsearch Methodology • The goal of Netsearch is to sort through large amounts of network information and return the relevant ones to the network operator. • Configuration Learning • Location Extraction • Indexing and Searching • Query Interpretation

  8. Netsearch Methodology

  9. Netsearch Methodology Config Learning • Based on configuration files of each router, Netsearch can form location dictionary and location hierarchy. • location dictionary: extract location information embedded in network messages. Netseach can also understand the syntax or format of locations. • location hierarchy contains two parts ----- physical hierarchy and logical hierarchy.

  10. Netsearch Methodology Netsearch uses the physical hierarchy to build the Indexing and searching algorithm. One to Many One router can have multiple slots One slot can have many ports

  11. NetsearchMethodology Location Extraction • Based on router configuration • Based on message context • Based on domain knowledge A hybrid method ----- combination of the three

  12. Netsearch Methodology

  13. NetsearchMethodology • Indexing and Searching • Contains 3 parts information: Time/location/other description(optional) • Involves Temporal indexing and Spatial indexing. • Relevant iff their positions in the location hierarchy tree are either the same or one is the other’s ancestor • Example interfaces and messages.

  14. NetsearchMethodology Query Interpretation • There are two options provided for the flexibility of location query • Specify the type: interface XXX or ID XXX • If no specification; mapping from signature to location digits(D)/alphabetic characters(A)/others(O) Example: SERIAL2/0.7/11:0 ----- AAAAAAADODODODDOD

  15. Evaluation • Evaluation of Netsearch was done using the 3 network data set ( Syslog, OSPF and SONET ) to evaluate the 3 main components of Netsearch, ie, location extraction, indexing and searching, and query interpretation. • Performed on a tier 1 ISP for a month.

  16. Evaluation • Location Extraction

  17. Evaluation • Indexing and Searching

  18. Evaluation • Query Interpretation

  19. Application • Important use of Netsearch is to assist network operators in analyzing the impact of a network event. • Network operator of the tier 1 ISP noticed that port 1/1/1 on router R1 was unstable.

  20. Application

  21. Application • Using grep (global regular expression print) to capture and analyze is a complicated task and is time consuming. • Netsearch provides the related set of messages within minutes

  22. Relation to FCAPS • Increase the efficiency to obtain the relevantmessages (P)

  23. Conclusion • Netsearch tool has been developed to sort through a wide range of network data such as those for large tier 1 ISPs. • Acts as the “google” for network analysis. • Search and indexing involves spatial and temporal information.

  24. THANK YOU

More Related