90 likes | 196 Views
This update covers challenges faced by the IAC Committee regarding communications infrastructure, including switch consistency, security, and new technologies. Issues such as network outages, misconfigurations, and hardware inventory are discussed.
E N D
Communications Infrastructure Committee Update for the IAC Friday, April 15, 2011
Initial Building List • Occupational Therapy • Clark - Done* • Shepardson - Done* • ARBL - Done* • Engineering • NESB • A/Z • VTH • Atmospheric Science • * Single GigE for now IAC Update
Issues and Difficulties • Switch Consistency (Type and Configuration) • Documentation (Change mgmt., ports, vlans) • Security (Physical and Virtual) • Resources • Hardware inventory • People – delegation of responsibilities (configurations, responding to outages, etc.) • Multi-departmental occupancy of buildings • New technologies • Radiation Safety Project • VoIP – exacerbated by all of the above IAC Update
Issues and Difficulties (Cont’d) • 900+ switches • 120+ MDFs/IDFs • 40,000+ systems • Video, Environmental Controls, Power Meters, Voice, Police/Fire, Security Panels, Servers, Wireless, Private College LANs, etc… • Main campus, West Campus, South Campus, Remote sites comprising • 213 Subnets • 60 Subnet managers
Small sample and examples of concerns • Environmental controls offline due to multicast storm, After hours response by Facilities, April 2011 • Looped network takes down environmental controls requiring reconfiguration of switches and further monitoring after hours by Facilities, NOC, April 2011 • Firewall not configured to be on network and thus not firewalling, March, 2011 • Several building networks down along with environmental controls due to dual-homed server misbehaving. Discovered hubs and other devices as part of debug process. March, 2011 • VOIP and Wireless down due to cables being moved to wrong switch ports. March, 2011 • Compromised machines swamp entire LAN affecting police/fire, March 2011 • Departmental servers down, nobody knew location of switches affecting servers nor configuration of switches thus requiring NOC to respond, find, fix, March, 2011 • Unit carrying police/fire notifications moved to wrong port on switch. After hours response by NOC, Facilities, Feb. 2011 • Lost communication on large campus network due to switches being plugged into each other incorrectly. Feb. 2011 • Network device with duplicate IP takes down a College’s central server, Feb 2011 • Emergency fiber run had to be made to bypass departmental network device incapable of handling vlans for cardkey access, Feb, 2011
Directive, from VPIT • Must ‘harden’ our network for future applications, including VoIP IAC Update
Discussion • Is most welcome IAC Update