Major Network Outage

Unplanned; Complete

Overview

Affected services
  • MyEd
  • Central Wiki Service
  • DiscoverEd
  • Kinetix (KX)
  • Staffmail
  • HR/Payroll (Legacy)
  • E-Financials
  • ID Management
  • Reporting + Analytics (BI Suite)
  • EBIS
  • Hosted Websites
  • PURE
  • eRecruitment
  • Polopoly (publishing)
  • Event Booking
  • Electronic Journals
  • UniDesk
  • Moodle
  • Learn
  • Office365
Degraded Service Time
01:05 PM, 16-Jun-14 — 01:15 PM, 16-Jun-14
Outage Time
01:15 PM, 16-Jun-14 — 02:30 PM, 16-Jun-14
Description
Multiple services unavailable due to central firewall fault..

Technical Information

Technical Information

Work summary
A network fault originating in Fifty George Square caused both (a) disruption of routing protocols in the core of the network, and (b) both central firewalls to reload. Disconnecting the 50GS network resolved the routing problems. A full, staged, reload of the central firewalls finally resolved the connectivity between the firewallas and the rest of the network.
Technical summary
Core network issues
Affecting
Core routing instability and access to firewalled services
Servers / Hardware
Criticality
high
Impact description
Disruption to core network routing betweeen 13:05 and 13:30. Loss of access to all services behind central firewall between 13:15 and 14:30.
Change Reference
Additional comments

Request, Authorise and Publish

Requested by IS Apps on 16-Jun-2014
Authorised by Applications
Publish to IS Website (Service Status and Alerts page): Yes
Published by Alex Swan


Additional Details

Risk classification
Risk assessment
Other people involved
Notes for future reference

Copy Edit