Internet2 IP Network Operations Report
08/20/2007 - 08/26/2007

Internet2 IP Network Operations Center
at Indiana University

New Customers

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Start Time (UTC) End Time (UTC)

107402-High 2-High Internet2 IP Network Backbone Circuit CHIC-NEWY Outage Resolved Circuit - Damaged Fiber 08/20/2007 2:12 AM 08/20/2007 11:23 PM
08/20/2007 11:24 PM 08/20/2007 11:25 PM
107611-Critical 1-Critical Internet2 IP Network Core Node ATLA Available Hardware 08/22/2007 5:23 PM 08/22/2007 5:25 PM
08/22/2007 5:26 PM 08/22/2007 5:28 PM
107651-Critical 1-Critical Internet2 IP Network Core Node ATLA M5 Available Undetermined 08/23/2007 8:34 AM 08/23/2007 9:23 AM

Unscheduled Outages Detail


Ticket No.:10740:45
Subject:Internet2 IP Network Backbone Circuit CHIC-NEWY Outage Resolved
Affected:I2-CHIC-NEWY-I2-00023
I2-CHIC-NEWY-ESNET-00072
I2-CHIC-NEWY-ESNET-00071
I2-CHIC-NEWY-I2-00104
Start Time:Monday, August 20, 2007, 2:12 AM (0212) UTC
End Time:Monday, August 20, 2007, 11:23 PM (2323) UTC
Start Time:Monday, August 20, 2007, 11:24 PM (2324) UTC
End Time:Monday, August 20, 2007, 11:25 PM (2325) UTC
Description:Internet2 IP Network Backbone Circuit CHIC-NEWY was available to the community. Level(3) Communications reported that the outage was due to a fiber cut in Hudson, OH. Level(3) Communications Technicians restored service by splicing fibers. Work to restore service has been completed.

Ticket No.:10761:45
Subject:Internet2 IP Network Core Node ATLA Available
Affected:Internet2 IP Core Node ATLA
Start Time:Wednesday, August 22, 2007, 5:23 PM (1723) UTC
End Time:Wednesday, August 22, 2007, 5:25 PM (1725) UTC
Start Time:Wednesday, August 22, 2007, 5:26 PM (1726) UTC
End Time:Wednesday, August 22, 2007, 5:28 PM (1728) UTC
Description:Internet2 IP Core Node ATLA was unavailable to the Internet2 community. Internet2 IP Network Engineers report the outage was due to a routing engine problem causing all BGP sessions to reset.

Ticket No.:10765:45
Subject:Internet2 IP Network Core Node ATLA M5 Available
Affected:Core Node ATLA M5
Start Time:Thursday, August 23, 2007, 8:34 AM (0834) UTC
End Time:Thursday, August 23, 2007, 9:23 AM (0923) UTC
Description:Close the subtask, refer to master ticket 10729 for details and updates.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Start Time (UTC) End Time (UTC)

10587 3-Elevated 2-High Internet2 IP Network Backbone Circuit HOUS-LOSA Maintenance Completed Circuit 08/21/2007 8:15 AM 08/21/2007 8:23 AM
10758 3-Elevated 1-Critical Internet2 IP Network Core Node SALT Maintenance Completed Software 08/26/2007 3:01 AM 08/26/2007 3:03 AM

Scheduled Maintenances Detail

Ticket No.:10587:45
Subject:Internet2 IP Network Backbone Circuit HOUS-LOSA Maintenance Completed
Affected:Backbone Circuit HOUS-LOSA
Start Time:Tuesday, August 21, 2007, 8:15 AM (0815) UTC
End Time:Tuesday, August 21, 2007, 8:23 AM (0823) UTC
Description: Backbone circuit HOUS-LOSA was briefly unavailable to the Internet 2 IP Network community. Level(3) Communications performed maintenance in Phoenix, AZ. Maintenance has been completed.

Ticket No.:10758:45
Subject:Internet2 IP Network Core Node SALT Maintenance Completed
Affected:Core Node SALT
Start Time:Sunday, August 26, 2007, 3:01 AM (0301) UTC
End Time:Sunday, August 26, 2007, 3:03 AM (0303) UTC
Description: Internet2 engineers performed software upgrades on the Internet2 core node in Salt Lake City. The outage was less than 5 minutes per node, while the route-engines changed over. All BGP sessions reset. Backbone traffic routed. Maintenance has been completed.


Downtime and Availability



Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability
** CHIC T6400 hr 0 min100.00000%100.00000%
DNVR T6400 hr 0 min100.00000%99.99962%
HSTN T6400 hr 0 min100.00000%99.99561%
LOSA T6400 hr 0 min100.00000%98.95643%
** NEWY T6400 hr 0 min100.00000%99.99943%
SNVA T6400 hr 0 min100.00000%99.99695%
** SEAT T6400 hr 0 min100.00000%99.99924%
** WASH T6400 hr 0 min100.00000%100.00000%
ATLA M50 hr 49 min99.51389%99.98111%
** ATLA T6400 hr 4 min99.96032%99.99676%
** SALT T6400 hr 2 min99.98016%99.99962%
** KANS T6400 hr 0 min100.00000%99.99943%

Aggregate Internet2 IP Core Nodes0 hr 55 min99.95453%99.91035%

** Less than 52 weeks of data available

Internet2 IP Backbone CircuitsDown TimeReporting Period Availability34 Week Availability
DNVR-SNVA OC-1920 hr 0 min100.00000%100.00000%
DENV-STTL OC-1920 hr 0 min100.00000%99.96674%
HSTN-LOSA OC-1920 hr 8 min99.92063%99.97724%
LOSA-SNVA OC-1920 hr 0 min100.00000%100.00000%
ATLA-HSTN OC-1920 hr 0 min100.00000%99.56787%
SNVA-STTL OC-1920 hr 0 min100.00000%99.75169%
** I2-CHIC-ATLA0 hr 0 min100.00000%98.97263%
** I2-CHIC-NEWY21 hr 12 min87.38095%99.42169%
** I2-CHIC-KANS0 hr 0 min100.00000%100.00000%
** I2-CHIC-WASH0 hr 0 min100.00000%100.00000%
** I2-NEWY-WASH0 hr 0 min100.00000%99.99562%
** I2-WASH-ATLA0 hr 0 min100.00000%99.98016%
** I2-ATLA-HOUS0 hr 0 min100.00000%99.91334%
** I2-KANS-ATLA0 hr 0 min100.00000%99.74936%
** I2-KANS-SALT0 hr 0 min100.00000%100.00000%
** I2-SALT-SEAT0 hr 0 min100.00000%100.00000%

Aggregate All Internet2 IP Backbone Circuits21 hr 20 min99.20635%99.83102%





Upcoming Scheduled Maintenances

Ticket No.:10781:45
Subject:Internet2 IP Network Backbone Circuit NEWY-WASH Maintenance
Affected:Backbone circuit NEWY-WASH
Peer ESNET
Start Time:Tuesday, September 11, 2007, 4:00 AM (0400) UTC
End Time:Tuesday, September 11, 2007, 10:00 AM (1000) UTC
Description: Backbone circuit NEWY-WASH will be unavailable to the Internet2 IP community for 2 hours while Level(3) Communications performs circuit maintenance in Newark NJ. The entire maintenance window will be observed.