Internet2 Network Operations Report
08/06/2007 - 08/12/2007

Internet2 Network Operations Center
at Indiana University

New Customers
test

Upgrades
test

New Services
test

Other
test

Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Start Time (UTC) End Time (UTC)
106411-Critical 2-High Internet2 IP Network Backbone Circuit CHIC-ATLA Outage Resolved Hardware 08/09/2007 4:16 PM 08/10/2007 12:38 AM
08/10/2007 1:51 AM 08/10/2007 6:17 PM
08/11/2007 4:53 PM 08/12/2007 4:58 AM
08/12/2007 5:45 AM 08/13/2007 2:45 AM
106582-High 1-Critical Internet2 IP Network STTL-SNVA Backbone Circuit Available Circuit - Damaged Fiber 08/12/2007 2:42 AM 08/12/2007 3:35 AM
106622-High 2-High Internet2 IP Network Backbone Circuit ATLA-HOUS Available Undetermined 08/12/2007 4:26 PM 08/12/2007 4:27 PM

Unscheduled Outages Detail


Ticket No.:10641:45
Subject:Internet2 IP Network Backbone Circuit CHIC-ATLA Outage Resolved
Affected:Backbone Circuit CHIC-ATLA
Start Time:Thursday, August 9, 2007, 4:16 PM (1616) UTC
End Time:Friday, August 10, 2007, 12:38 AM (0038) UTC
Start Time:Friday, August 10, 2007, 1:51 AM (0151) UTC
End Time:Friday, August 10, 2007, 6:17 PM (1817) UTC
Start Time:Saturday, August 11, 2007, 4:53 PM (1653) UTC
End Time:Sunday, August 12, 2007, 4:58 AM (0458) UTC
Start Time:Sunday, August 12, 2007, 5:45 AM (0545) UTC
End Time:Monday, August 13, 2007, 2:45 AM (0245) UTC
Description:Backbone circuit CHIC-ATLA was unavailable to the community. Internet2 NOC engineering, with the assistance of Level(3) Communications engineers, restored service by rebuilding the circuit. Service has been restored. *Traffic is re-routing
Ticket No.:10658:45
Subject:Internet2 IP Network STTL-SNVA Backbone Circuit Available
Affected:Backbone Circuit STTL-SNVA
Start Time:Sunday, August 12, 2007, 2:42 AM (0242) UTC
End Time:Sunday, August 12, 2007, 3:35 AM (0335) UTC
Description:Internet2 IP Backbone OC-192 circuit from STTL to SNVA was unavailable to the community. Service provider technicians confirmed that the circuit has been restored.
Ticket No.:10662:45
Subject:Internet2 IP Network Backbone Circuit ATLA-HOUS Available
Affected:Backbone Circuit ATLA-HOUS
Start Time:Sunday, August 12, 2007, 4:26 PM (1626) UTC
End Time:Sunday, August 12, 2007, 4:27 PM (1627) UTC
Description:Internet2 IP Network Backbone Circuit ATLA-HOUS experienced a brief outage. Internet2 circuit provider Level(3) Communications has been contacted; however, no reason for the outage as yet been received. *Traffic re-routed

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Start Time (UTC) End Time (UTC)
10566 3-Elevated 3-Elevated Internet2 IP Network Backbone Circuit ATLA-WASH Maintenance Completed Circuit 08/09/2007 4:23 AM 08/09/2007 5:31 AM

Scheduled Maintenances Detail

Ticket No.:10566:45
Subject:Internet2 IP Network Backbone Circuit ATLA-WASH Maintenance Completed
Affected:I2-ATLA-WASH-I2-00097
I2-ATLA-WASH-ESNET-00008
I2-ATLA-WASH-ESNET-00009
Start Time:Thursday, August 9, 2007, 4:23 AM (0423) UTC
End Time:Thursday, August 9, 2007, 5:31 AM (0531) UTC
Description: Provider Level (3) performed backbone circuit maintenance between ATLA-WASH. The maintenance has been completed and the network restored.

Downtime and Availability


Internet2 Core NodesDown TimeReporting Period Availability52 Week Availability
** CHIC T6400 hr 0 min100.00000%100.00000%
DNVR T6400 hr 0 min100.00000%99.99962%
HSTN T6400 hr 0 min100.00000%99.99618%
LOSA T6400 hr 0 min100.00000%98.95700%
** NEWY T6400 hr 0 min100.00000%99.98760%
SNVA T6400 hr 0 min100.00000%99.99752%
STTL T6400 hr 0 min100.00000%99.99695%
** WASH T6400 hr 0 min100.00000%100.00000%
ATLA M50 hr 0 min100.00000%100.00000%
** ATLA T6400 hr 0 min100.00000%99.99790%
** SALT T6400 hr 0 min100.00000%100.00000%
** KANS T6400 hr 0 min100.00000%100.00000%
Aggregate Internet2 Core Nodes0 hr 0 min100.00000%99.91106%

** Less than 52 weeks of data available

Internet2 Backbone CircuitsDown TimeReporting Period Availability32 Week Availability
DNVR-SNVA OC-1920 hr 0 min100.00000%100.00000%
DENV-STTL OC-1920 hr 0 min100.00000%99.96466%
HSTN-LOSA OC-1920 hr 0 min100.00000%99.97830%
LOSA-SNVA OC-1920 hr 0 min100.00000%100.00000%
ATLA-HSTN OC-1920 hr 0 min100.00000%99.54086%
SNVA-STTL OC-1920 hr 53 min99.47421%99.74733%
** I2-CHIC-ATLA55 hr 8 min67.18254%98.95957%
** I2-CHIC-NEWY0 hr 0 min100.00000%99.77989%
** I2-CHIC-KANS0 hr 0 min100.00000%100.00000%
** I2-CHIC-WASH0 hr 0 min100.00000%100.00000%
** I2-NEWY-WASH0 hr 0 min100.00000%99.99659%
** I2-WASH-ATLA1 hr 8 min99.32540%99.97892%
** I2-ATLA-HOUS0 hr 1 min99.99008%99.90792%
** I2-KANS-ATLA0 hr 0 min100.00000%99.73369%
** I2-KANS-SALT0 hr 0 min100.00000%100.00000%
** I2-SALT-SEAT0 hr 0 min100.00000%100.00000%
Aggregate All Internet2 Backbone Circuits57 hr 10 min97.87326%99.84923%




Upcoming Scheduled Maintenances

Ticket No.:10647:45
Subject:Internet2 IP Peers TransPAC2 (STTL), AARnet, and NREN, and Connector CALREN2-S Maintenance
Affected:IXP PacWave*
Peers TransPAC2 (STTL)*, AARnet*, and NREN*
Start Time:Wednesday, August 15, 2007, 11:00 AM (1100) UTC
End Time:Wednesday, August 15, 2007, 1:00 PM (1300) UTC
Description: IXP PacWave's circuit provider will be replacing a failing card in Sunnyvale, CA. A brief outage is expected. However, the entire maintenance window has been reserved. *Denotes multi-homed status

Ticket No.:10670:45
Subject:Internet2 IP Network Core Node ATLA Maintenance
Affected:Core Node ATLA and Its Connectors, Participants, and Peers
Start Time:Saturday, August 18, 2007, 3:20 AM (0320) UTC
End Time:Saturday, August 18, 2007, 3:50 AM (0350) UTC
Description: Internet2 engineers will be performing software upgrades on the Internet2 core nodes. The outage should be limited to 5 minutes per node, while the route-engines change over, though the entire 30 minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:10668:45
Subject:Internet2 IP Network Core Node NEWY Maintenance
Affected:Core Node NEWY and Its Connectors, Participants, and Peers
Start Time:Saturday, August 18, 2007, 3:00 AM (0300) UTC
End Time:Saturday, August 18, 2007, 3:30 AM (0330) UTC
Description: Internet2 engineers will be performing software upgrades on the Internet2 core nodes. The outage should be limited to 5 minutes per node, while the route-engines change over, though the entire 30 minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:10671:45
Subject:Internet2 IP Network Core Node ATLA M5 Maintenance
Affected:Core Node ATLA M5 and Its Participants
Start Time:Saturday, August 18, 2007, 3:25 AM (0325) UTC
End Time:Saturday, August 18, 2007, 3:55 AM (0355) UTC
Description: Internet2 engineers will be performing software upgrades on the Internet2 core nodes. The outage should be limited to 5 minutes per node, while the route-engines change over, though the entire 30 minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:10672:45
Subject:Internet2 IP Network Core Node LOSA Maintenance
Affected:Core Node LOSA and Its Connectors, Participants, and Peers
Start Time:Saturday, August 18, 2007, 3:30 AM (0330) UTC
End Time:Saturday, August 18, 2007, 4:00 AM (0400) UTC
Description: Internet2 engineers will be performing software upgrades on the Internet2 core nodes. The outage should be limited to 5 minutes per node, while the route-engines change over, though the entire 30 minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:10673:45
Subject:Internet2 IP Network Core Node WASH Maintenance
Affected:Core Node WASH and Its Connectors, Participants, and Peers
Start Time:Saturday, August 18, 2007, 3:40 AM (0340) UTC
End Time:Saturday, August 18, 2007, 4:10 AM (0410) UTC
Description: Internet2 engineers will be performing software upgrades on the Internet2 core nodes. The outage should be limited to 5 minutes per node, while the route-engines change over, though the entire 30 minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:10674:45
Subject:Internet2 IP Network Core Node HSTN Maintenance
Affected:Core Node HSTN and Its Connectors, Participants, and Peers
Start Time:Saturday, August 18, 2007, 3:50 AM (0350) UTC
End Time:Saturday, August 18, 2007, 4:20 AM (0420) UTC
Description: Internet2 engineers will be performing software upgrades on the Internet2 core nodes. The outage should be limited to 5 minutes per node, while the route-engines change over, though the entire 30 minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:10676:45
Subject:Internet2 IP Network Core Node KANS Maintenance
Affected:Core Node KANS and Its Connectors, Participants, and Peers
Start Time:Saturday, August 18, 2007, 4:00 AM (0400) UTC
End Time:Saturday, August 18, 2007, 4:30 AM (0430) UTC
Description: Internet2 engineers will be performing software upgrades on the Internet2 core nodes. The outage should be limited to 5 minutes per node, while the route-engines change over, though the entire 30 minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:10678:45
Subject:Internet2 IP Network Core Node CHIC Maintenance
Affected:Core Node CHIC and Its Connectors, Participants, and Peers
Start Time:Saturday, August 18, 2007, 4:20 AM (0420) UTC
End Time:Saturday, August 18, 2007, 4:50 AM (0450) UTC
Description: Internet2 engineers will be performing software upgrades on the Internet2 core nodes. The outage should be limited to 5 minutes per node, while the route-engines change over, though the entire 30 minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:10679:45
Subject:Internet2 IP Network Core Node SALT Maintenance
Affected:Core Node SALT and Its Connectors, Participants, and Peers
Start Time:Saturday, August 18, 2007, 4:30 AM (0430) UTC
End Time:Saturday, August 18, 2007, 5:00 AM (0500) UTC
Description: Internet2 engineers will be performing software upgrades on the Internet2 core nodes. The outage should be limited to 5 minutes per node, while the route-engines change over, though the entire 30 minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:10681:45
Subject:Internet2 IP Network Backbone Circuit STTL-SNVA Emergency Maintenance
Affected:Backbone Circuit STTL-SNVA
Start Time:Tuesday, August 14, 2007, 6:00 AM (0600) UTC
End Time:Wednesday, August 15, 2007, 12:00 PM (1200) UTC
Description: Internet2 IP Network Backbone circuit STTL-SNVA may experience a brief outage during the above time frame while Qwest Communications relocates fiber. A 5-10 minute outage can be expected; however, the entire maintenance window has been reserved.