Internet2 IP Network Operations Report
01/24/2011 - 01/30/2011

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Start Time (UTC) End Time (UTC)

168262-High 2-High Internet2 IP Network Various Backbone Circuits Brief Outage Resolved Software 01/26/2011 9:05 PM 01/26/2011 9:12 PM
168322-High 2-High Internet2 IP Network Various Backbone Circuits Brief Outage Resolved Circuit - Bumped Fiber 01/27/2011 3:54 PM 01/27/2011 3:55 PM

Unscheduled Outages Detail


Ticket No.:16826:45
Subject:Internet2 IP Network Various Backbone Circuits Brief Outage Resolved
Affected:Backbone Circuit ATLA-CHIC
Backbone Circuit CHIC-KANS
Connectors MREN, Nysernet, MERIT
Start Time:Wednesday, January 26, 2011, 9:05 PM (2105) UTC
End Time:Wednesday, January 26, 2011, 9:12 PM (2112) UTC
Description:The above listed circuits were briefly unavailable. Internet2 Engineers are worked with Juniper to resolve a software bug.

Ticket No.:16832:45
Subject:Internet2 IP Network Various Backbone Circuits Brief Outage Resolved
Affected:Backbone Circuits ATLA-CHIC
Start Time:Thursday, January 27, 2011, 3:54 PM (1554) UTC
End Time:Thursday, January 27, 2011, 3:55 PM (1555) UTC
Description:Various Circuits listed above were briefly unavailable. Level(3) communications confirmed a fiber bump between Crown Point and Chicago by a third party using a backhoe.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Start Time (UTC) End Time (UTC)

16790 3-Elevated 1-Critical Internet2 IP Network Core Node ATLA Maintenance Completed Software 01/25/2011 4:00 AM 01/25/2011 4:05 AM
16791 3-Elevated 1-Critical Internet2 IP Network Core Node WASH Maintenance Completed Software 01/25/2011 4:30 AM 01/25/2011 4:35 AM
16792 3-Elevated 1-Critical Internet2 IP Network Core Node NEWY Maintenance Completed Software 01/25/2011 5:00 AM 01/25/2011 5:04 AM
16793 3-Elevated 1-Critical Internet2 IP Network Core Node CHIC Maintenance Completed Software 01/25/2011 5:30 AM 01/25/2011 6:00 AM
16795 3-Elevated 1-Critical Internet2 IP Network Core Node SALT Maintenance Completed Software 01/25/2011 6:45 AM 01/25/2011 6:47 AM
16796 3-Elevated 1-Critical Internet2 IP Network Core Node LOSA Maintenance Completed Software 01/25/2011 7:01 AM 01/25/2011 7:04 AM
16794 3-Elevated 1-Critical Internet2 IP Network Core Node HOUS Maintenance Completed Software 01/25/2011 8:02 AM 01/25/2011 8:04 AM
16807 3-Elevated 2-High Internet2 IP Network Backbone Circuit ATLA-CHIC Maintenance Completed Circuit 01/28/2011 5:48 AM 01/28/2011 5:59 AM
16841 3-Elevated 1-Critical Internet2 IP Network Core Node CHIC Emergency Maintenance Completed Software 01/29/2011 5:01 AM 01/29/2011 5:05 AM

Scheduled Maintenances Detail

Ticket No.:16790:45
Subject:Internet2 IP Network Core Node ATLA Maintenance Completed
Affected:Core Node ATLA and its Connector(s) and Participants
Start Time:Tuesday, January 25, 2011, 4:00 AM (0400) UTC
End Time:Tuesday, January 25, 2011, 4:05 AM (0405) UTC
Description: Core Node ATLA was unavailable to the community while Internet2 Engineers performed a routing engine upgrade. This maintenance has been completed.

Ticket No.:16791:45
Subject:Internet2 IP Network Core Node WASH Maintenance Completed
Affected:Core Node WASH and its Connector(s) and Participants
Start Time:Tuesday, January 25, 2011, 4:30 AM (0430) UTC
End Time:Tuesday, January 25, 2011, 4:35 AM (0435) UTC
Description: Core Node WASH was unavailable to the community while Internet2 Engineers performed a route engine upgrade. This maintenance has been completed.

Ticket No.:16792:45
Subject:Internet2 IP Network Core Node NEWY Maintenance Completed
Affected:Core Node NEWY and its Connector(s) and Participants
Start Time:Tuesday, January 25, 2011, 5:00 AM (0500) UTC
End Time:Tuesday, January 25, 2011, 5:04 AM (0504) UTC
Description: Core Node NEWY was unavailable to the community while Internet2 Engineers performed a route engine upgrade. This maintenance has been completed.

Ticket No.:16793:45
Subject:Internet2 IP Network Core Node CHIC Maintenance Completed
Affected:Core Node CHIC and its Connector(s) and Participants
Start Time:Tuesday, January 25, 2011, 5:30 AM (0530) UTC
End Time:Tuesday, January 25, 2011, 6:00 AM (0600) UTC
Description: Core Node CHIC was unavailable to the community while Internet2 Engineers performed a route engine upgrade. This maintenance has been completed.

Ticket No.:16795:45
Subject:Internet2 IP Network Core Node SALT Maintenance Completed
Affected:Core Node SALT and its Connector(s) and Participants
Start Time:Tuesday, January 25, 2011, 6:45 AM (0645) UTC
End Time:Tuesday, January 25, 2011, 6:47 AM (0647) UTC
Description: Core Node SALT was unavailable to the community while Internet2 Engineers performed route engine upgrades. Maintenance has been completed.

Ticket No.:16796:45
Subject:Internet2 IP Network Core Node LOSA Maintenance Completed
Affected:Core Node LOSA and its Connector(s) and Participants
Start Time:Tuesday, January 25, 2011, 7:01 AM (0701) UTC
End Time:Tuesday, January 25, 2011, 7:04 AM (0704) UTC
Description: Core Node LOSA was unavailable to the community while Internet2 Engineers performed route engine upgrades. Maintenance has been completed.

Ticket No.:16794:45
Subject:Internet2 IP Network Core Node HOUS Maintenance Completed
Affected:Core Node HOUS and its Connector(s) and Participants
Start Time:Tuesday, January 25, 2011, 8:02 AM (0802) UTC
End Time:Tuesday, January 25, 2011, 8:04 AM (0804) UTC
Description: Core Node HOUS was unavailable to the community while Internet2 Engineers performed route engine upgrades. Maintenance has been completed.

Ticket No.:16807:45
Subject:Internet2 IP Network Backbone Circuit ATLA-CHIC Maintenance Completed
Affected:Backbone Circuit ATLA-CHIC
Connector KyRON
Connector Indiana Gigapop (ATLA)*
Start Time:Friday, January 28, 2011, 5:48 AM (0548) UTC
End Time:Friday, January 28, 2011, 5:59 AM (0559) UTC
Description: Backbone Circuit ATLA-CHIC was unavailable while Level(3) Communications technicians performed invasive troubleshooting in Blountsville, AL. Maintenance has been completed.

Ticket No.:16841:45
Subject:Internet2 IP Network Core Node CHIC Emergency Maintenance Completed
Affected:Core Node CHIC and its Connector(s) and Participants
Start Time:Saturday, January 29, 2011, 5:01 AM (0501) UTC
End Time:Saturday, January 29, 2011, 5:05 AM (0505) UTC
Description: Core Node CHIC was briefly unavailable to the community while Internet2 Engineers performed a software maintenance. Maintenance has been completed.


Downtime and Availability



Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability
CHIC T16000 hr 34 min99.66270%99.89109%
NEWY MX9600 hr 3 min99.97024%99.99905%
SEAT MX9600 hr 0 min100.00000%99.96983%
WASH MX9600 hr 5 min99.95040%99.99867%
HOUS MX9600 hr 2 min99.98016%99.99962%
LOSA MX9600 hr 3 min99.97024%99.99943%
ATLA MX9600 hr 4 min99.96032%99.99886%
SALT MX9600 hr 2 min99.98016%99.97249%
KANS MX9600 hr 0 min100.00000%99.99848%

Aggregate Internet2 IP Core Nodes0 hr 53 min99.94158%99.98084%

** Less than 52 weeks of data available

Internet2 IP Backbone CircuitsDown TimeReporting Period Availability52 Week Availability
I2-HOUS-LOSA-10GE-055590 hr 0 min100.00000%99.83170%
I2-ATLA-CHIC-10GE-054190 hr 19 min99.81151%99.77971%
** I2-HOUS-KANS-10GE-055600 hr 0 min100.00000%99.98956%
I2-CHIC-NEWY32AOA-10GE-052390 hr 0 min100.00000%99.90153%
** I2-CHIC-NEWY32AOA-10GE-056670 hr 0 min100.00000%99.90247%
I2-NEWY32AOA-WASH-10GE-052420 hr 0 min100.00000%99.78844%
I2-CHIC-WASH-10GE-052500 hr 0 min100.00000%99.91841%
** I2-HOUS-KANS-10GE-055610 hr 0 min100.00000%99.98122%
** I2-NEWY32AOA-WASH-10GE-046430 hr 0 min100.00000%99.88407%
I2-ATLA-WASH-10GE-052510 hr 0 min100.00000%99.99696%
I2-ATLA-WASH-10GE-051330 hr 0 min100.00000%99.99696%
I2-ATLA-HOUS-10GE-054230 hr 0 min100.00000%99.91139%
** I2-ATLA-HOUS-10GE-055620 hr 0 min100.00000%99.92543%
** I2-KANS-SALT-10GE-055660 hr 0 min100.00000%99.97097%
I2-KANS-SALT-10GE-051380 hr 0 min100.00000%99.97097%
** I2-SALT-SEAT-10GE-055650 hr 0 min100.00000%99.97002%
** I2-SALT-SEAT-10GE-055730 hr 0 min100.00000%99.97002%
** I2-LOSA-SALT-10GE-055710 hr 0 min100.00000%99.88673%
** I2-LOSA-SALT-10GE-055630 hr 0 min100.00000%99.88673%
I2-ATLA-CHIC-10GE-056380 hr 12 min99.88095%99.71311%
I2-CHIC-KANS-10GE-055670 hr 7 min99.93056%99.91670%
I2-CHIC-KANS-10GE-055680 hr 0 min100.00000%99.91424%
I2-CHIC-KANS-10GE-059760 hr 0 min100.00000%99.98691%
I2-CHIC-WASH-10GE-056370 hr 0 min100.00000%99.99108%
I2-LOSA-SEAT-10GE-055640 hr 0 min100.00000%99.98463%
I2-LOSA-SEAT-10GE-055720 hr 0 min100.00000%99.98463%
I2-HOUS-LOSA-10GE-055810 hr 0 min100.00000%99.83796%

Aggregate All Internet2 IP Backbone Circuits0 hr 38 min99.98604%99.91824%





Upcoming Scheduled Maintenances

Ticket No.:16853:45
Subject:Internet2 IP Network Core Node KANS Maintenance
Affected:Core Node KANS and its Connector(s) and Participants
Start Time:Wednesday, February 9, 2011, 5:00 AM (0500) UTC
End Time:Sunday, January 9, 2011, 9:00 AM (0900) UTC
Description: Core Node KANS will be unavailable to the community while Internet2 Engineers swap the MX 960 to a T1600. An extended outage is expected; however, the entire window is reserved. All connections to the Core Node will be affected.