Internet2 IP Network Operations Report
01/27/2014 - 02/02/2014

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Start Time (UTC) End Time (UTC)

222842-High 2-High Outage Resolved - I2 IP Backbone CHIC-CLEV Unannounced Maintenance 01/30/2014 8:56 PM 01/30/2014 9:57 PM

Unscheduled Outages Detail


Ticket No.:22284:45
Subject:Outage Resolved - I2 IP Backbone CHIC-CLEV
Affected:Backbone CHIC-CLEV
Start Time:Thursday, January 30, 2014, 8:56 PM (2056) UTC
End Time:Thursday, January 30, 2014, 9:57 PM (2157) UTC
Description:Backbone CHIC-CLEV was unavailable while Level(3) Engineers performed emergency maintenance. This is a temporary fix to be resolved in a future maintenance. Today's work has been completed and no further outages are expected.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Start Time (UTC) End Time (UTC)

22229 3-Elevated 2-High Maintenance Completed - I2 IP Backbone KANS-SALT Hardware 01/28/2014 6:11 AM 01/28/2014 6:25 AM
22149 3-Elevated 2-High Maintenance 1 of 2 Completed - I2 IP Backbone ATLA-CHIC Circuit 01/29/2014 6:01 AM 01/29/2014 9:24 AM
22226 3-Elevated 3-Elevated Maintenance Completed - I2 IP Backbone CHIC-CLEV Hardware 01/29/2014 5:02 AM 01/29/2014 5:20 AM

Scheduled Maintenances Detail

Ticket No.:22229:45
Subject:Maintenance Completed - I2 IP Backbone KANS-SALT
Affected:Backbone KANS-SALT
Start Time:Tuesday, January 28, 2014, 6:11 AM (0611) UTC
End Time:Tuesday, January 28, 2014, 6:25 AM (0625) UTC
Description: Backbone KANS-SALT was briefly unavailable while Level(3) Communications performed maintenance to troubleshoot an Amp Pump Failure between Denver, CO and Platteville, CO. IP traffic was re-routed during this maintenance. No further outages are anticipated. Maintenance has been completed.

Ticket No.:22149:45
Subject:Maintenance 1 of 2 Completed - I2 IP Backbone ATLA-CHIC
Affected:Backbone ATLA-CHIC
Start Time:Wednesday, January 29, 2014, 6:01 AM (0601) UTC
End Time:Wednesday, January 29, 2014, 9:24 AM (0924) UTC
Description: Backbone ATLA-CHIC was unavailable while vendor Engineers performed maintenance. IP traffic was re-routed during this maintenance. This was the first of two maintenance windows. Maintenance has been completed successfully.

Ticket No.:22226:45
Subject:Maintenance Completed - I2 IP Backbone CHIC-CLEV
Affected:Backbone CHIC-CLEV
Start Time:Wednesday, January 29, 2014, 5:02 AM (0502) UTC
End Time:Wednesday, January 29, 2014, 5:20 AM (0520) UTC
Description: A portion of backbone CHIC-CLEV was unavailable while Level(3) Communications performed maintenance to troubleshoot an incorrectly provisioned CMD on the node in Chicago. A period of diminished capacity was expected. Maintenance has been successfully completed. No further outages are anticipated.


Downtime and Availability



Internet2 IP Core Nodes Down TimeReporting Period Availability52 Week Availability
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98065% 99.99981%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96945% 99.99905%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99146% 99.99924%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96888% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99791% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96680% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98179% 99.99867%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97344% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96452% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94175% 99.99962%

Aggregate Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.97366%99.99964%

** Less than 52 weeks of data available

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 3 hr 23 min0 hr 0 min 97.98611%100.00000% 99.94517%99.99943%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98767%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94668%99.99848%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 1 hr 1 min1 hr 1 min 99.39484%99.39484% 99.80874%99.86434%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96433%100.00000%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98900%99.99943%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98937%100.00000%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96585%100.00000%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75448%99.81671%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 14 min0 hr 0 min 99.86111%100.00000% 99.97514%99.99981%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98975%100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96907%99.99905%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95200%99.95636%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99051%99.99924%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 3 hr 23 min0 hr 0 min 97.98611%100.00000% 99.70382%99.81538%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05638 3 hr 23 min0 hr 0 min 97.98611%100.00000% 99.70249%99.81538%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89526%99.96983%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05562 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89413%99.97002%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05133 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76738%99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76871%99.86092%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99772%99.99981%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-6366 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 1 hr 1 min1 hr 1 min 99.39484%99.39484% 99.86434%99.88540%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08892 1 hr 19 min1 hr 1 min 99.21627%99.39484% 99.86092%99.88540%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93701%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92790%100.00000%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90760%99.95731%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91386%99.95731%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84612%99.90190%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08890 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84024%99.90190%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.58997%99.65657%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05561 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.58997%99.65657%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.51749%99.68105%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05581 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.51711%99.68067%
Legacy 10G Backbone: I2-KANS-CHIC-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05138 0 hr 14 min0 hr 0 min 99.86111%100.00000% 99.77592%99.90912%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 14 min0 hr 0 min 99.86111%100.00000% 99.77611%99.90930%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 14 min0 hr 0 min 99.86111%100.00000% 99.82449%99.90912%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74803%99.80666%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05571 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75125%99.80666%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.73304%99.82278%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.73304%99.82601%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.73076%99.91101%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07613 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.65828%99.83853%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97154%99.99943%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05573 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97154%99.99943%

Aggregate All Internet2 IP Backbone Circuits 14 hr 26 min11 hr 23 min 99.82101%99.96218% 99.85300%99.91307%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

* Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.



Upcoming Scheduled Maintenances

Ticket No.:22304:45
Subject:Maintenance - I2 IP Core Node KANS
Affected:Core Node KANS and its Connector(s) and Participants
Connector LEARN
Net+ Provider Dell
Start Time:Saturday, February 8, 2014, 11:00 AM (1100) UTC
End Time:Saturday, February 8, 2014, 12:00 PM (1200) UTC
Description: Core Node KANS will be unavailable while Internet2 Engineers reboot the routing engine. An outage is expected, and the entire window is reserved. All connections to the Core Node will be affected.

Ticket No.:22231:45
Subject:Maintenance 1 of 2 - I2 IP Backbone LOSA-SALT
Affected:Backbone LOSA-SALT
Start Time:Tuesday, February 25, 2014, 8:00 AM (0800) UTC
End Time:Tuesday, February 25, 2014, 2:00 PM (1400) UTC
Description: Backbone LOSA-SALT will be unavailable while Level(3) Communications performs fiber maintenance in San Gabriel, CA as mandated by the California Department of Transportation. The entire window is reserved. IP traffic will re-route during this maintenance. An alternate window has been reserved for 2/28/14 at 0800-1400, should it be required.

Ticket No.:22234:45
Subject:Maintenance 2 of 2 - I2 IP Backbone LOSA-SALT
Affected:Backbone LOSA-SALT
Start Time:Friday, February 28, 2014, 8:00 AM (0800) UTC
End Time:Friday, February 28, 2014, 2:00 PM (1400) UTC
Description: Backbone LOSA-SALT will be unavailable while Level(3) Communications performs fiber maintenance in San Gabriel, CA as mandated by the California Department of Transportation. The entire window is reserved. IP traffic will re-route during this maintenance. This is an alternate window for ticket 22231:45, should it be required.