Internet2 IP Network Operations Report
05/12/2014 - 05/18/2014

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

230642-High 2-High Outage Resolved - I2 IP Backbone ATLA-WASH HardwareInternal 05/11/2014 7:33 PM 05/12/2014 5:48 PM

Unscheduled Outages Detail


Ticket No.:23064:45
Subject:Outage Resolved - I2 IP Backbone ATLA-WASH
Source Of Impact:Internal
Affected:Backbone ATLA-WASH
Start Time:Sunday, May 11, 2014, 7:33 PM (1933) UTC
End Time:Monday, May 12, 2014, 5:48 PM (1748) UTC
Description:Backbone ATLA-WASH is now available. The reason for the outage was due to a hardware failure. This hardware has been replaced, and service has been restored.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

23076 2-High 2-High Emergency Maintenance Completed - I2 IP Backbone CLEV-WASH Circuit Vendor05/13/2014 4:24 PM 05/13/2014 4:39 PM
23014 3-Elevated 2-High Maintenance 1 of 2 Completed - I2 IP Backbone LOSA-SALT CircuitVendor 05/14/2014 9:04 AM 05/14/2014 11:43 AM
23097 3-Elevated 2-High Emergency Maintenance Completed - I2 IP Backbones ATLA-WASH and CLEV-NEWY32AOA Hardware Vendor05/14/2014 11:00 PM 05/14/2014 11:03 PM
23073 3-Elevated 3-Elevated Emergency Maintenance Completed - I2 IP Circuit I2-CHIC-KANS-VLAN-09322 HardwareVendor 05/16/2014 6:06 AM 05/16/2014 6:22 AM
23106 3-Elevated 2-High Emergency Maintenance Completed - I2 IP Backbone CLEV-NEWY32AOA Hardware Vendor05/16/2014 3:03 PM 05/16/2014 3:23 PM

Scheduled Maintenances Detail

Ticket No.:23076:45
Subject:Emergency Maintenance Completed - I2 IP Backbone CLEV-WASH
Source Of Impact:Vendor
Affected:Backbone CLEV-WASH
Start Time:Tuesday, May 13, 2014, 4:24 PM (1624) UTC
End Time:Tuesday, May 13, 2014, 4:39 PM (1639) UTC
Description: Backbone CLEV-WASH was briefly unavailable while Internet2 Engineers, with the assistance of Equinix technicians, worked to correct a degraded condition on the AL2S backbone. IP traffic re-routed during the outage.

Ticket No.:23014:45
Subject:Maintenance 1 of 2 Completed - I2 IP Backbone LOSA-SALT
Source Of Impact:Vendor
Affected:Backbone LOSA-SALT
Start Time:Wednesday, May 14, 2014, 9:04 AM (0904) UTC
End Time:Wednesday, May 14, 2014, 11:43 AM (1143) UTC
Description: Backbone LOSA-SALT is now available after Level(3) Engineers performed maintenance. No further outages are expected. IP traffic re-routed during this maintenance. This was maintenance window 1 of 2.

Ticket No.:23097:45
Subject:Emergency Maintenance Completed - I2 IP Backbones ATLA-WASH and CLEV-NEWY32AOA
Source Of Impact:Vendor
Affected:Backbone ATLA-WASH
Backbone CLEV-NEWY32AOA
Start Time:Wednesday, May 14, 2014, 11:00 PM (2300) UTC
End Time:Wednesday, May 14, 2014, 11:03 PM (2303) UTC
Description: Backbones ATLA-WASH and CLEV-NEWY32AOA was unavailable while Ciena Engineers, working with I2 Engineering, performed hardware maintenance, which is completed. IP traffic re-routed during this maintenance.

Ticket No.:23073:45
Subject:Emergency Maintenance Completed - I2 IP Circuit I2-CHIC-KANS-VLAN-09322
Source Of Impact:Vendor
Affected:I2-CHIC-KANS-VLAN-09183
I2-CHIC-KANS-VLAN-09322
Start Time:Friday, May 16, 2014, 6:06 AM (0606) UTC
End Time:Friday, May 16, 2014, 6:22 AM (0622) UTC
Description: The above listed circuit was briefly unavailable while Internet2's fiber provider performed hardware maintenance. Maintenance has been completed. No further outages are expected.

Ticket No.:23106:45
Subject:Emergency Maintenance Completed - I2 IP Backbone CLEV-NEWY32AOA
Source Of Impact:Vendor
Affected:Backbone CLEV-NEWY32AOA
Start Time:Friday, May 16, 2014, 3:03 PM (1503) UTC
End Time:Friday, May 16, 2014, 3:23 PM (1523) UTC
Description: Backbone CLEV-NEWY32AOA was unavailable while Internet2 and vendor Engineers performed hardware maintenance, which is completed. IP traffic re-routed during this maintenance.


Downtime and Availability



Internet2 IP Core Nodes Down TimeReporting Period Availability52 Week Availability
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99355% 99.99867%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98501% 99.99905%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99089% 99.99924%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97571% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99639% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99184% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943% 100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99241% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99639% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98843% 100.00000%

Aggregate Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.99101%99.99970%

** Less than 52 weeks of data available

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.87363%99.95693%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74177%99.89545%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 2 min0 hr 0 min 99.98016%100.00000% 99.78749%99.84138%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79698%99.85409%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 16 min0 hr 0 min 99.84127%100.00000% 99.94915%99.98975%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 22 min0 hr 0 min 99.78175%100.00000% 99.98216%99.99924%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 15 min0 hr 0 min 99.85119%100.00000% 99.95105%99.98179%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.73057%99.77326%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71881%99.79660%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93777%99.97002%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 2 hr 39 min0 hr 0 min 98.42262%100.00000% 99.94592%100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96205%99.99905%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96205%99.99905%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94972%99.95617%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98710%99.99924%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98729%99.99943%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84100%99.91310%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05638 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.69016%99.76359%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.54406%99.87724%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05562 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.54292%99.87743%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05133 17 hr 50 min17 hr 48 min 89.38492%89.40476% 99.41143%99.45905%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 2 min0 hr 0 min 99.98016%100.00000% 99.66606%99.71236%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 2 min0 hr 0 min 99.98016%100.00000% 99.84707%99.85030%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-6366 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96604%99.98786%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08892 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96262%99.98786%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97856%99.99981%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97856%99.99981%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08893 0 hr 2 min0 hr 0 min 99.98016%100.00000% 99.95769%99.99829%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 2 min0 hr 0 min 99.98016%100.00000% 99.96471%99.99905%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.82620%99.83626%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08890 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80533%99.83626%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.68067%99.75030%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05561 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.68067%99.75030%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.52395%99.60686%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05581 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.51996%99.60667%
Legacy 10G Backbone: I2-KANS-CHIC-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05138 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81709%99.90930%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81709%99.90930%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81690%99.90912%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 2 hr 39 min0 hr 0 min 98.42262%100.00000% 99.74992%99.80666%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05571 2 hr 39 min0 hr 0 min 98.42262%100.00000% 99.75315%99.80666%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93416%99.97249%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93094%99.97249%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78825%99.91177%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07613 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78825%99.91177%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956%99.99943%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05573 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956%99.99943%

Aggregate All Internet2 IP Backbone Circuits 26 hr 50 min9 hr 2 min 99.68056%99.78810% 99.84052%99.89865%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

* Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.



Upcoming Scheduled Maintenances

Ticket No.:23102:45
Subject:Maintenance - I2 IP Backbone ATLA-HOUS
Affected:Backbone ATLA-HOUS
Start Time:Tuesday, May 27, 2014, 5:00 AM (0500) UTC
End Time:Tuesday, May 27, 2014, 11:00 AM (1100) UTC
Description: Backbone ATLA-HOUS will be unavailable whileLevel(3) Communications perform maintenance in Baton rouge, LA. An outage of 2 hours is expected; however the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:23117:45
Subject:Maintenance - I2 IP Backbone CHIC-CLEV
Affected:Backbone CHIC-CLEV
Start Time:Friday, May 30, 2014, 5:00 AM (0500) UTC
End Time:Friday, May 30, 2014, 7:00 AM (0700) UTC
Description: Backbone CHIC-CLEV will be unavailable while Internet2 Engineers perform maintenance. Outages are expected; however, the entire window is reserved. IP traffic will re-route during this maintenance.