Internet2 IP Network Operations Report
06/02/2014 - 06/08/2014

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

232092-High 2-High Brief Outage - I2 IP Backbone NEWY32AOA-WASH UndeterminedUndetermined 06/02/2014 8:57 PM 06/02/2014 8:58 PM
232252-High 2-High Brief Outage - I2 IP 10GE Backbones CHIC-KANS InvestigatingUndetermined 06/04/2014 9:24 PM 06/04/2014 9:25 PM
232322-High 2-High Availability - I2 IP Backbone CHIC-KANS HardwareVendor 06/06/2014 8:55 AM 06/06/2014 10:01 AM

Unscheduled Outages Detail


Ticket No.:23209:45
Subject:Brief Outage - I2 IP Backbone NEWY32AOA-WASH
Source Of Impact:Undetermined
Affected:Backbone NEWY32AOA-WASH
Start Time:Monday, June 2, 2014, 8:57 PM (2057) UTC
End Time:Monday, June 2, 2014, 8:58 PM (2058) UTC
Description:Backbone NEWY32AOA-WASH was briefly unavailable. Internet2 Engineers are investigating the cause; however, the reason for the outage is pending. IP traffic will re-route.

Ticket No.:23225:45
Subject:Brief Outage - I2 IP 10GE Backbones CHIC-KANS
Source Of Impact:Undetermined
Affected:ION Backbone Circuits CHIC-KANS
Participant SLIAC
Start Time:Wednesday, June 4, 2014, 9:24 PM (2124) UTC
End Time:Wednesday, June 4, 2014, 9:25 PM (2125) UTC
Description:Backbone Circuits CHIC-KANS were briefly unavailable. Internet2 Engineers are investigating the cause; however, the reason for the outage is pending. The Internet2 IP Network (R&E/Commodity) Backbone CHIC-KANS remained available. This outage affected only ION traffic.

Ticket No.:23232:45
Subject:Availability - I2 IP Backbone CHIC-KANS
Source Of Impact:Vendor
Affected:Backbone CHIC-KANS
Start Time:Friday, June 6, 2014, 8:55 AM (0855) UTC
End Time:Friday, June 6, 2014, 10:01 AM (1001) UTC
Description:Backbone CHIC-KANS is now available.Fiber provider Engineers report that outage was due to a card card failure in Plainfiled, IL. IP traffic was re-routed.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

23196 3-Elevated 2-High Maintenance Completed - I2 IP Various Backbones (KANS) Hardware Vendor06/04/2014 5:15 AM 06/04/2014 5:26 AM

Scheduled Maintenances Detail

Ticket No.:23196:45
Subject:Maintenance Completed - I2 IP Various Backbones (KANS)
Source Of Impact:Vendor
Affected:Backbone CHIC-KANS
Backbone HOUS-KANS
Backbone KANS-SALT
Connector GPN
Connector UEN
Connector LONI
Connector LEARN
Start Time:Wednesday, June 4, 2014, 5:15 AM (0515) UTC
End Time:Wednesday, June 4, 2014, 5:26 AM (0526) UTC
Description: The above listed backbones along with their connectors and participants were unavailable while Internet2 Engineering, with the assistance of Level(3) Communications remote hands technician, replaced a failing card on the Kansas City, MO router, and consolidated connections from another card onto the newly replaced card. Outages were expected throughout the maintenance window. No further outages are anticipated. Maintenance has been completed.


Downtime and Availability



Internet2 IP Core Nodes Down TimeReporting Period Availability52 Week Availability
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99355% 99.99867%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98501% 99.99905%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99089% 99.99924%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97571% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99639% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99184% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943% 100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99336% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99639% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98843% 100.00000%

Aggregate Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.99110%99.99970%

** Less than 52 weeks of data available

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.87306%99.95636%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.72279%99.89545%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78749%99.84138%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78939%99.85409%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 1 hr 17 min1 hr 6 min 99.23611%99.34524% 99.93454%99.97723%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98216%99.99924%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95105%99.98179%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 11 min0 hr 0 min 99.89087%100.00000% 99.72848%99.77326%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.69756%99.79660%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 11 min0 hr 0 min 99.89087%100.00000% 99.93568%99.97002%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94592%100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96205%99.99905%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96205%99.99905%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.94953%99.95598%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98710%99.99924%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98729%99.99943%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89545%99.96755%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05638 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74461%99.81804%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.54330%99.89526%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05562 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.54216%99.89545%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05133 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.54937%99.59699%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80400%99.85030%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84707%99.85030%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-6366 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96604%99.98786%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08892 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95769%99.98786%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 1 hr 18 min1 hr 7 min 99.22619%99.33532% 99.96376%99.98710%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 1 hr 18 min1 hr 7 min 99.22619%99.33532% 99.96376%99.98710%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95845%99.99905%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96053%99.99981%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.82620%99.83626%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08890 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80039%99.83626%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 0 hr 11 min0 hr 0 min 99.89087%100.00000% 99.67858%99.75030%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05561 0 hr 11 min0 hr 0 min 99.89087%100.00000% 99.67858%99.75030%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.50269%99.60667%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05581 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.49890%99.60667%
Legacy 10G Backbone: I2-KANS-CHIC-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05138 0 hr 11 min0 hr 0 min 99.89087%100.00000% 99.81500%99.90930%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 11 min0 hr 0 min 99.89087%100.00000% 99.81500%99.90930%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 11 min0 hr 0 min 99.89087%100.00000% 99.81481%99.90912%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74992%99.80666%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05571 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75315%99.80666%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95978%99.99772%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95655%99.99772%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78825%99.91177%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07613 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78825%99.91177%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956%99.99943%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05573 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98937%99.99943%

Aggregate All Internet2 IP Backbone Circuits 5 hr 11 min1 hr 50 min 99.93829%99.96012% 99.84595%99.90732%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

* Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.



Upcoming Scheduled Maintenances

Ticket No.:23213:45
Subject:Maintenance - I2 IP Backbone ATLA-CHIC
Affected:Backbone ATLA-CHIC
Start Time:Tuesday, June 10, 2014, 5:00 AM (0500) UTC
End Time:Tuesday, June 10, 2014, 6:00 AM (0600) UTC
Description: Backbone ATLA-CHIC will be unavailable while Internet2 Engineers perform maintenance. A brief outage is expected; however, the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:23220:45
Subject:Maintenance - I2 IP Backbone CHIC-CLEV
Affected:Backbone I2-CHIC-CLEV-VLAN-09180
Backbone I2-CHIC-CLEV-VLAN-09319
Start Time:Wednesday, June 11, 2014, 8:00 AM (0800) UTC
End Time:Wednesday, June 11, 2014, 10:00 AM (1000) UTC
Description: Backbones I2-CHIC-CLEV-VLAN-09180 & I2-CHIC-CLEV-VLAN- 09319 will be unavailable while Internet2 Engineers perform maintenance to create an additional AL2S backbone. The entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:23238:45
Subject:Maintenance - I2 IP Backbone CHIC-KANS
Affected:Backbone CHIC-KANS
Start Time:Thursday, June 12, 2014, 2:00 AM (0200) UTC
End Time:Thursday, June 12, 2014, 4:00 AM (0400) UTC
Description: Backbone CHIC-KANS will be unavailable while Level(3) Communications performs maintenance to replace a card in Plainfield, IN. An outage is expected, and the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:23198:45
Subject:Maintenance Freeze - I2 Optical Various Circuits (FIFA World Cup)
Affected:
Start Time:Sunday, June 15, 2014, 1:00 AM (0100) UTC
End Time:Sunday, July 13, 2014, 10:00 PM (2200) UTC
Description: Maintenance Freeze approved, routes applied, posting to cal.

Ticket No.:23219:45
Subject:Maintenance - I2 IP Various Backbones
Affected:Backbone ATLA-CHIC
Backbone CHIC-CLEV
Backbone HOUS-KANS
Backbone CLEV-WASH
ION Backbone CLEV-WASH
ION Backbone HOUS-KANS
ION Backbone ATLA-CHIC
ION Backbone CHIC-CLEV
Start Time:Thursday, June 26, 2014, 4:00 AM (0400) UTC
End Time:Thursday, June 26, 2014, 11:00 AM (1100) UTC
Description: The backbone listed above will be unavailable while Internet2 fiber provider Engineers perform maintenance. Outages are expected; however, the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:23221:45
Subject:Maintenance - I2 IP Various Backbones
Affected:Backbone CLEV-NEWY32AOA
Backbone LOSA-SEAT
Backbone NEWY32AOA-WASH
ION Backbone CLEV-NEWY32AOA
ION Backbone NEWY32AOA-WASH
Start Time:Friday, June 27, 2014, 4:00 AM (0400) UTC
End Time:Friday, June 27, 2014, 11:00 AM (1100) UTC
Description: The backbones listed above will be unavailable while Internet2's fiber provider Engineers perform maintenance. Outages are expected and the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:23222:45
Subject:Maintenance - I2 IP Various Backbones
Affected:ION Backbone ATLA-CHIC
Backbone ATLA-CHIC
ION Backbone ATLA-WASH
Backbone ATLA-WASH
ION Backbone CHIC-KANS
Backbone CHIC-KANS
ION Backbone HOUS-KANS
Backbone HOUS-KANS
Start Time:Sunday, June 29, 2014, 4:00 AM (0400) UTC
End Time:Sunday, June 29, 2014, 11:00 AM (1100) UTC
Description: The above listed backbones will be unavailable while Vendor Engineers perform maintenance. Outages are anticipated; however, the entire window is reserved. IP traffic will re-route during this maintenance.