Unified - Internet2 IP Network Operations Report
08/29/2016 - 09/04/2016

Unified - Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

99524-Normal 1-Critical Brief Outage Resolved - I2 IP Core Node ATLA HardwareVendor 08/29/2016 7:06 AM 08/29/2016 7:10 AM
99734-Normal 1-Critical Brief Outage Resolved - I2 AL2S Core Node DENV SoftwareVendor 08/30/2016 4:37 PM 08/30/2016 4:41 PM

Unscheduled Outages Detail


Ticket No.:9952:144
Subject:Brief Outage Resolved - I2 IP Core Node ATLA
Source Of Impact:Vendor
Affected:Core Node ATLA and its Connector(s) and Participants.
IP Backbone ATLA-HOUS, ATLA-WASH, & ATLA-CHIC
Start Time:Monday, August 29, 2016, 7:06 AM (0706) UTC
End Time:Monday, August 29, 2016, 7:10 AM (0710) UTC
Description:The above listed assets remain available after a brief outage. Internet2 Engineers worked with the hardware vendor to identify a routing engine issue. The hardware was replaced and no further outages are expected.

Ticket No.:9973:144
Subject:Brief Outage Resolved - I2 AL2S Core Node DENV
Source Of Impact:Vendor
Affected:AL2S Core Node DENV
AL2S Backbones DENV-KANS, DENV-SALT, ALBU-DENV, & DENV-ELPA
IP Backbone KANS-SALT
Optical Member NOAA N-Wave
AL2S Participant XSEDE
AL2S Connector USDA
Start Time:Tuesday, August 30, 2016, 4:37 PM (1637) UTC
End Time:Tuesday, August 30, 2016, 4:41 PM (1641) UTC
Description:The above listed assets were briefly unavailable. Internet2 Engineers have investigated the cause; however the reason for the outage is undetermined. No further outages are expected.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

9947 3-Elevated 2-High Emergency Maintenance Completed - I2 AL2S Backbone BATO-JACK Hardware Vendor08/29/2016 2:25 AM 08/29/2016 2:35 AM
9630 3-Elevated 1-Critical Maintenance 1 of 2 Completed - I2 AL2S Core Node ALBA PowerInternal 08/30/2016 4:02 AM 08/30/2016 4:37 AM
9889 3-Elevated 1-Critical Maintenance Completed - I2 IP Core Node CLEV Hardware Internal08/31/2016 4:07 AM 08/31/2016 5:10 AM
9891 3-Elevated 1-Critical Maintenance Completed - I2 AL2S Core Node CLEV HardwareInternal 09/01/2016 4:07 AM 09/01/2016 6:33 AM
9882 3-Elevated 1-Critical Maintenance Completed - I2 Optical DWDM System ATLA-CHAT Hardware Vendor09/01/2016 7:34 AM 09/01/2016 8:39 AM

Scheduled Maintenances Detail

Ticket No.:9947:144
Subject:Emergency Maintenance Completed - I2 AL2S Backbone BATO-JACK
Source Of Impact:Vendor
Affected:AL2S Backbone BATO-JACK
IP Backbone ATLA-HOUS
Start Time:Monday, August 29, 2016, 2:25 AM (0225) UTC
End Time:Monday, August 29, 2016, 2:35 AM (0235) UTC
Description: The above listed asset is now available after Level(3) Engineers performed emergency maintenance to replace a failing card in Baton Rouge, LA. Maintenance has been completed. No further outages are expected.

Ticket No.:9630:144
Subject:Maintenance 1 of 2 Completed - I2 AL2S Core Node ALBA
Source Of Impact:Internal
Affected:AL2S Core Node ALBA
AL2S Backbone ALBA-BOST
AL2S Backbone ALBA-CLEV
AL2S Participant UVM
AL2S Participant UNH
AL2S Participant DART
AL2S Participant UMS
IP Backbone CHIC-NEWY
IP Backbone CLEV-NEWY
Start Time:Tuesday, August 30, 2016, 4:02 AM (0402) UTC
End Time:Tuesday, August 30, 2016, 4:37 AM (0437) UTC
Description: The above listed assets are now available. Internet2 Engineers, working with Level(3) Contracted Engineers, upgraded power services in Albany, NY. Maintenance has been completed. No further outages are expected.

Ticket No.:9889:144
Subject:Maintenance Completed - I2 IP Core Node CLEV
Source Of Impact:Internal
Affected:IP Core Node CLEV and its Connectors and Participants
IP Backbone ATLA-CLEV
IP Backbone CHIC-CLEV
IP Backbone CLEV-NEWY32AOA
IP Backbone CLEV-WASH
AL2S-IP Interconnect
Start Time:Wednesday, August 31, 2016, 4:07 AM (0407) UTC
End Time:Wednesday, August 31, 2016, 5:10 AM (0510) UTC
Description: The above listed assets are now available after Internet2 Engineers performed maintenance. Maintenance has been completed. No further outages are expected.

Ticket No.:9891:144
Subject:Maintenance Completed - I2 AL2S Core Node CLEV
Source Of Impact:Internal
Affected:AL2S Core Node CLEV and its Connectors and Participants
AL2S Backbone CLEV-PITT, CLEV-EQCH, & ALBA-CLEV
IP Backbone CLEV-WASH, ASHB-CLEV, ATLA-CLEV, CLEV-WASH, CLEV-
NEWY32AOA, CLEV-EQCH, CHIC-EQCH, CHIC-NEWY32AOA, & CHIC-CLEV
Start Time:Thursday, September 1, 2016, 4:07 AM (0407) UTC
End Time:Thursday, September 1, 2016, 6:33 AM (0633) UTC
Description: The above listed assets are now available after Internet2 Engineers performed maintenance. Maintenance has been completed. No further outages are expected.

Ticket No.:9882:144
Subject:Maintenance Completed - I2 Optical DWDM System ATLA-CHAT
Source Of Impact:Vendor
Affected:DWDM System ATLA-CHAT
AL2S Backbone ATLA-LOUI & ATLA-JCSN
IP Backbone ATLA-CHIC

Member NORDUnet
Member Indiana GigaPOP
Member MissION
Member NOAA N-Wave
Member ESnet
Start Time:Thursday, September 1, 2016, 7:34 AM (0734) UTC
End Time:Thursday, September 1, 2016, 8:39 AM (0839) UTC
Description: The above listed assets are now available after Level(3) Communications performed maintenance in Douglasville, GA. Maintenance has been completed. No further outages are expected.


Downtime and Availability



Unified - Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability
ASHB MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw0.sing1.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw.sing2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%

Aggregate Unified - Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%100.00000%100.00000%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Unified - Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
Layer3 AL3S Backbone ASHB-ATLA R&E VLAN 55199 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.54681%99.77312%
Layer3 AL3S Backbone ASHB-ATLA Commodity VLAN 55204 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.47604%99.61720%
Layer3 AL3S Backbone ASHB-CHIC R&E VLAN 55198 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Layer3 AL3S Backbone ASHB-CHIC Commodity VLAN 55203 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.68987%99.81551%
Layer3 AL3S Backbone ASHB-CLEV R&E VLAN 55197 3 hr 29 min0 hr 0 min 97.92659%100.00000% 99.85960%99.98411%
Layer3 AL3S Backbone ASHB-CLEV Commodity VLAN 55202 1 hr 3 min0 hr 0 min 99.37500%100.00000% 99.98694%100.00000%
Layer3 AL3S Backbone ASHB-NEWY R&E VLAN 55201 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.22949%99.50329%
Layer3 AL3S Backbone ASHB-NEWY Commodity VLAN 55206 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80851%99.92601%
Layer3 AL3S Backbone ASHB-WASH R&E VLAN 55200 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86868%99.92658%
Layer3 AL3S Backbone ASHB-WASH Commodity VLAN 55205 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85108%99.92072%
I2-CHIC-WASH-VLAN-12131 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.38370%99.61361%
I2-CHIC-WASH-VLAN-12132 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.36497%99.62913%
I2-ATLA-CLEV-VLAN-14832 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-CLEV-VLAN-14837 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14833 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14838 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14831 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14834 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 1 hr 5 min0 hr 0 min 99.35516%100.00000% 99.65864%99.87682%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 10 min0 hr 0 min 99.90079%100.00000% 98.85994%99.07527%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74190%99.81059%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 3 hr 29 min0 hr 0 min 97.92659%100.00000% 99.56119%99.85449%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79034%100.00000%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 4 hr 4 min0 hr 0 min 97.57937%100.00000% 99.47832%99.56517%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 3 hr 29 min0 hr 0 min 97.92659%100.00000% 99.59052%99.88609%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.97990%99.29534%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.66981%99.91996%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 4 min0 hr 4 min 99.96032%99.96032% 99.47850%99.79564%
R&E 10G Backbone: I2-LOSA-PAIX-VLAN-23105 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93245%99.99622%
Commodity 10G Backbone: I2-LOSA-PAIX-VLAN-23106 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93245%99.99622%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.55930%99.83613%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.67435%99.95497%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.67435%99.95497%
R&E 100G Backbone: I2-LOSA-WILC-VLAN-23103 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97597%100.00000%
Commodity 100G Backbone: I2-LOSA-WILC-VLAN-23104 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97597%100.00000%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.40528%99.51181%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.54057%99.74871%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.54057%99.74871%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09318 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74190%99.81059%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 1 hr 9 min0 hr 4 min 99.31548%99.96032% 99.58050%99.87606%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 0 hr 4 min0 hr 4 min 99.96032%99.96032% 98.83193%99.09798%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 4 min0 hr 4 min 99.96032%99.96032% 99.75704%99.84295%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 1 hr 3 min0 hr 0 min 99.37500%100.00000% 99.78372%99.87038%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80945%100.00000%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 1 hr 3 min0 hr 0 min 99.37500%100.00000% 99.87738%99.98316%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.16572%99.29950%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.72147%99.94550%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.65921%99.86773%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84370%99.87190%
Legacy 10G Backbone: I2-LOSA-PAIX-10GE-05853 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93245%99.99622%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84332%99.93377%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75685%99.95648%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 100G Backbone: I2-LOSA-WILC-100GE-23893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78353%99.87833%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.67265%99.74871%

Aggregate All Unified - Internet2 IP Backbone Circuits 20 hr 16 min20 hr 0 min 99.80224%99.99740% 99.71880%99.84452%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:10069:144
Subject:Emergency Maintenance 1 of 2 - I2 AL2S Backbone EQCH-MINN
Affected:AL2S Backbone EQCH-MINN
Net+ Provider Code42
Start Time:Sunday, September 11, 2016, 5:00 AM (0500) UTC
End Time:Sunday, September 11, 2016, 10:00 AM (1000) UTC
Description: The above listed asset will be unavailable while Zayo Engineers perform maintenance. An outage of up to 3 hours is expected. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. This is maintenance window 1 of 2.

Ticket No.:10071:144
Subject:Emergency Maintenance 2 of 2 - I2 AL2S Backbone EQCH-MINN
Affected:AL2S Backbone EQCH-MINN
Net+ Provider Code42
Start Time:Monday, September 12, 2016, 5:00 AM (0500) UTC
End Time:Monday, September 12, 2016, 10:00 AM (1000) UTC
Description: The above listed asset will be unavailable while Zayo Engineers perform maintenance. An outage of up to 3 hours is expected. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re- routed on the backbone. This is maintenance window 2 of 2.

Ticket No.:10077:144
Subject:Maintenance - I2 Optical Member CENIC
Affected:Member CENIC
Participant PacWave
Start Time:Wednesday, September 14, 2016, 7:00 AM (0700) UTC
End Time:Wednesday, September 14, 2016, 9:00 AM (0900) UTC
Description: The above listed optical circuits will be unavailable while Pacific Wave and Internet2 Engineers perform maintenance. An outage is expected. The entire maintenance window has been reserved.

Ticket No.:10098:144
Subject:Maintenance - I2 AL2S Core Node ELPA
Affected:AL2S Core Node ELPA
AL2S Backbones ELPA-HOUH, ELPA-TUCS, & DENV-ELPA
IP Backbone HOUS-LOSA
AL2S Participant CENIC
AL2S Participant LEARN
Start Time:Friday, September 16, 2016, 5:00 AM (0500) UTC
End Time:Friday, September 16, 2016, 11:00 AM (1100) UTC
Description: The above listed assets will be unavailable while Internet2 Engineers perform a maintenance to consolidate routers in El Paso, TX. An outage of 6 hours is expected; however, the entire window is reserved. All connections to the Core Node will be affected.

Ticket No.:10099:144
Subject:Maintenance - I2 AL2S Connector U.S. Department of Agriculture
Affected:AL2S Connector U.S. Department of Agriculture
Start Time:Wednesday, September 21, 2016, 4:00 AM (0400) UTC
End Time:Wednesday, September 21, 2016, 11:00 AM (1100) UTC
Description: The above listed asset will be unavailable while USDA Engineers perform hardware replacement maintenance. An outage is expected. The entire window is reserved.

Ticket No.:9981:144
Subject:Maintenance 1 of 2 - I2 Optical DWDM System JCSN-MEMP
Affected:DWDM System JCSN-MEMP
AL2S Backbone ATLA-JCSN
Member NOAA N-Wave
Member MissiON
Member ESnet
Start Time:Tuesday, September 27, 2016, 5:00 AM (0500) UTC
End Time:Tuesday, September 27, 2016, 10:00 AM (1000) UTC
Description: The above listed assets will be unavailable while Zayo Engineers perform maintenance in Jackson, MS. The entire maintenance window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. This is maintenance window 1 of 2

Ticket No.:9982:144
Subject:Maintenance 2 of 2 - I2 Optical DWDM System JCSN-MEMP
Affected:DWDM System JCSN-MEMP
AL2S Backbone ATLA-JCSN
Member NOAA N-Wave
Member MissiON
Member ESnet
Start Time:Wednesday, September 28, 2016, 5:00 AM (0500) UTC
End Time:Wednesday, September 28, 2016, 10:00 AM (1000) UTC
Description: The above listed assets will be unavailable while Zayo Engineers perform maintenance in Jackson, MS. The entire maintenance window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. This is maintenance window 2 of 2

Ticket No.:10133:144
Subject:Maintenance - I2 Optical Member NOAA N-Wave
Affected:
Start Time:Thursday, September 29, 2016, 4:00 AM (0400) UTC
End Time:Thursday, September 29, 2016, 10:00 AM (1000) UTC
Description: Member NOAA N-Wave's Optical circuit I2-ATLA-CHAR-10GE-07618 will be unavailable while their vendor contractors perform fiber maintenance. Outage are expected and the entire maintenance window has been reserved.

Ticket No.:9707:144
Subject:Maintenance - I2 Optical Member China Educational and Research Network
Affected:Member China Educational and Research Network
Start Time:Saturday, October 22, 2016, 12:00 AM (0000) UTC
End Time:Sunday, October 23, 2016, 12:00 PM (1200) UTC
Description: The above listed asset will be unavailable while TATA Engineers perform maintenance. An outage is expected; however, the entire window is reserved.