Unified - Internet2 IP Network Operations Report
11/14/2016 - 11/20/2016

Unified - Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

110914-Normal 2-High Brief Outage Resolved - I2 AL2S Various Circuits (KANS) SoftwareVendor 11/14/2016 4:33 PM 11/14/2016 4:41 PM
111304-Normal 1-Critical Brief Outage - I2 Optical Various Circuits Human ErrorVendor 11/16/2016 8:04 PM 11/16/2016 8:05 PM

Unscheduled Outages Detail


Ticket No.:11091:144
Subject:Brief Outage Resolved - I2 AL2S Various Circuits (KANS)
Source Of Impact:Vendor
Affected:AL2S Backbone CHIC-KANS
IP Backbone CHIC-KANS and KANS-SALT
Start Time:Monday, November 14, 2016, 4:33 PM (1633) UTC
End Time:Monday, November 14, 2016, 4:41 PM (1641) UTC
Description:The above listed asset are available following a brief outage. The reason for the outage is a software defect. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:11130:144
Subject:Brief Outage - I2 Optical Various Circuits
Source Of Impact:Vendor
Affected:AL2S Backbone ELPA-HOUS
IP Backbone HOUS-LOSA
Member ESnet
Start Time:Wednesday, November 16, 2016, 8:04 PM (2004) UTC
End Time:Wednesday, November 16, 2016, 8:05 PM (2005) UTC
Description:The above listed asset is available following a brief outage. Internet2 Engineers are investigating the cause. The reason for the outage is undetermined. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

11016 3-Elevated 1-Critical Maintenance 2 of 2 Completed - I2 Optical DWDM System CHAR-RALE Circuit Vendor11/20/2016 5:04 AM 11/20/2016 6:31 AM

Scheduled Maintenances Detail

Ticket No.:11016:144
Subject:Maintenance 2 of 2 Completed - I2 Optical DWDM System CHAR-RALE
Source Of Impact:Vendor
Affected:DWDM System CHAR-RALE
AL2S Backbone(s) ATLA-WASH & CHAR-RALE
IP Backbone(s) ATLA-WASH, ATLA-CLEV, ATLA-NEWY32AOA, & ASHB-ATLA
Member ESnet
Member NOAA N-Wave
Start Time:Sunday, November 20, 2016, 5:04 AM (0504) UTC
End Time:Sunday, November 20, 2016, 6:31 AM (0631) UTC
Description: The above listed assets are now available after Level(3) Communications relocated fiber in Greensboro, NC. Maintenance has completed. This was maintenance window 2 of 2.


Downtime and Availability



Unified - Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability
ASHB MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw0.sing1.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw.sing2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%

Aggregate Unified - Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%100.00000%100.00000%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Unified - Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
Layer3 AL3S Backbone ASHB-ATLA R&E VLAN 55199 1 hr 27 min0 hr 0 min 99.13690%100.00000% 98.44403%98.74111%
Layer3 AL3S Backbone ASHB-ATLA Commodity VLAN 55204 1 hr 27 min0 hr 0 min 99.13690%100.00000% 99.40565%99.61645%
Layer3 AL3S Backbone ASHB-CHIC R&E VLAN 55198 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Layer3 AL3S Backbone ASHB-CHIC Commodity VLAN 55203 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.68987%99.81551%
Layer3 AL3S Backbone ASHB-CLEV R&E VLAN 55197 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81381%99.98392%
Layer3 AL3S Backbone ASHB-CLEV Commodity VLAN 55202 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98808%100.00000%
Layer3 AL3S Backbone ASHB-NEWY R&E VLAN 55201 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.01018%99.29534%
Layer3 AL3S Backbone ASHB-NEWY Commodity VLAN 55206 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.60055%99.71806%
Layer3 AL3S Backbone ASHB-WASH R&E VLAN 55200 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85600%99.92658%
Layer3 AL3S Backbone ASHB-WASH Commodity VLAN 55205 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.83954%99.92072%
I2-CHIC-WASH-VLAN-12131 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.37065%99.61361%
I2-CHIC-WASH-VLAN-12132 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.35191%99.62913%
I2-ATLA-CLEV-VLAN-14832 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-CLEV-VLAN-14837 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14833 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14838 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14831 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14834 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.60566%99.87682%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.72502%99.04992%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 1 hr 27 min0 hr 0 min 99.13690%100.00000% 99.60642%99.80983%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.57822%99.87360%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79205%100.00000%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.62439%99.71711%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.48267%99.88590%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.94925%99.32542%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.46015%99.81551%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.48853%99.79564%
R&E 10G Backbone: I2-LOSA-PAIX-VLAN-23105 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93472%99.99622%
Commodity 10G Backbone: I2-LOSA-PAIX-VLAN-23106 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93472%99.99622%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.63707%99.90236%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71087%99.95515%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71087%99.95515%
R&E 100G Backbone: I2-LOSA-WILC-VLAN-23103 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97408%100.00000%
Commodity 100G Backbone: I2-LOSA-WILC-VLAN-23104 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97408%100.00000%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.43820%99.57368%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79167%99.99981%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79167%99.99981%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09318 1 hr 27 min0 hr 0 min 99.13690%100.00000% 99.60642%99.80983%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.56347%99.87587%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.80469%99.07735%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 1 hr 27 min0 hr 0 min 99.13690%100.00000% 99.71087%99.84295%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80283%99.88949%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 8 min0 hr 8 min 99.92063%99.92063% 99.80794%99.99849%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86490%99.98259%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.12598%99.32978%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.60415%99.84749%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 8 min0 hr 8 min 99.92063%99.92063% 99.66602%99.86622%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84370%99.87190%
Legacy 10G Backbone: I2-LOSA-PAIX-10GE-05853 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93472%99.99622%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92185%100.00000%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.67832%99.87038%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 100G Backbone: I2-LOSA-WILC-100GE-23893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76082%99.87852%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89309%99.99981%

Aggregate All Unified - Internet2 IP Backbone Circuits 7 hr 32 min7 hr 15 min 99.92649%99.99724% 99.69132%99.83484%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:11231:144
Subject:Emergency Maintenance - I2 AL2S Backbone CLEV-EQCH
Affected:AL2S Backbone CLEV-EQCH
Peer Nysernet (CHIC)
Peer Northern Lights (CLEV)
Start Time:Wednesday, November 30, 2016, 6:00 AM (0600) UTC
End Time:Wednesday, November 30, 2016, 8:00 AM (0800) UTC
Description: The above listed asset will be unavailable while Internet2 Engineers perform emergency maintenance to clean fiber. An outage is expected. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:11134:144
Subject:Maintenance - I2 Optical Member Center for Education Network Initiatives in California
Affected:Member Center for Education Network Initiatives in California
Start Time:Wednesday, November 30, 2016, 7:00 AM (0700) UTC
End Time:Wednesday, November 30, 2016, 1:00 PM (1300) UTC
Description: Member Center for Education Network Initiatives in California's Optical circuit I2-SEAT-SUNN-100GE-07910 will be unavailable while PNWGP Engineers perform maintenance. Outages are expected. The entire window is reserved.

Ticket No.:11095:144
Subject:Maintenance 2 of 2 - I2 AL2S Backbone MINN-MISS2
Affected:AL2S Backbone MINN-MISS2
IP Net+ Provider Code42
Start Time:Wednesday, November 30, 2016, 7:00 AM (0700) UTC
End Time:Wednesday, November 30, 2016, 12:00 PM (1200) UTC
Description: The above listed asset will be unavailable while Zayo Engineers perform maintenance in Last Chance Gulch Helena, MT. An outage of up to one hour is expected. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. This is window 2 of 2.

Ticket No.:11141:144
Subject:Maintenance - I2 Optical Member NOAA N-Wave
Affected:
Start Time:Thursday, December 1, 2016, 5:00 AM (0500) UTC
End Time:Thursday, December 1, 2016, 11:00 AM (1100) UTC
Description: Member NOAA N-Wave's Optical circuit I2-ATLA-CHAR-10GE-07618 will be unavailable while NOAA N-Wave Engineers perform maintenance. An outage is expected, however the entire maintenance window has been reserved.

Ticket No.:11222:144
Subject:Maintenance - I2 AL2S Backbone CINC-LOUI
Affected:AL2S Backbone CINC-LOUI
IP Backbone ATLA-CHIC
Start Time:Friday, December 2, 2016, 5:00 AM (0500) UTC
End Time:Friday, December 2, 2016, 7:00 AM (0700) UTC
Description: The above listed asset will be unavailable while Internet2 Engineers perform maintenance. An outage is expected. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:11203:144
Subject:Maintenance - I2 AL2S Circuit I2-LOSA-SING-100GE-55449
Affected:Internet2 Singapore
Start Time:Sunday, December 4, 2016, 7:00 AM (0700) UTC
End Time:Monday, December 5, 2016, 1:00 AM (0100) UTC
Description: The above listed asset will be unavailable while Level(3) Engineers perform maintenance on circuit I2-LOSA-SING-100GE-55449. An outage of 30 minutes is expected.However, the entire window is reserved.

Ticket No.:11233:144
Subject:Maintenance - I2 AL2S Circuit I2-LOSA-SING-100GE-55449
Affected:Internet2 Singapore
Start Time:Tuesday, December 6, 2016, 6:00 AM (0600) UTC
End Time:Tuesday, December 6, 2016, 9:00 AM (0900) UTC
Description: The above listed asset will be unavailable while Level(3) Engineers perform maintenance on circuit I2-LOSA-SING-100GE-55449. An outage of 1 hour and 30 minutes is expected. The entire window is reserved.

Ticket No.:11159:144
Subject:Maintenance - I2 Optical Member NOAA N-Wave
Affected:Member NOAA N-Wave
Start Time:Wednesday, December 7, 2016, 5:00 AM (0500) UTC
End Time:Wednesday, December 7, 2016, 11:00 AM (1100) UTC
Description: Member NOAA N-Wave's Optical circuit I2-ATLA-CHAR-10GE-07618will be unavailable while their participant engineers perform maintenance. An outage is expected, however the entire maintenance window has been reserved.

Ticket No.:11038:144
Subject:Maintenance Rescheduled 1 of 2 - I2 Optical DWDM System MEMP-NASH
Affected:DWDM System MEMP-NASH
AL2S Backbone ATLA-JCSN
Member NOAA N-Wave
Member Univeristy of Memphis
Member MissiON
Member ESnet
Start Time:Thursday, December 8, 2016, 6:00 AM (0600) UTC
End Time:Thursday, December 8, 2016, 12:00 PM (1200) UTC
Description: The above listed assets will be unavailable while Level(3) Communications perform cable relocation maintenance in Mount Pleasant, TN. An outage is expected. The entire window is reserved.

Ticket No.:11125:144
Subject:Maintenance 1 of 2 - I2 Optical DWDM Systems KANS-SAIN and CHIC-SAIN
Affected:DWDM Systems KANS-SAIN and CHIC-SAIN
AL2S Backbones CHIC-KANS and CHIC-COLU4
IP Backbone CHIC-KANS
Start Time:Friday, December 9, 2016, 6:00 AM (0600) UTC
End Time:Friday, December 9, 2016, 12:00 PM (1200) UTC
Description: The above listed assets will be unavailable while Level(3) Communications performs cable relocation maintenance in St. Louis, MO. An outage of 2 hours is expected. The entire window is reserved. This is maintenance window 1 of 2.

Ticket No.:11039:144
Subject:Maintenance Rescheduled 2 of 2 - I2 Optical DWDM System MEMP-NASH
Affected:DWDM System MEMP-NASH
AL2S Backbone ATLA-JCSN
Member NOAA N-Wave
Member Univeristy of Memphis
Member MissiON
Member ESnet
Start Time:Friday, December 9, 2016, 6:00 AM (0600) UTC
End Time:Friday, December 9, 2016, 12:00 PM (1200) UTC
Description: The above listed assets will be unavailable while Level(3) Communications perform cable relocation maintenance in Mount Pleasant, TN. An outage is expected. The entire window is reserved.

Ticket No.:11133:144
Subject:Maintenance 2 of 2 - I2 Optical DWDM Systems KANS-SAIN and CHIC-SAIN
Affected:DWDM Systems KANS-SAIN and CHIC-SAIN
AL2S Backbones CHIC-KANS and CHIC-COLU4
IP Backbone CHIC-KANS
Start Time:Saturday, December 10, 2016, 6:00 AM (0600) UTC
End Time:Saturday, December 10, 2016, 12:00 PM (1200) UTC
Description: The above listed assets will be unavailable while Level(3) Communications performs cable relocation maintenance in St. Louis, MO. An outage of 2 hours is expected. The entire window is reserved. This is maintenance window 2 of 2.

Ticket No.:11160:144
Subject:Maintenance - I2 AL2S Backbone MINN-MISS2
Affected:AL2S Backbone MINN-MISS2
IP Net+ Provider Code42
Start Time:Saturday, December 10, 2016, 3:00 PM (1500) UTC
End Time:Saturday, December 10, 2016, 11:00 PM (2300) UTC
Description: The above listed asset will be unavailable while Zayo Engineers perform maintenance. An outage is expected. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.