Unified - Internet2 IP Network Operations Report
01/26/2015 - 02/01/2015

Unified - Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

23953-Elevated 1-Critical Outage Resolved - I2 Optical DWDM System BATO-JACK Unannounced MaintenanceVendor 01/30/2015 5:00 AM 01/30/2015 6:14 AM
23993-Elevated Brief Outage Resolved - I2 AL2S Core Node (PHOE) HardwareInternal 01/30/2015 10:56 AM 01/30/2015 11:00 AM

Unscheduled Outages Detail


Ticket No.:2395:144
Subject:Outage Resolved - I2 Optical DWDM System BATO-JACK
Source Of Impact:Vendor
Affected:DWDM BATO-JACK
AL2S Backbone(s) BATO-JACK
IP Backbone(s) ATLA-HOUS
Start Time:Friday, January 30, 2015, 5:00 AM (0500) UTC
End Time:Friday, January 30, 2015, 6:14 AM (0614) UTC
Description:DWDM System BATO-JACK was unavailable to the community. Level (3) Communications technicians have informed that the reason for the outage was due to a planned maintenance. This maintenance has been completed.

Ticket No.:2399:144
Subject:Brief Outage Resolved - I2 AL2S Core Node (PHOE)
Source Of Impact:Internal
Affected:AL2S Core Node PHOE
AL2S Backbone LOSA-PHOE
AL2S Backbone HOUS-LOSA
IP Backbone HOUS-LOSA
Start Time:Friday, January 30, 2015, 10:56 AM (1056) UTC
End Time:Friday, January 30, 2015, 11:00 AM (1100) UTC
Description:The above listed assets was briefly unavailable. Internet2 Engineers diagnosed a problem with AL2S Core Node PHOE during maintenance 2304:144, forcing a swap of the routing-engine for preventative action to replace defective module.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

2393 3-Elevated 1-Critical Emergency Maintenance Completed - I2 Optical DWDM System DETR-EQCH Circuit Vendor01/30/2015 8:22 AM 01/30/2015 8:56 AM

Scheduled Maintenances Detail

Ticket No.:2393:144
Subject:Emergency Maintenance Completed - I2 Optical DWDM System DETR-EQCH
Source Of Impact:Vendor
Affected:DWDM DETR-EQCH
AL2S Backbone ASHB-CHIC
AL2S Backbone CLEV-CHIC
IP Backbone(s) CHIC-CLEV
Start Time:Friday, January 30, 2015, 8:22 AM (0822) UTC
End Time:Friday, January 30, 2015, 8:56 AM (0856) UTC
Description: DWDM System DETR-EQCH was unavailable while Internet 2 Engineers with the help of Equinix checked a fiber cross-connect in Chicago, IL. This maintenance has been completed.


Downtime and Availability



Unified - Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw0.sing1.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw.sing2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%

Aggregate Unified - Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%100.00000%100.00000%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Unified - Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
I2-ATLA-CLEV-VLAN-14832 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-CLEV-VLAN-14837 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14833 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14838 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14831 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14834 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71046%99.97268%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.60895%99.99621%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92809%99.99829%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94004%99.99924%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97344%99.99924%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94498%99.99469%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96585%99.99469%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91006%99.99696%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 4 min0 hr 4 min 99.96032%99.96032% 99.63760%99.75808%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89868%99.98975%
R&E 10G Backbone: I2-LOSA-PAIX-VLAN-23105 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Commodity 10G Backbone: I2-LOSA-PAIX-VLAN-23106 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98900%100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97666%99.99943%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97666%99.99943%
R&E 100G Backbone: I2-LOSA-WILC-VLAN-23103 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Commodity 100G Backbone: I2-LOSA-WILC-VLAN-23104 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98918%99.99867%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99696%100.00000%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99696%100.00000%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09318 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92809%99.99829%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.73418%99.97306%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 1 hr 13 min1 hr 13 min 99.27579%99.27579% 99.20993%99.56208%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93871%100.00000%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93871%100.00000%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 34 min0 hr 0 min 99.66270%100.00000% 99.95807%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981%99.99981%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96376%99.99962%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94346%99.99753%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76245%99.82772%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92505%99.99924%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92505%99.99924%
Legacy 10G Backbone: I2-LOSA-PAIX-10GE-05853 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99621%100.00000%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99488%100.00000%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97875%99.99962%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99431%100.00000%
Legacy 100G Backbone: I2-LOSA-WILC-100GE-23893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829%99.99943%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%

Aggregate All Unified - Internet2 IP Backbone Circuits 1 hr 51 min0 hr 34 min 99.97753%99.98441% 99.93129%99.98067%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:2388:144
Subject:Maintenance - I2 Optical Member N-Wave ( NWAVE-CHIC-CLEV-10GE-02056)
Affected:NWAVE-CHIC-CLEV-10GE-02056
Start Time:Friday, February 6, 2015, 1:00 AM (0100) UTC
End Time:Friday, February 6, 2015, 3:00 AM (0300) UTC
Description: Member N-Wave's Optical circuit NWAVE-CHIC-CLEV-10GE-02056 will be unavailable while N-Wave Engineers perform maintenance. A brief outage is expected. The entire maintenance window has been reserved.

Ticket No.:2421:144
Subject:Maintenance - I2 Optical Member SOX
Affected:I2-ATLA-ATLA-100GE-11442
Start Time:Friday, February 6, 2015, 6:00 AM (0600) UTC
End Time:Friday, February 6, 2015, 10:00 AM (1000) UTC
Description: Member SOX's Optical circuit I2-ATLA-ATLA-100GE-11442 will be unavailable while SOX Engineers perform maintenance. A brief outage is expected, however the entire maintenance window has been reserved.

Ticket No.:2335:144
Subject:Maintenance - I2 AL2S Various Backbone Configuration Change
Affected:AL2S Backbone Management on the following routes will be updated:
ASHB - WASH (CID 09106)
ASHB - WASH (CID 11823)
ASHB - PITT
ATLA - CHIC
CHAR - RALE
RALE - WASH
PHIL - WASH
CLEV - PITT
Start Time:Monday, February 9, 2015, 5:00 AM (0500) UTC
End Time:Monday, February 9, 2015, 9:00 AM (0900) UTC
Description: Internet2 Network Engineering will be performing work to update in-band monitoring. No impact to production services is anticipated; however, the entire window is reserved. Workgroup administrators received notifications from OESS regarding circuits re-routed on the backbone

Ticket No.:2392:144
Subject:Maintenance - I2 AL2S Core Node CLEV
Affected:AL2S Core Node CLEV
AL2S Backbone ALBA-CLEV, CLEV-EQCH, CLEV-PITT, CLEV-CLEV
Start Time:Monday, February 9, 2015, 8:30 AM (0830) UTC
End Time:Monday, February 9, 2015, 9:00 AM (0900) UTC
Description: The above listed assets will be unavailable while Internet2 Engineers perform AL2S hardware maintenance. An outage of 5 min is expected; however, the entire window is reserved. All connections to the Core Node will be affected.

Ticket No.:2104:144
Subject:Maintenance 3 of 3 - I2 Optical Member NOAA N-Wave
Affected:
Start Time:Tuesday, February 10, 2015, 5:00 AM (0500) UTC
End Time:Tuesday, February 10, 2015, 10:00 AM (1000) UTC
Description: Optical Member NOAA N-Wave will be unavailable while Zayo Engineers perform a fiber repair near Smithfield, PA. An outage of 3 hours is expected; however, the entire window has been reserved. *This is maintenance window 3 of 3.*

Ticket No.:2316:144
Subject:Maintenance - I2 Optical DWDM System BATO-JACK
Affected:DWDM BATO-JACK
AL2S Backbone BATO-JACK
IP Backbones ATLA-HOUS
Start Time:Tuesday, February 10, 2015, 6:00 AM (0600) UTC
End Time:Tuesday, February 10, 2015, 12:00 PM (1200) UTC
Description: DWDM System BATO-JACK will be unavailable while Level(3) Communications preforms cable relocation maintenance in Baton Rouge, LA. An outage of up to 2 hours is expected; however the entire window is reserved.

Ticket No.:2337:144
Subject:Maintenance - I2 AL2S Various Backbone Configuration Changes
Affected:AL2S Backbone Management on the following routes will be updated:
CLEV - EQCH
EQCH - STAR
CHIC - STAR
CHIC - KANS
CHIC - COLU4
ASHB - CHIC
DALL - HOUH
DALL - TULS
Start Time:Tuesday, February 10, 2015, 6:00 AM (0600) UTC
End Time:Tuesday, February 10, 2015, 10:00 AM (1000) UTC
Description: Internet2 Network Engineering will be performing work to update in-band monitoring. No impact to production services is anticipated; however, the entire window is reserved. Workgroup administrators received notifications from OESS regarding circuits re-routed on the backbone

Ticket No.:2334:144
Subject:Maintenance - I2 AL2S Various Backbone Configuration Changes
Affected:AL2S Backbone Management on the following routes will be updated:
NEWY32AOA - PHIL
HART2 - NEWY32AOA
BOST - HART2
ALBA - BOST
ALBA - CLEV
Start Time:Wednesday, February 11, 2015, 5:00 AM (0500) UTC
End Time:Wednesday, February 11, 2015, 7:30 AM (0730) UTC
Description: Internet2 Network Engineering will be performing work to update in-band monitoring. No impact to production services is anticipated; however, the entire window is reserved. Workgroup administrators received notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:2313:144
Subject:Maintenance - I2 Optical Member ESNet
Affected:
Start Time:Thursday, February 12, 2015, 3:00 AM (0300) UTC
End Time:Thursday, February 12, 2015, 5:00 AM (0500) UTC
Description: Member ESNet's Optical circuit ESNET-ASHB-WASH-OTU3-09301 will be unavailable while Level3 Engineers perform maintenance. A brief outage is expected, however the entire maintenance window has been reserved.

Ticket No.:2336:144
Subject:Maintenance - I2 AL2S Various Backbone Configuration Changes
Affected:AL2S Backbone Management on the following routes will be updated:
ATLA - CHAR
ATLA - JACK
ATLA - JCSN
COLU4 - KANS
KANS - TULS
HOUH - JCSN
BATO - HOUH
JACK - BATO
Start Time:Thursday, February 12, 2015, 5:00 AM (0500) UTC
End Time:Thursday, February 12, 2015, 9:00 AM (0900) UTC
Description: Internet2 Network Engineering will be performing work to update in-band monitoring. No impact to production services is anticipated; however, the entire window is reserved. Workgroup administrators received notifications from OESS regarding circuits re-routed on the backbone

Ticket No.:2305:144
Subject:Maintenance - I2 AL2S Various Backbone Configuration Changes
Affected:AL2S Backbone Monitoring on the following routes:
PHOE-TUCS
ELPA-TUCS
DENV-ELPA
ELPA-HOUH
DENV-SALT
DENV-KANS
MINN-MISS2
EQCH-MINN
Start Time:Friday, February 13, 2015, 7:00 AM (0700) UTC
End Time:Friday, February 13, 2015, 11:00 AM (1100) UTC
Description: Internet2 Network Engineering will be updating configurations to support inband management. No impact to production services are anticipated, however the entire window is reserved. Workgroup administrators received notifications from OESS regarding circuits re-routed on the backbone

Ticket No.:2440:144
Subject:Maintenance - I2 Optical Member NOAA N-Wave
Affected:Optical Member NOAA N-Wave
Start Time:Friday, February 20, 2015, 5:00 AM (0500) UTC
End Time:Friday, February 20, 2015, 10:00 AM (1000) UTC
Description: Optical Member NOAA N-Wave will be unavailable while Zayo Engineers perform a fiber repair near Smithfield, PA. An outage of 3 hours is expected; however, the entire window has been reserved.

Ticket No.:2375:144
Subject:Maintenance 1 of 2 - I2 Optical DWDM System CINC-INDI
Affected:DWDM CINC-INDI
AL2S Backbone(s) ATLA-CHIC
IP Backbone(s) ATLA-CHIC
Start Time:Wednesday, February 25, 2015, 5:00 AM (0500) UTC
End Time:Wednesday, February 25, 2015, 11:00 AM (1100) UTC
Description: *This is maintenance window 1 of 2* DWDM System CINC-INDI will be unavailable while Level(3) Communications relocates and replaces backbone cable in Cincinnati, Ohio. An outage of 30 minutes is expected; however the entire window is reserved.

Ticket No.:2376:144
Subject:Maintenance 2 of 2 - I2 Optical DWDM System CINC-INDI
Affected:DWDM CINC-INDI
AL2S Backbone(s) ATLA-CHIC
IP Backbone(s) ATLA-CHIC
Start Time:Thursday, February 26, 2015, 5:00 AM (0500) UTC
End Time:Thursday, February 26, 2015, 11:00 AM (1100) UTC
Description: *This is maintenance window 2 of 2* DWDM System CINC-INDI will be unavailable while Level(3) Communications relocates and replaces backbone cable in Cincinnati, Ohio. An outage of 30 minutes is expected; however the entire window is reserved.

Ticket No.:2377:144
Subject:Maintenance Alternate Window - I2 Optical DWDM System CINC-INDI
Affected:DWDM CINC-INDI
AL2S Backbone(s) ATLA-CHIC
IP Backbone(s) ATLA-CHIC
Start Time:Friday, February 27, 2015, 5:00 AM (0500) UTC
End Time:Friday, February 27, 2015, 11:00 AM (1100) UTC
Description: *This is an alternative window* DWDM System CINC-INDI will be unavailable while Level(3) Communications relocates and replaces backbone cable in Cincinnati, Ohio. An outage of 30 minutes is expected; however the entire window is reserved.