Internet2 Advanced Layer 2 Service Network Operations Report
08/11/2014 - 08/17/2014

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Network Resources

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

20842-High 2-High Brief Outage Resolved - I2 AL2S Backbone ATLA-JCSN Human ErrorVendor 08/14/2014 8:17 AM 08/14/2014 8:18 AM
20892-High 2-High Instability Resolved - I2 AL2S Backbone CHIC-COLU4 & CHIC-KANS HardwareVendor 08/17/2014 4:11 PM 08/17/2014 10:02 PM

Unscheduled Outages Detail


Ticket No.:2084:135
Subject:Brief Outage Resolved - I2 AL2S Backbone ATLA-JCSN
Source Of Impact:Vendor
Affected:Backbone ATLA-JCSN
Start Time:Thursday, August 14, 2014, 8:17 AM (0817) UTC
End Time:Thursday, August 14, 2014, 8:18 AM (0818) UTC
Description:Backbone ATLA-JCSN was briefly unavailable. Zayo technicians have indicated that the outage was due to a fiber splice case repair operation on an adjacent non-Internet2 circuit. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:2089:135
Subject:Instability Resolved - I2 AL2S Backbone CHIC-COLU4 & CHIC-KANS
Source Of Impact:Vendor
Affected:Backbone CHIC-COLU4
Backbone CHIC-KANS
Start Time:Sunday, August 17, 2014, 4:11 PM (1611) UTC
End Time:Sunday, August 17, 2014, 10:02 PM (2202) UTC
Description:The above backbones are now stable. Internet2's Fiber Provider Engineers report the reason for instability was due to card failure. The card has been replaced, and alarms have cleared. No further outages are expected. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

2085 3-Elevated 2-High Emergency Maintenance Completed - I2 AL2S Backbone ATLA-JACK Hardware Internal08/14/2014 6:07 PM 08/14/2014 6:18 PM
2068 3-Elevated 2-High Maintenance Completed - I2 AL2S Backbone PORT-SEAT HardwareVendor 08/15/2014 7:02 AM 08/15/2014 7:13 AM

Scheduled Maintenances Detail

Ticket No.:2085:135
Subject:Emergency Maintenance Completed - I2 AL2S Backbone ATLA-JACK
Source Of Impact:Internal
Affected:Backbone ATLA-JACK
Start Time:Thursday, August 14, 2014, 6:07 PM (1807) UTC
End Time:Thursday, August 14, 2014, 6:18 PM (1818) UTC
Description: Backbone ATLA-JACK was unavailable while Level 3 Engineers, working with I2 Engineers, performed hardware replacement maintenance, which is completed. Backbone traffic re-routed during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re- routed on the backbone.

Ticket No.:2068:135
Subject:Maintenance Completed - I2 AL2S Backbone PORT-SEAT
Source Of Impact:Vendor
Affected:Backbone PORT-SEAT
Start Time:Friday, August 15, 2014, 7:02 AM (0702) UTC
End Time:Friday, August 15, 2014, 7:13 AM (0713) UTC
Description: Backbone PORT-SEAT was briefly unavailable while Level 3 Communications performed hardware maintenance. Backbone traffic re-routed during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.


Downtime and Availability



Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability
sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905% 100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905% 100.00000%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943% 100.00000%
sdn-sw.bato.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905% 100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99772% 100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96471% 99.98975%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943% 100.00000%
sdn-sw.colu4.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924% 100.00000%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85864% 99.85902%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943% 100.00000%
sdn-sw.eqch.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92828% 99.92885%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96319% 100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98425% 99.98520%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886% 99.99943%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943% 100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98596% 100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962% 100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924% 100.00000%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924% 100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962% 100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924% 100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99810% 99.99886%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905% 100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905% 100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867% 100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943% 100.00000%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98444% 100.00000%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95105% 99.98387%

Aggregate Internet2 Advanced Layer 2 Service Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.98758%99.99203%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
I2-ALBA-BOST-100GE-09210 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98634%100.00000%
I2-ALBA-CLEV-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97932%99.99981%
I2-ASHB-CHIC-100GE-11803 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81026%99.90190%
I2-ASHB-PITT-100GE-07737 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.77117%99.88065%
I2-ASHB-WASH-100GE-09106 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86092%99.98368%
I2-ASHB-WASH-100GE-11823 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86092%99.98311%
I2-ATLA-CHAR-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96812%99.97932%
I2-ATLA-CHIC-100GE-07740 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.52546%99.71577%
I2-ATLA-HOUH-10GE-07742 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-JACK-100GE-07739 0 hr 11 min0 hr 0 min 99.89087%100.00000% 99.95389%99.99981%
I2-ATLA-JCSN-100GE-10734 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.44786%99.50307%
I2-ATLA-WASH-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-BATO-HOUH-100GE-08860 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90361%99.92847%
I2-BATO-JACK-100GE-11005 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.62394%99.73209%
I2-BOST-NEWY32AOA-100GE-09211 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98160%100.00000%
I2-CHAR-RALE-100GE-10633 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96774%99.97970%
I2-CHIC-COLU4-100GE-11554 5 hr 51 min5 hr 51 min 96.51786%96.51786% 99.87743%99.91196%
I2-CHIC-KANS-100GE-07745 5 hr 51 min5 hr 51 min 96.51786%96.51786% 99.66245%99.84347%
I2-CHIC-STAR-100GE-07743 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.67384%99.78597%
I2-CLEV-EQCH-100GE-07736 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91196%99.91196%
I2-CLEV-NEWY32AOA-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962%100.00000%
I2-CLEV-PITT-100GE-10334 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90323%100.00000%
I2-CLEV-STAR-100GE-07736 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86737%99.98596%
I2-COLU4-KANS-100GE-11548 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96566%99.98235%
I2-DALL-HOUH-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.82980%99.87325%
I2-DALL-TULS-100GE-11300 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.82886%99.84460%
I2-DENV-ELPA-100GE-07748 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97875%99.99260%
I2-DENV-KANS-100GE-07746 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76947%99.83758%
I2-DENV-SALT-100GE-07747 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.83132%99.86775%
I2-ELPA-HOUH-100GE-07749 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.52470%99.58485%
I2-ELPA-PHOE-100GE-07750 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89507%99.91595%
I2-ELPA-TUCS-100GE-07750 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-EQCH-STAR-100GE-09299 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96300%99.97439%
I2-EQCH-MINN-100GE-12184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99753%100.00000%
I2-HOUH-JCSN-100GE-10783 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91177%99.91405%
I2-HOUH-TULS-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.68940%99.75068%
I2-KANS-TULS-100GE-07753 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89413%99.99981%
I2-LOSA-PHOE-100GE-09190 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76055%99.80874%
I2-LOSA-SALT-100GE-07757 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.88730%99.93226%
I2-LOSA-SUNN-100GE-07755 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99374%99.99962%
I2-MINN-SEAT-100GE-09130 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.22738%99.45488%
I2-NEWY23AOA-PHIL-100GE-07759 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99431%99.99981%
I2-PHIL-WASH-100GE-10867 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84081%99.98349%
I2-PORT-SEAT-100GE-08997 0 hr 11 min0 hr 0 min 99.89087%100.00000% 99.98691%100.00000%
I2-PORT-SUNN-100GE-10343 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98273%99.99810%
I2-RALE-WASH-100GE-08888 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74025%99.81197%
I2-SALT-SUNN-100GE-07766 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97780%99.99545%

Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits 12 hr 5 min0 hr 22 min 99.85016%99.85470% 99.85434%99.90727%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:2080:135
Subject:Maintenance 1 of 2 - I2 AL2S Backbones ATLA-CHIC and ATLA-JCSN
Affected:Backbone ATLA-CHIC
Backbone ATLA-JCSN
Start Time:Tuesday, August 19, 2014, 4:00 AM (0400) UTC
End Time:Tuesday, August 19, 2014, 10:00 AM (1000) UTC
Description: The above listed will be unavailable while Level(3) Communications perform maintenance. Outages are expected throughout the maintenance window. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. This is window 1 of a 2 night maintenance.

Ticket No.:2088:135
Subject:Maintenance - I2 AL2S Participant MREN
Affected:Participant MREN
Start Time:Wednesday, August 20, 2014, 3:00 AM (0300) UTC
End Time:Wednesday, August 20, 2014, 3:30 AM (0330) UTC
Description: Participant MREN will be unavailable while MREN Engineers perform maintenance. A brief outage is expected; the entire window is reserved.

Ticket No.:2081:135
Subject:Maintenance 2 of 2 - I2 AL2S Backbones ATLA-CHIC and ATLA-JCSN
Affected:Backbone ATLA-CHIC
Backbone ATLA-JCSN
Start Time:Wednesday, August 20, 2014, 4:00 AM (0400) UTC
End Time:Wednesday, August 20, 2014, 10:00 AM (1000) UTC
Description: The above listed will be unavailable while Level(3) Communications perform maintenance. Outages are expected throughout the maintenance window. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. This is window 2 of a 2 night maintenance.

Ticket No.:2079:135
Subject:Maintenance - I2 AL2S Backbone MINN-SEAT
Affected:Backbone MINN-SEAT
Start Time:Saturday, August 23, 2014, 1:00 PM (1300) UTC
End Time:Saturday, August 23, 2014, 11:00 PM (2300) UTC
Description: Backbone MINN-SEAT will be unavailable while Zayo Engineers perform maintenance. An outage is expected, and the entire maintenance window has been reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:2077:135
Subject:Maintenance 1 of 2 - I2 AL2S Backbone MINN-SEAT
Affected:Backbone MINN-SEAT
Start Time:Wednesday, August 27, 2014, 5:00 AM (0500) UTC
End Time:Wednesday, August 27, 2014, 10:00 AM (1000) UTC
Description: Backbone MINN-SEAT will be unavailable while Zayo Engineers perform maintenance. An outage is expected, and the entire maintenance window has been reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. *This is the 1st of 2 maintenance windows *

Ticket No.:2052:135
Subject:Maintenance 1 of 2 - I2 AL2S Various Backbones
Affected:Backbone ASHB-CHIC
Backbone CHIC-CLEV
Backbone CLEV-EQCH
Start Time:Thursday, August 28, 2014, 4:00 AM (0400) UTC
End Time:Thursday, August 28, 2014, 10:00 AM (1000) UTC
Description: Tha above listed backbones will be unavailable while Internet2's Fiber Provider Engineers perform maintenance. An outage of 2 hours is expected; however, the entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.An alternate window has been reserved for date/time, should it be required.

Ticket No.:2078:135
Subject:Maintenance 2 of 2 - I2 AL2S Backbone MINN-SEAT
Affected:Backbone MINN-SEAT
Start Time:Thursday, August 28, 2014, 5:00 AM (0500) UTC
End Time:Thursday, August 28, 2014, 10:00 AM (1000) UTC
Description: Backbone MINN-SEAT will be unavailable while Zayo Engineers perform maintenance. An outage is expected, and the entire maintenance window has been reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. *This is the 2nd of 2 maintenance windows *

Ticket No.:2053:135
Subject:Maintenance 2 of 2 - I2 AL2S Various Backbones
Affected:Backbone ASHB-CHIC
Backbone CHIC-CLEV
Backbone CLEV-EQCH
Start Time:Friday, August 29, 2014, 4:00 AM (0400) UTC
End Time:Friday, August 29, 2014, 10:00 AM (1000) UTC
Description: Tha above listed backbones will be unavailable while Internet2's Fiber Provider Engineers perform maintenance. An outage of 2 hours is expected; however, the entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. This is an alternate window for ticket 2052:135, should it be required.