Internet2 Advanced Layer 2 Service Network Operations Report
02/03/2014 - 02/09/2014

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

ConnectorTypeDateSponsor
FLR (BATO)Participant2/6/2014
MARIA (ASHB)Participant2/6/2014
NOAA (DENV)Participant2/6/2014
NOAA (WASH)Participant2/6/2014
UEN (SALT) Participant2/6/2014
LEARN (DALL)Participant2/7/2014


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Start Time (UTC) End Time (UTC)

13161-Critical 1-Critical Outage Resolved - I2 AL2S Core Node HOUH Undetermined 02/05/2014 1:59 PM 02/05/2014 8:14 PM
13172-High 2-High Instability Resolved - I2 AL2S Backbone MINN-SEAT Circuit - Other 02/05/2014 2:16 PM 02/05/2014 3:31 PM
13232-High 2-High Brief Outage - I2 AL2S Backbone ELPA-HOUH Hardware 02/06/2014 12:09 PM 02/06/2014 12:10 PM

Unscheduled Outages Detail


Ticket No.:1316:135
Subject:Outage Resolved - I2 AL2S Core Node HOUH
Affected:Core Node HOUH
Start Time:Wednesday, February 5, 2014, 1:59 PM (1359) UTC
End Time:Wednesday, February 5, 2014, 8:14 PM (2014) UTC
Description:I2 AL2S Code Node Houston (HOUH) experienced a hardware switch fabric issue. The I2 engineering team escalated to work directly with the Tier 3 support group with Brocade TAC. Brocade TAC and I2 Engineering triaged the conditions which resulted in a reboot of the node to clear forwarding inconsistencies. Backbone links traversing Houston have been enabled and all traffic is forwarding. Traffic was re-routed during the event.

Ticket No.:1317:135
Subject:Instability Resolved - I2 AL2S Backbone MINN-SEAT
Affected:Backbone MINN-SEAT
Start Time:Wednesday, February 5, 2014, 2:16 PM (1416) UTC
End Time:Wednesday, February 5, 2014, 3:31 PM (1531) UTC
Description:Backbone MINN-SEAT is stable. Vendor Zayo engineers reseated and replaced a card which was in error after a maintenance (1310:135). No further outages are expected. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1323:135
Subject:Brief Outage - I2 AL2S Backbone ELPA-HOUH
Affected:Backbone ELPA-HOUH
Start Time:Thursday, February 6, 2014, 12:09 PM (1209) UTC
End Time:Thursday, February 6, 2014, 12:10 PM (1210) UTC
Description:Backbone ELPA-HOUH was briefly unavailable. Internet2's fiber provider advised that this was caused by a Layer1 hardware issue. Workgroup administrators received notifications from OESS regarding circuits briefly re-routed on the backbone.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Start Time (UTC) End Time (UTC)

1310 3-Elevated 2-High Maintenance 1 of 2 Completed - I2 AL2S Backbone MINN-SEAT Circuit 02/05/2014 7:58 AM 02/05/2014 7:59 AM
02/05/2014 8:11 AM 02/05/2014 8:13 AM
1241 3-Elevated 2-High Maintenance Completed - I2 AL2S Backbone ELPA-HOUH Circuit 02/06/2014 11:38 AM 02/06/2014 11:58 AM
1246 3-Elevated 2-High Maintenance Completed - I2 AL2S Backbone BATO-JACK Circuit 02/08/2014 6:07 AM 02/08/2014 6:59 AM

Scheduled Maintenances Detail

Ticket No.:1310:135
Subject:Maintenance 1 of 2 Completed - I2 AL2S Backbone MINN-SEAT
Affected:Backbone MINN-SEAT
Start Time:Wednesday, February 5, 2014, 7:58 AM (0758) UTC
End Time:Wednesday, February 5, 2014, 7:59 AM (0759) UTC
Start Time:Wednesday, February 5, 2014, 8:11 AM (0811) UTC
End Time:Wednesday, February 5, 2014, 8:13 AM (0813) UTC
Description: Backbone MINN-SEAT was unavailable while Zayo Engineers performed maintenance. Outages are expected throughout the entire maintenance window. Workgroup administrators received notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1241:135
Subject:Maintenance Completed - I2 AL2S Backbone ELPA-HOUH
Affected:Backbone ELPA-HOUH
Start Time:Thursday, February 6, 2014, 11:38 AM (1138) UTC
End Time:Thursday, February 6, 2014, 11:58 AM (1158) UTC
Description: Backbone ELPA-HOUH was unavailable while vendor Engineers performed maintenance. Maintenance has been completed. Backbone traffic re-routed during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1246:135
Subject:Maintenance Completed - I2 AL2S Backbone BATO-JACK
Affected:Backbone BATO-JACK
Start Time:Saturday, February 8, 2014, 6:07 AM (0607) UTC
End Time:Saturday, February 8, 2014, 6:59 AM (0659) UTC
Description: Backbone BATO-JACK was unavailable while vendor Engineers performed maintenance. Backbone traffic re-routed during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. Maintenance has been completed.


Downtime and Availability



Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability
sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99772% 100.00000%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97514% 100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99658% 100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95617% 100.00000%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98008% 100.00000%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84612% 99.86604%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98084% 100.00000%
sdn-sw.houh.net.internet2.edu 6 hr 15 min6 hr 15 min 96.27976%96.27976% 99.90893% 99.92885%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97970% 100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98520% 99.98520%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98008% 100.00000%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98027% 100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98653% 100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98046% 100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99791% 100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962% 100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.69642% 99.73550%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98008% 100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99374% 100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97932% 100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98008% 100.00000%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98008% 100.00000%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97951% 100.00000%

Aggregate Internet2 Advanced Layer 2 Service Core Nodes6 hr 15 min6 hr 15 min99.86713%99.86713%99.96859%99.98270%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
I2-ASHB-PITT-100GE-07737 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89811%99.89868%
I2-ATLA-CHAR-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97970%99.97970%
I2-ATLA-CHIC-100GE-07740 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.55734%99.67023%
I2-ATLA-HOUH-10GE-07742 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96148%99.96148%
I2-ATLA-JACK-100GE-07739 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99412%100.00000%
I2-ATLA-JCSN-100GE-10734 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-WASH-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-BATO-HOUH-100GE-08860 6 hr 15 min6 hr 15 min 96.27976%96.27976% 99.92847%99.92847%
I2-BATO-JACK-100GE-11005 0 hr 52 min0 hr 0 min 99.48413%100.00000% 99.98994%99.99981%
I2-CHAR-RALE-100GE-10633 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97970%99.97970%
I2-CHIC-KANS-100GE-07745 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95200%99.97970%
I2-CHIC-STAR-100GE-07743 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75581%99.77004%
I2-CLEV-NEWY32AOA-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.57366%99.60819%
I2-CLEV-PITT-100GE-10334 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99336%100.00000%
I2-CLEV-STAR-100GE-07736 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94991%99.98368%
I2-DALL-HOUH-100GE-07751 6 hr 15 min6 hr 15 min 96.27976%96.27976% 99.92885%99.92885%
I2-DALL-TULS-100GE-11300 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-DENV-KANS-100GE-07746 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84403%99.88881%
I2-DENV-SALT-100GE-07747 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93321%99.97932%
I2-ELPA-HOUH-100GE-07749 0 hr 21 min0 hr 1 min 99.79167%99.99008% 99.36912%99.48125%
I2-ELPA-LOSA-100GE-07750 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981%100.00000%
I2-HOUH-JCSN-100GE-10783 6 hr 15 min6 hr 15 min 96.27976%96.27976% 99.91405%99.91405%
I2-HOUH-TULS-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.65619%99.74461%
I2-KANS-TULS-100GE-07753 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91462%99.91519%
I2-LOSA-SALT-100GE-07757 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92638%99.93188%
I2-LOSA-SUNN-100GE-07755 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89716%99.89830%
I2-NEWY23AOA-PHIL-100GE-07759 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-PHIL-WASH-100GE-10867 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89451%100.00000%
I2-PORT-SEAT-100GE-08997 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-PORT-SUNN-100GE-10343 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%99.99962%
I2-SALT-SUNN-100GE-07766 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94725%99.96850%

Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits 19 hr 58 min1 hr 12 min 99.61662%99.63966% 99.89477%99.91645%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:1236:135
Subject:Maintenance 1 of 2 - I2 AL2S Backbone LOSA-SALT
Affected:Backbone LOSA-SALT
Start Time:Tuesday, February 25, 2014, 8:00 AM (0800) UTC
End Time:Tuesday, February 25, 2014, 2:00 PM (1400) UTC
Description: Backbone LOSA-SALT will be unavailable while Level(3) Communications performs fiber maintenance in San Gabriel, CA as mandated by the California Department of Transportation. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re- routed on the backbone. An alternate window has been reserved for 2/28/14 at 0800-1400, should it be required.

Ticket No.:1239:135
Subject:Maintenance 2 of 2 - I2 AL2S Backbone LOSA-SALT
Affected:Backbone LOSA-SALT
Start Time:Friday, February 28, 2014, 8:00 AM (0800) UTC
End Time:Friday, February 28, 2014, 2:00 PM (1400) UTC
Description: Backbone LOSA-SALT will be unavailable while Level(3) Communications performs fiber maintenance in San Gabriel, CA as mandated by the California Department of Transportation. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. This is an alternate window for ticket 1236:135, should it be required.