Internet2 Advanced Layer 2 Service Network Operations Report
03/11/2013 - 03/17/2013

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Start Time (UTC) End Time (UTC)

2532-High 2-High Internet2 Advanced Layer 2 Services Backbone Circuit CLEV-NEWY Brief Outage Resolved Undetermined 03/12/2013 12:19 AM 03/12/2013 12:20 AM
2553-Elevated 2-High Internet2 Advanced Layer 2 Services Backbone Circuit HOUH-JACK Outage Resolved Unannounced Maintenance 03/12/2013 4:54 AM 03/12/2013 6:00 AM
2562-High 2-High Internet2 Advanced Layer 2 Services Backbone Circuit CLEV-NEWY Brief Outage Resolved Undetermined 03/13/2013 12:49 AM 03/13/2013 12:50 AM
2572-High 2-High Internet2 Advanced Layer 2 Services Backbone Circuit CLEV-NEWY Brief Outage Resolved Undetermined 03/14/2013 1:38 AM 03/14/2013 1:39 AM
2582-High 2-High Internet2 Advanced Layer 2 Services Backbone Circuit CLEV-NEWY Brief Outage Resolved Undetermined 03/15/2013 1:50 AM 03/15/2013 1:51 AM
2612-High 2-High Internet2 Advanced Layer 2 Services Backbone Circuit CLEV-NEWY Brief Outage Resolved Undetermined 03/17/2013 1:42 AM 03/17/2013 1:43 AM

Unscheduled Outages Detail


Ticket No.:253:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit CLEV-NEWY Brief Outage Resolved
Affected:Backbone Circuit CLEV-NEWY
Start Time:Tuesday, March 12, 2013, 12:19 AM (0019) UTC
End Time:Tuesday, March 12, 2013, 12:20 AM (0020) UTC
Description:Backbone Circuit CLEV-NEWY was briefly unavailable. Level(3) Engineers determined that the outage was caused by a software bug. Backbone traffic re-routed.

Ticket No.:255:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit HOUH-JACK Outage Resolved
Affected:Backbone Circuit HOUH-JACK
Start Time:Tuesday, March 12, 2013, 4:54 AM (0454) UTC
End Time:Tuesday, March 12, 2013, 6:00 AM (0600) UTC
Description:Backbone Circuit HOUH-JACK was unavailable while Level(3) Communications performed unannounced fiber relocation maintenance in New Orleans, LA as mandated by the City Public Works Department.

Ticket No.:256:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit CLEV-NEWY Brief Outage Resolved
Affected:Backbone Circuit CLEV-NEWY
Start Time:Wednesday, March 13, 2013, 12:49 AM (0049) UTC
End Time:Wednesday, March 13, 2013, 12:50 AM (0050) UTC
Description:Backbone Circuit CLEV-NEWY was briefly unavailable. Level(3) Engineers confirmed that this outage was caused by a software bug. Backbone traffic re-routed.

Ticket No.:257:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit CLEV-NEWY Brief Outage Resolved
Affected:Backbone Circuit CLEV-NEWY
Start Time:Thursday, March 14, 2013, 1:38 AM (0138) UTC
End Time:Thursday, March 14, 2013, 1:39 AM (0139) UTC
Description:Backbone Circuit CLEV-NEWY was briefly unavailable. Internet2 Engineers are investigating the cause; however, the reason for the outage is due to a known bug on the Brocade. Backbone traffic re-routed during the brief outage.

Ticket No.:258:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit CLEV-NEWY Brief Outage Resolved
Affected:Backbone Circuit CLEV-NEWY
Start Time:Friday, March 15, 2013, 1:50 AM (0150) UTC
End Time:Friday, March 15, 2013, 1:51 AM (0151) UTC
Description:Backbone Circuit CLEV-NEWY was briefly unavailable. Internet2's vendor has investigated and the reason for the outage is due to a software bug. Backbone traffic re-routed during the brief outage.

Ticket No.:261:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit CLEV-NEWY Brief Outage Resolved
Affected:Backbone Circuit CLEV-NEWY
Start Time:Sunday, March 17, 2013, 1:42 AM (0142) UTC
End Time:Sunday, March 17, 2013, 1:43 AM (0143) UTC
Description:Backbone Circuit CLEV-NEWY was briefly unavailable. Level(3) Engineers have confirmed that the outage was caused by a software bug. Backbone traffic re-routed.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Start Time (UTC) End Time (UTC)

240 3-Elevated 2-High Internet2 Advanced Layer 2 Services Backbone Circuit HOUH-JACK Maintenance Complete Circuit 03/12/2013 6:00 AM 03/12/2013 7:03 AM
254 3-Elevated 1-Critical Internet2 Advanced Layer 2 Services Core Node RALE Maintenance Completed Software 03/15/2013 3:31 AM 03/15/2013 3:35 AM

Scheduled Maintenances Detail

Ticket No.:240:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit HOUH-JACK Maintenance Complete
Affected:Backbone Circuit HOUH-JACK
Start Time:Tuesday, March 12, 2013, 6:00 AM (0600) UTC
End Time:Tuesday, March 12, 2013, 7:03 AM (0703) UTC
Description: Backbone Circuit HOUH-JACK was unavailable while Level(3) Communications performed fiber relocation maintenance in New Orleans, LA as mandated by the City Public Works Department. The maintenance has been completed.

Ticket No.:254:135
Subject:Internet2 Advanced Layer 2 Services Core Node RALE Maintenance Completed
Affected:Core Node RALE and its Connector(s) and Participants
Start Time:Friday, March 15, 2013, 3:31 AM (0331) UTC
End Time:Friday, March 15, 2013, 3:35 AM (0335) UTC
Description: Core Node RALE was unavailable while Internet2 Engineers performed software maintenance. Maintenance has been completed.


Downtime and Availability



Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability
sdn-sw.atla.net.internet2.edu0 hr 0 min100.00000%99.99146%
sdn-sw.chic.net.internet2.edu0 hr 0 min100.00000%99.99108%
sdn-sw.clev.net.internet2.edu0 hr 0 min100.00000%99.99108%
sdn-sw.denv.net.internet2.edu0 hr 0 min100.00000%99.99165%
sdn-sw.elpa.net.internet2.edu0 hr 0 min100.00000%99.99127%
sdn-sw.houh.net.internet2.edu0 hr 0 min100.00000%99.99146%
sdn-sw.jack.net.internet2.edu0 hr 0 min100.00000%99.99260%
sdn-sw.kans.net.internet2.edu0 hr 0 min100.00000%99.99127%
sdn-sw.losa.net.internet2.edu0 hr 0 min100.00000%99.99146%
sdn-sw.newy32aoa.net.internet2.edu0 hr 0 min100.00000%99.99146%
sdn-sw.rale.net.internet2.edu0 hr 4 min99.96032%99.98084%
sdn-sw.salt.net.internet2.edu0 hr 0 min100.00000%99.99146%
sdn-sw.star.net.internet2.edu0 hr 0 min100.00000%99.99127%
sdn-sw.sunn.net.internet2.edu0 hr 0 min100.00000%99.99108%
sdn-sw.tuls.net.internet2.edu0 hr 0 min100.00000%99.99013%
sdn-sw.wash.net.internet2.edu0 hr 0 min100.00000%99.99127%

Aggregate Internet2 Advanced Layer 2 Service Core Nodes0 hr 4 min99.99752%99.99068%

Internet2 Advanced Layer 2 Service Backbone CircuitsDown TimeReporting Period Availability52 Week Availability
I2-ATLA-CHIC-100GE-077400 hr 0 min100.00000%99.74898%
I2-ATLA-HOUH-10GE-077420 hr 0 min100.00000%99.36058%
I2-ATLA-JACK-100GE-077390 hr 0 min100.00000%99.36058%
I2-ATLA-WASH-100GE-077380 hr 0 min100.00000%99.91329%
I2-CHIC-KANS-100GE-077450 hr 0 min100.00000%99.99943%
I2-CHIC-STAR-100GE-077430 hr 0 min100.00000%99.99374%
I2-CLEV-NEWY32AOA-100GE-077350 hr 5 min99.95040%99.90494%
I2-CLEV-STAR-100GE-077360 hr 0 min100.00000%99.98634%
I2-CLEV-WASH-100GE-077370 hr 0 min100.00000%99.99924%
I2-DENV-KANS-100GE-077460 hr 0 min100.00000%99.95332%
I2-DENV-SALT-100GE-077470 hr 0 min100.00000%99.99070%
I2-ELPA-HOUH-100GE-077490 hr 0 min100.00000%99.70211%
I2-ELPA-LOSA-100GE-077500 hr 0 min100.00000%99.87762%
I2-HOUH-TULS-100GE-077510 hr 0 min100.00000%99.77554%
I2-KANS-TULS-100GE-077530 hr 0 min100.00000%100.00000%
I2-LOSA-SALT-100GE-077570 hr 0 min100.00000%99.99962%
I2-LOSA-SUNN-100GE-077550 hr 0 min100.00000%99.99829%
I2-NEWY23AOA-WASH-100GE-077590 hr 0 min100.00000%99.98197%
I2-SALT-SUNN-100GE-077660 hr 0 min100.00000%99.94232%

Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits0 hr 5 min99.99739%99.86782%




Upcoming Scheduled Maintenances