Internet2 Advanced Layer 2 Service Network Operations Report
11/04/2013 - 11/10/2013

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Start Time (UTC) End Time (UTC)

9821-Critical 1-Critical Brief Outage Resolved - I2 AL2S Core Node RALE Software 11/04/2013 3:01 PM 11/04/2013 3:07 PM
9922-High 2-High Outage Resolved - I2 AL2S Backbone LOSA-SALT Hardware 11/06/2013 5:12 AM 11/06/2013 6:10 AM

Unscheduled Outages Detail


Ticket No.:982:135
Subject:Brief Outage Resolved - I2 AL2S Core Node RALE
Affected:Core Node RALE and its Connector(s) and Participants
Start Time:Monday, November 4, 2013, 3:01 PM (1501) UTC
End Time:Monday, November 4, 2013, 3:07 PM (1507) UTC
Description:Core Node RALE was briefly unavailable. Internet2 Engineers are indicated that outage was caused by a JunOS software bug on the Core Node in Raleigh, NC that caused a restart of the Routing Engine. No further outages are to be expected.

Ticket No.:992:135
Subject:Outage Resolved - I2 AL2S Backbone LOSA-SALT
Affected:Backbone LOSA-SALT
Start Time:Wednesday, November 6, 2013, 5:12 AM (0512) UTC
End Time:Wednesday, November 6, 2013, 6:10 AM (0610) UTC
Description:Backbone LOSA-SALT is now available. Level(3) Communications reports the outage was caused by an OCLD fault in Salt Lake City, UT. No further outages are expected. Backbone traffic should have re-routed.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Start Time (UTC) End Time (UTC)

976 3-Elevated 2-High Maintenance Completed - I2 AL2S Backbone ATLA-RALE Hardware 11/05/2013 5:02 AM 11/05/2013 6:43 AM
988 3-Elevated 2-High Emergency Maintenance Completed - I2 AL2S Backbone ATLA-RALE Circuit 11/06/2013 5:10 AM 11/06/2013 7:10 AM

Scheduled Maintenances Detail

Ticket No.:976:135
Subject:Maintenance Completed - I2 AL2S Backbone ATLA-RALE
Affected:Backbone ATLA-RALE
Start Time:Tuesday, November 5, 2013, 5:02 AM (0502) UTC
End Time:Tuesday, November 5, 2013, 6:43 AM (0643) UTC
Description: Backbone ATLA-RALE was unavailable while Internet2 Engineers performed maintenance to insert core node CHAR. The maintenance was unsuccessful due to faulty Optical Vendor hardware. The maintenance will be rescheduled at a future date.

Ticket No.:988:135
Subject:Emergency Maintenance Completed - I2 AL2S Backbone ATLA-RALE
Affected:Backbone ATLA-RALE
Start Time:Wednesday, November 6, 2013, 5:10 AM (0510) UTC
End Time:Wednesday, November 6, 2013, 7:10 AM (0710) UTC
Description: Backbone ATLA-RALE was unavailable while Internet2 Engineers processed maintenance to install a new core node in Charlotte, NC. The maintenance was unsuccessful due to faulty hardware. Maintenance will be rescheduled at a future date. Traffic should have re- routed during the maintenance.


Downtime and Availability



Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability
sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 100.00000% 100.00000
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.99772% 100.00000
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97495% 100.00000
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.99658% 100.00000
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97951% 100.00000
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97970% 100.00000
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97970% 100.00000
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98027% 100.00000
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97970% 100.00000
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97970% 100.00000
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97951% 100.00000
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97989% 100.00000
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98748% 100.00000
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98008% 100.00000
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.99962% 100.00000
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.99791% 100.00000
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 100.00000% 100.00000
sdn-sw.rale.net.internet2.edu 0 hr 6 min0 hr 6 min 99.94048%99.94048 99.69642% 99.73550
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97970% 100.00000
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.99374% 100.00000
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97894% 100.00000
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97970% 100.00000
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97970% 100.00000
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97913% 100.00000

Aggregate Internet2 Advanced Layer 2 Service Core Nodes0 hr 6 min0 hr 6 min99.99752%99.99752%99.97332%99.98898%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
I2-ASHB-PITT-100GE-07737 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99355%99.99412%
I2-ATLA-CHIC-100GE-07740 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.61426%99.69016%
I2-ATLA-HOUH-10GE-07742 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.36172%99.36722%
I2-ATLA-JACK-100GE-07739 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.36172%99.36722%
I2-ATLA-WASH-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99526%100.00000%
I2-CHIC-KANS-100GE-07745 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97230%100.00000%
I2-CHIC-STAR-100GE-07743 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89147%99.89375%
I2-CLEV-NEWY32AOA-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.57366%99.60819%
I2-CLEV-PITT-100GE-10334 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%100.00000%
I2-CLEV-STAR-100GE-07736 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95276%99.99658%
I2-DENV-KANS-100GE-07746 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85428%99.90930%
I2-DENV-SALT-100GE-07747 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96129%100.00000%
I2-ELPA-HOUH-100GE-07749 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.27083%99.38012%
I2-ELPA-LOSA-100GE-07750 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.88350%99.88369%
I2-HOUH-TULS-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76529%99.79356%
I2-KANS-TULS-100GE-07753 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91462%99.91519%
I2-LOSA-SALT-100GE-07757 0 hr 58 min0 hr 58 min 99.42460%99.42460% 99.98311%99.98862%
I2-LOSA-SUNN-100GE-07755 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89545%99.89716%
I2-NEWY23AOA-WASH-100GE-07759 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99298%99.99336%
I2-PORT-SEAT-100GE-08997 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-PORT-SUNN-100GE-10343 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%100.00000%
I2-SALT-SUNN-100GE-07766 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89792%99.91158%

Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits 0 hr 58 min0 hr 0 min 99.97385%99.97385% 99.82429%99.84499%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:980:135
Subject:Maintenance - I2 AL2S Backbone CLEV-PITT
Affected:Backbone CLEV-PITT
Start Time:Thursday, November 14, 2013, 5:00 AM (0500) UTC
End Time:Thursday, November 14, 2013, 11:00 AM (1100) UTC
Description: Backbone CLEV-PITT will be unavailable while Level(3) Communications perform scheduled maintenance to relocate cable as mandated by the Penn DOT and Norfolk Southern Railroad due to a road construction and a bridge demolition project between the boroughs of New Brighton and Fallston, Pennsylvania. An outage up to 2 hours is expected; however the entire window is reserved. Backbone traffic will re-route during this maintenance. This is the primary maintenance window. An alternate window is scheduled for 19-Nov-2013 05:00:00 UTC to 19-Nov-2013 11:00:00 UTC to be used if needed.

Ticket No.:981:135
Subject:Maintenance - I2 AL2S Backbone CLEV-PITT Alternate Window
Affected:Backbone CLEV-PITT
Start Time:Tuesday, November 19, 2013, 5:00 AM (0500) UTC
End Time:Tuesday, November 19, 2013, 11:00 AM (1100) UTC
Description: Backbone CLEV-PITT will be unavailable while Level(3) Communications perform scheduled maintenance to relocate cable as mandated by the Penn DOT and Norfolk Southern Railroad due to a road construction and a bridge demolition project between the boroughs of New Brighton and Fallston, Pennsylvania. An outage up to 2 hours is expected; however the entire window is reserved. Backbone traffic will re-route during this maintenance. This is the alternate window for ticket 980:135, should it be required.