Internet2 Advanced Layer 2 Service Network Operations Report
08/12/2013 - 08/18/2013

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Start Time (UTC) End Time (UTC)

6752-High 2-High Internet2 Advanced Layer 2 Services Backbone Circuit DENV-KANS Outage Resolved Circuit - Damaged Fiber 08/14/2013 1:08 PM 08/14/2013 9:04 PM
6782-High 2-High Internet2 Advanced Layer 2 Services Backbone Circuit ELPA-HOUH Outage Resolved Circuit - Damaged Fiber 08/15/2013 1:52 PM 08/16/2013 6:50 AM
6982-High 2-High Internet2 Advanced Layer 2 Services Backbone Circuit RALE-WASH Outage Resolved Hardware 08/18/2013 7:00 PM 08/18/2013 8:18 PM

Unscheduled Outages Detail


Ticket No.:675:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit DENV-KANS Outage Resolved
Affected:Backbone Circuit DENV-KANS
Start Time:Wednesday, August 14, 2013, 1:08 PM (1308) UTC
End Time:Wednesday, August 14, 2013, 9:04 PM (2104) UTC
Description:Backbone Circuit DENV-KANS is now stable. Level (3) Communications has indicated that the instability was caused by contractor work 4 miles from the Denver POP. The Field Crew has determined the fiber was too badly damaged to straighten and moved forward with a plan to cut the fiber completely, then re-splice each buffer tube individually. Splicing has been completed and no further outages are expected.

Ticket No.:678:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit ELPA-HOUH Outage Resolved
Affected:Backbone Circuit ELPA-HOUH
Start Time:Thursday, August 15, 2013, 1:52 PM (1352) UTC
End Time:Friday, August 16, 2013, 6:50 AM (0650) UTC
Description:Backbone Circuit ELPA-HOUH is now available to the community. Level(3) Communications technicians reported a fiber cut between Comstock, TX and Del Rio, TX. Crews arrived onsite determined the damage was due to drilling being done at the site by workers who were installing a billboard. The splice crew has completed repairs and no further outages are expected.

Ticket No.:698:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit RALE-WASH Outage Resolved
Affected:Backbone Circuit RALE-WASH
Start Time:Sunday, August 18, 2013, 7:00 PM (1900) UTC
End Time:Sunday, August 18, 2013, 8:18 PM (2018) UTC
Description:Backbone Circuit RALE-WASH is now available. Internet2 Engineering encountered problems while performing hardware maintenance (692:135). No further outages are to be expected. Backbone traffic was re-routed during the outage.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Start Time (UTC) End Time (UTC)

684 3-Elevated 2-High Internet2 Advanced Layer 2 Services Backbone Circuit ELPA-HOUH Emergency Maintenance Window 1 of 2 Completed Circuit 08/17/2013 7:35 PM 08/17/2013 7:37 PM
692 3-Elevated 2-High Internet2 Advanced Layer 2 Services Backbone Circuit RALE-WASH Emergency Maintenance Completed Circuit 08/18/2013 4:32 PM 08/18/2013 7:00 PM

Scheduled Maintenances Detail

Ticket No.:684:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit ELPA-HOUH Emergency Maintenance Window 1 of 2 Completed
Affected:Backbone Circuit ELPA-HOUH
Start Time:Saturday, August 17, 2013, 7:35 PM (1935) UTC
End Time:Saturday, August 17, 2013, 7:37 PM (1937) UTC
Description: Backbone Circuit ELPA-HOUH was unavailable while Internet2 Engineering with the assistance of Level(3) communications technicians performed maintenance. Maintenance has been completed. A second window has been scheduled to complete the other side of this maintenance.

Ticket No.:692:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit RALE-WASH Emergency Maintenance Completed
Affected:Backbone Circuit RALE-WASH
Start Time:Sunday, August 18, 2013, 4:32 PM (1632) UTC
End Time:Sunday, August 18, 2013, 7:00 PM (1900) UTC
Description: Internet2 Engineering attempted to perform a hardware replacement in McLean, VA. The maintenance was successful and the maintenance window has expired. Problem is now being tracked in outage ticket 698:135.


Downtime and Availability



Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97457% 100.00000
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97894% 100.00000
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97913% 100.00000
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97951% 100.00000
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98008% 100.00000
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97951% 100.00000
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.98027% 100.00000
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97932% 100.00000
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97970% 100.00000
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97970% 100.00000
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.69756% 99.73664
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97951% 100.00000
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97932% 100.00000
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97913% 100.00000
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97818% 100.00000
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000 99.97932% 100.00000

Aggregate Internet2 Advanced Layer 2 Service Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.96148%99.98354%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
I2-ATLA-CHIC-100GE-07740 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.51730%99.59244%
I2-ATLA-HOUH-10GE-07742 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.36058%99.36608%
I2-ATLA-JACK-100GE-07739 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.36058%99.36608%
I2-ATLA-WASH-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91329%99.91803%
I2-CHIC-KANS-100GE-07745 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97211%100.00000%
I2-CHIC-STAR-100GE-07743 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99089%99.99772%
I2-CLEV-NEWY32AOA-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84745%99.88160%
I2-CLEV-STAR-100GE-07736 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97704%99.99772%
I2-CLEV-WASH-100GE-07737 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92524%99.92904%
I2-DENV-KANS-100GE-07746 7 hr 56 min7 hr 56 min 95.27778%95.27778% 99.85447%99.90949%
I2-DENV-SALT-100GE-07747 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96186%100.00000%
I2-ELPA-HOUH-100GE-07749 16 hr 60 min16 hr 58 min 89.88095%89.90079% 99.42908%99.49795%
I2-ELPA-LOSA-100GE-07750 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.87743%99.88369%
I2-HOUH-TULS-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76643%99.79356%
I2-KANS-TULS-100GE-07753 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91519%99.91519%
I2-LOSA-SALT-100GE-07757 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99526%99.99962%
I2-LOSA-SUNN-100GE-07755 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89697%99.89754%
I2-NEWY23AOA-WASH-100GE-07759 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98179%99.99336%
I2-SALT-SUNN-100GE-07766 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89925%99.91177%

Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits 24 hr 58 min24 hr 56 min 99.21888%99.21992% 99.81275%99.83426%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:689:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit CLEV-STAR Maintenance
Affected:Backbone Circuit CLEV-STAR
Start Time:Monday, August 19, 2013, 3:00 PM (1500) UTC
End Time:Monday, August 19, 2013, 7:00 PM (1900) UTC
Description: Backbone Circuit CLEV-STAR will be unavailable while Internet2 Engineers and Level(3) Communcations Technicians perform maintenance. The entire window is reserved. Backbone traffic will re-route during this maintenance.

Ticket No.:697:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit ELPA-HOUH Emergency Maintenance Window 2 of 2
Affected:Backbone Circuit ELPA-HOUH
Start Time:Monday, August 19, 2013, 3:00 PM (1500) UTC
End Time:Monday, August 19, 2013, 7:00 PM (1900) UTC
Description: Backbone Circuit ELPA-HOUH will be unavailable while Internet2 Engineering with the assistance of Level(3) communications technicians perform maintenance. A brief outage is expected while work is performed at each end; however, the entire window is reserved. Backbone traffic will re-route during this maintenance. This is the second window for ticket 684:135.

Ticket No.:661:135
Subject:Internet2 Advanced Layer2 Services Backbone Circuit ATLA-CHIC Maintenance
Affected:Backbone Circuit ATLA-CHIC
Start Time:Tuesday, August 20, 2013, 5:00 AM (0500) UTC
End Time:Tuesday, August 20, 2013, 11:00 AM (1100) UTC
Description: Backbone Circuit ATLA-CHIC will be unavailable while vendor Engineers perform maintenance. An outage of 15 minutes is expected; however, the entire window is reserved. Backbone traffic will re-route during this maintenance.

Ticket No.:656:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit SEAT-SUNN Maintenance Window 1 of 2
Affected:Backbone Circuit SEAT-SUNN
Start Time:Wednesday, August 21, 2013, 7:00 AM (0700) UTC
End Time:Wednesday, August 21, 2013, 1:00 PM (1300) UTC
Description: Backbone Circuit SEAT-SUNN will be unavailable while Level(3) Engineers perform circuit migration maintenance. An outage of 2 hours is expected; however, the entire window is reserved. Backbone traffic will re-route during this maintenance. This is the first of two maintenance windows.

Ticket No.:679:135
Subject:Internet2 Advanced Layer 2 Services Backbone Circuit SEAT-SUNN Maintenance
Affected:Backbone Circuit SEAT-SUNN
Start Time:Friday, August 23, 2013, 7:05 AM (0705) UTC
End Time:Friday, August 23, 2013, 9:05 AM (0905) UTC
Description: Backbone Circuit SEAT-SUNN will be unavailable while Internet2 Engineers install a node oin Portland, OR. An outage is expected, and the entire window is reserved. Backbone traffic will be re-routed during this maintenance.