Internet2 Advanced Layer 2 Service Network Operations Report
06/23/2014 - 06/29/2014

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Network Resources

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

19032-High 2-High Brief Outage Resolved - I2 AL2S Backbone RALE-WASH UndeterminedUndetermined 06/24/2014 6:02 AM 06/24/2014 6:03 AM
19122-High 2-High Brief Outage Resolved - I2 AL2S Backbone DALL-TULS UndeterminedUndetermined 06/26/2014 11:08 AM 06/26/2014 11:09 AM
19112-High 2-High Outage Resolved - I2 AL2S Backbone CHIC-STAR SoftwareVendor 06/26/2014 12:00 PM 06/26/2014 7:02 PM
19222-High 2-High Brief Outage - I2 AL2S Backbone CHIC-COLU4 InvestigatingUndetermined 06/28/2014 12:55 AM 06/28/2014 12:56 AM

Unscheduled Outages Detail


Ticket No.:1903:135
Subject:Brief Outage Resolved - I2 AL2S Backbone RALE-WASH
Source Of Impact:Undetermined
Affected:Backbone RALE-WASH
Start Time:Tuesday, June 24, 2014, 6:02 AM (0602) UTC
End Time:Tuesday, June 24, 2014, 6:03 AM (0603) UTC
Description:Backbone RALE-WASH was briefly unavailable. Internet2 Engineers report the reason for the outage is undetermined. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1912:135
Subject:Brief Outage Resolved - I2 AL2S Backbone DALL-TULS
Source Of Impact:Undetermined
Affected:Backbone DALL-TULS
Start Time:Thursday, June 26, 2014, 11:08 AM (1108) UTC
End Time:Thursday, June 26, 2014, 11:09 AM (1109) UTC
Description:Backbone DALL-TULS is now available following a brief outage. Level(3) Communications and Internet2 Engineering has investigated, but the reason for the outage is indeterminate. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1911:135
Subject:Outage Resolved - I2 AL2S Backbone CHIC-STAR
Source Of Impact:Vendor
Affected:Backbone CHIC-STAR
Start Time:Thursday, June 26, 2014, 12:00 PM (1200) UTC
End Time:Thursday, June 26, 2014, 7:02 PM (1902) UTC
Description:Backbone CHIC-STAR is now available after Internet2's Optical Vendor experienced trouble during a software upgrade maintenance. Hardware has been replaced and no further outages are expected. Backbone traffic re-routed. Workgroup administrators will receive notifications from OESS regarding circuits re- routed on the backbone.

Ticket No.:1922:135
Subject:Brief Outage - I2 AL2S Backbone CHIC-COLU4
Source Of Impact:Undetermined
Affected:Backbone CHIC-COLU4
Start Time:Saturday, June 28, 2014, 12:55 AM (0055) UTC
End Time:Saturday, June 28, 2014, 12:56 AM (0056) UTC
Description:Backbone CHIC-COLU4 was briefly unavailable. Vendor Engineers are investigating the cause; however, the reason for the outage is pending. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

1817 3-Elevated 2-High Maintenance Completed - I2 AL2S Various Backbones Circuit Vendor06/26/2014 4:05 AM 06/26/2014 12:00 PM
1818 3-Elevated 2-High Maintenance Completed - I2 AL2S Various Backbones CircuitVendor 06/27/2014 7:02 AM 06/27/2014 7:27 AM

Scheduled Maintenances Detail

Ticket No.:1817:135
Subject:Maintenance Completed - I2 AL2S Various Backbones
Source Of Impact:Vendor
Affected:Backbone ASHB-PITT
Backbone ASHB-WASH
Backbone CHIC-STAR
Backbone CLEV-PITT
Backbone CLEV-STAR
Backbone KANS-TULS
Backbone ASHB-CHIC
Backbone ASHB-WASH
Backbone ATLA-CHIC
Start Time:Thursday, June 26, 2014, 4:05 AM (0405) UTC
End Time:Thursday, June 26, 2014, 12:00 PM (1200) UTC
Description: The backbones listed above were be unavailable while Level(3) Communications Engineers performed maintenance. Backbone traffic re-routed during this maintenance. This maintenance has been completed. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1818:135
Subject:Maintenance Completed - I2 AL2S Various Backbones
Source Of Impact:Vendor
Affected:Backbone BOST-NEWY32AOA
Backbone LOSA-SUNN
Backbone NEWY32A0A-PHIL
Backbone PHIL-WASH
Backbone CHIC-COLU4
Start Time:Friday, June 27, 2014, 7:02 AM (0702) UTC
End Time:Friday, June 27, 2014, 7:27 AM (0727) UTC
Description: The backbones listed above were unavailable while Level(3) Communications Engineers performed maintenance. Maintenance has been completed. No further outages are expected. Backbone traffic re- routedduring this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.


Downtime and Availability



Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability
sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99696% 100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99696% 100.00000%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867% 100.00000%
sdn-sw.bato.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905% 100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99564% 100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96376% 99.98975%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867% 100.00000%
sdn-sw.colu4.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924% 100.00000%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85770% 99.85902%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943% 100.00000%
sdn-sw.eqch.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92752% 99.92885%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829% 100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98425% 99.98520%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99810% 99.99943%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886% 100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98596% 100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905% 100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924% 100.00000%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99715% 100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962% 100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924% 100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956% 99.99886%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829% 100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99279% 100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99791% 100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867% 100.00000%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867% 100.00000%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99810% 100.00000%

Aggregate Internet2 Advanced Layer 2 Service Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.98960%99.99253%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
I2-ALBA-BOST-100GE-09210 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99393%99.99924%
I2-ALBA-CLEV-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98767%99.99981%
I2-ASHB-CHIC-100GE-11803 7 hr 55 min0 hr 0 min 95.28770%100.00000% 99.89887%99.98975%
I2-ASHB-PITT-100GE-07737 7 hr 55 min0 hr 0 min 95.28770%100.00000% 99.77117%99.88065%
I2-ASHB-WASH-100GE-09106 7 hr 55 min0 hr 0 min 95.28770%100.00000% 99.90874%99.99981%
I2-ASHB-WASH-100GE-11823 7 hr 55 min0 hr 0 min 95.28770%100.00000% 99.90987%100.00000%
I2-ATLA-CHAR-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97932%99.97932%
I2-ATLA-CHIC-100GE-07740 7 hr 55 min0 hr 0 min 95.28770%100.00000% 99.75656%99.93530%
I2-ATLA-HOUH-10GE-07742 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-JACK-100GE-07739 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99222%100.00000%
I2-ATLA-JCSN-100GE-10734 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.67934%99.72336%
I2-ATLA-WASH-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-BATO-HOUH-100GE-08860 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90361%99.92847%
I2-BATO-JACK-100GE-11005 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.70287%99.73323%
I2-BOST-NEWY32AOA-100GE-09211 0 hr 25 min0 hr 0 min 99.75198%100.00000% 99.98160%100.00000%
I2-CHAR-RALE-100GE-10633 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97894%99.97970%
I2-CHIC-COLU4-100GE-11554 0 hr 26 min0 hr 1 min 99.74206%99.99008% 99.95978%99.97856%
I2-CHIC-KANS-100GE-07745 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75600%99.91006%
I2-CHIC-STAR-100GE-07743 14 hr 56 min7 hr 1 min 91.11111%95.82341% 99.67099%99.78370%
I2-CLEV-NEWY32AOA-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962%100.00000%
I2-CLEV-PITT-100GE-10334 7 hr 55 min0 hr 0 min 95.28770%100.00000% 99.90323%100.00000%
I2-CLEV-STAR-100GE-07736 7 hr 55 min0 hr 0 min 95.28770%100.00000% 99.86737%99.98596%
I2-COLU4-KANS-100GE-11548 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98197%99.98235%
I2-DALL-HOUH-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92600%99.92866%
I2-DALL-TULS-100GE-11300 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.84384%99.84460%
I2-DENV-ELPA-100GE-07748 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97913%99.99260%
I2-DENV-KANS-100GE-07746 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.83910%99.88141%
I2-DENV-SALT-100GE-07747 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90494%99.96983%
I2-ELPA-HOUH-100GE-07749 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.31960%99.39132%
I2-ELPA-PHOE-100GE-07750 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89507%99.91595%
I2-EQCH-STAR-100GE-09299 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96300%99.97439%
I2-EQCH-MINN-100GE-12184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99753%100.00000%
I2-HOUH-JCSN-100GE-10783 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91310%99.91405%
I2-HOUH-TULS-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.68788%99.75068%
I2-KANS-TULS-100GE-07753 7 hr 55 min0 hr 0 min 95.28770%100.00000% 99.90912%99.99981%
I2-LOSA-PHOE-100GE-09190 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78408%99.80874%
I2-LOSA-SALT-100GE-07757 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.88274%99.93226%
I2-LOSA-SUNN-100GE-07755 0 hr 25 min0 hr 0 min 99.75198%100.00000% 99.99355%99.99943%
I2-MINN-SEAT-100GE-09130 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.35318%99.54425%
I2-NEWY23AOA-PHIL-100GE-07759 0 hr 25 min0 hr 0 min 99.75198%100.00000% 99.99431%99.99981%
I2-PHIL-WASH-100GE-10867 0 hr 25 min0 hr 0 min 99.75198%100.00000% 99.88881%99.99981%
I2-PORT-SEAT-100GE-08997 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829%100.00000%
I2-PORT-SUNN-100GE-10343 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829%99.99962%
I2-RALE-WASH-100GE-08888 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.79926%99.82810%
I2-SALT-SUNN-100GE-07766 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98122%99.99545%

Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits 80 hr 24 min73 hr 20 min 98.95963%99.90856% 99.87904%99.92304%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:1856:135
Subject:Maintenance - I2 AL2S Backbone HOUH-JCSN
Affected:Backbone HOUH-JCSN
Start Time:Tuesday, July 1, 2014, 4:00 AM (0400) UTC
End Time:Tuesday, July 1, 2014, 11:00 AM (1100) UTC
Description: Backbone HOUH-JCSN will be unavailable while Level(3) Communications performs software upgrade maintenance. Outages are expected, and the entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1820:135
Subject:Maintenance - I2 AL2S Various Backbonese
Affected:Backbone ATLA-JCSN
Backbone ATLA-CHIC
Backbone ATLA-CHAR
Backbone CHAR-RALE
Backbone CHIC-KANS
Backbone DALL-HOUH
Backbone RALE-WASH
Start Time:Thursday, July 3, 2014, 4:00 AM (0400) UTC
End Time:Thursday, July 3, 2014, 11:00 AM (1100) UTC
Description: The above listed backbones will be unavailable while Level(3) Engineers perform maintenance. Outages are expected; however, the entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1918:135
Subject:Maintenance - I2 AL2S Various Backbones
Affected:Backbone DENV-SALT
Backbone ELPA-TUCS
Backbone DENV-ELPA
Backbone ELPA-HOUH
Backbone DENV-KANS
Backbone ASHB-WASH
Backbone ASHB-CHIC
Start Time:Friday, July 4, 2014, 4:00 AM (0400) UTC
End Time:Friday, July 4, 2014, 11:00 AM (1100) UTC
Description: The above listed backbones will be unavailable while Level 3 Engineers perform maintenance. Outages are expected, and the entire maintenance window has been reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbones.

Ticket No.:1869:135
Subject:Maintenance - I2 AL2S Backbones CHIC-KANS and CHIC-COLU4
Affected:Backbone CHIC-KANS
Backbone CHIC-COLU4
Start Time:Sunday, July 6, 2014, 5:00 AM (0500) UTC
End Time:Sunday, July 6, 2014, 7:00 AM (0700) UTC
Description: Backbones CHIC-KANS and CHIC-COLU4 will be unavailable while Level(3) Communications performs maintenance to replace a card in Plainfield, IN. An outage is expected, and the entire window is reserved. Workgroup administrators will receive notifications from OESS regarding circuits re- routed on the backbone.

Ticket No.:1906:135
Subject:Maintenance 1 of 2 - I2 AL2S Backbone DALL-HOUH
Affected:Backbone DALL-HOUH
Start Time:Thursday, July 10, 2014, 5:00 AM (0500) UTC
End Time:Thursday, July 10, 2014, 11:00 AM (1100) UTC
Description: Backbone DALL-HOUH will be unavailable while Level(3) Communications performs maintenance to repair damaged fiber in Bardwell, TX. An outage is expected, and the entire window is reserved. Backbone traffic will re- route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. * This is the 1st of 2 maintenance windows *

Ticket No.:1907:135
Subject:Maintenance 2 of 2 - I2 AL2S Backbone DALL-HOUH
Affected:Backbone DALL-HOUH
Start Time:Friday, July 11, 2014, 5:00 AM (0500) UTC
End Time:Friday, July 11, 2014, 11:00 AM (1100) UTC
Description: Backbone DALL-HOUH will be unavailable while Level(3) Communications performs maintenance to repair damaged fiber in Bardwell, TX. An outage is expected, and the entire window is reserved. Backbone traffic will re- route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. * This is the 2nd of 2 maintenance windows *

Ticket No.:1908:135
Subject:Maintenance 1 of 2 - I2 AL2S Backbone MINN-SEAT
Affected:Backbone MINN-SEAT
Start Time:Saturday, July 12, 2014, 5:01 AM (0501) UTC
End Time:Saturday, July 12, 2014, 10:00 AM (1000) UTC
Description: Backbone MINN-SEAT will be unavailable while Internet2's Fiber Provider performs maintenance. An outage is expected, and the entire maintenance window has been reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. Please note this maintenance is one of two windows.

Ticket No.:1917:135
Subject:Maintenance 2 of 2 - I2 AL2S Backbone MINN-SEAT
Affected:Backbone MINN-SEAT
Start Time:Saturday, July 19, 2014, 5:01 AM (0501) UTC
End Time:Saturday, July 19, 2014, 10:00 AM (1000) UTC
Description: Backbone MINN-SEAT will be unavailable while Internet2's Fiber Provider performs maintenance. An outage is expected, and the entire maintenance window has been reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. Please note this maintenance is two of two windows.