Internet2 Advanced Layer 2 Service Network Operations Report
06/16/2014 - 06/22/2014

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

ConnectorTypeDateSponsor
US IgniteDemo6/20/2014 @ 0100 UTC


Upgrades
OESS 1.1.4ah1, 6/26/2014 @ 02:30 UTC

OESS 1.1.4b, 6/27/2014 @ 07:00 UTC


New Network Resources
FSFW 1.0.2-4, 6/16/2014 @ 10:00 UTC

Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

18492-High 2-High Brief Outage - I2 AL2S Backbone ATLA-CHIC InvestigatingUndetermined 06/11/2014 6:16 PM 06/11/2014 6:17 PM
06/17/2014 8:40 PM 06/17/2014 8:41 PM
06/18/2014 3:14 PM 06/18/2014 3:15 PM
18742-High 2-High Brief Outage - I2 AL2S Backbone COLU4-KANS InvestigatingUndetermined 06/18/2014 6:03 AM 06/18/2014 6:04 AM
18792-High 2-High Brief Outage - I2 AL2S Backbone BATO-JACK InvestigatingUndetermined 06/18/2014 8:04 PM 06/18/2014 8:05 PM

Unscheduled Outages Detail


Ticket No.:1849:135
Subject:Brief Outage - I2 AL2S Backbone ATLA-CHIC
Source Of Impact:Undetermined
Affected:Backbone ATLA-CHIC
Start Time:Wednesday, June 11, 2014, 6:16 PM (1816) UTC
End Time:Wednesday, June 11, 2014, 6:17 PM (1817) UTC
Start Time:Tuesday, June 17, 2014, 8:40 PM (2040) UTC
End Time:Tuesday, June 17, 2014, 8:41 PM (2041) UTC
Start Time:Wednesday, June 18, 2014, 3:14 PM (1514) UTC
End Time:Wednesday, June 18, 2014, 3:15 PM (1515) UTC
Description:Backbone ATLA-CHIC was briefly unavailable. Internet2 Engineers are investigating the cause; however, the reason for the outage is pending. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1874:135
Subject:Brief Outage - I2 AL2S Backbone COLU4-KANS
Source Of Impact:Undetermined
Affected:Backbone COLU4-KANS
Start Time:Wednesday, June 18, 2014, 6:03 AM (0603) UTC
End Time:Wednesday, June 18, 2014, 6:04 AM (0604) UTC
Description:Backbone COLU4-KANS was briefly unavailable. MREN Engineers are investigating the cause; however, the reason for the outage is pending. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1879:135
Subject:Brief Outage - I2 AL2S Backbone BATO-JACK
Source Of Impact:Undetermined
Affected:Backbone BATO-JACK
Start Time:Wednesday, June 18, 2014, 8:04 PM (2004) UTC
End Time:Wednesday, June 18, 2014, 8:05 PM (2005) UTC
Description:Backbone BATO-JACK was briefly unavailable. Internet2 Engineers are investigating the cause; however, the reason for the outage is pending. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

1891 3-Elevated 2-High Emergency Maintenance Completed - I2 AL2S Backbone ATLA-CHIC Hardware Internal06/21/2014 5:09 AM 06/21/2014 6:29 AM

Scheduled Maintenances Detail

Ticket No.:1891:135
Subject:Emergency Maintenance Completed - I2 AL2S Backbone ATLA-CHIC
Source Of Impact:Internal
Affected:Backbone ATLA-CHIC
Interconnect to IP
Connector Indiana Gigapop (CHIC)*
Connector ICCN
Connector ESnet (CHIC)*
Participant GENI (CHIC)*
Connector MREN (CHIC)*
Start Time:Saturday, June 21, 2014, 5:09 AM (0509) UTC
End Time:Saturday, June 21, 2014, 6:29 AM (0629) UTC
Description: The above listed was unavailable while Level 3 Engineers worked with Internet2 Engineers to perform hardware maintenance. Maintenance has been completed. No further outages are expected. Backbone traffic re-routed during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. * indicates multihomed status, and thus the entity will remain available.


Downtime and Availability



Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability
sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99696% 100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99696% 100.00000%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867% 100.00000%
sdn-sw.bato.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905% 100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99564% 100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96376% 99.98975%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867% 100.00000%
sdn-sw.colu4.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924% 100.00000%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85770% 99.85902%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943% 100.00000%
sdn-sw.eqch.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92752% 99.92885%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829% 100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98425% 99.98520%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99810% 99.99943%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886% 100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98596% 100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905% 100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924% 100.00000%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99715% 100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962% 100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924% 100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956% 99.99886%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829% 100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99279% 100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99791% 100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867% 100.00000%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867% 100.00000%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99810% 100.00000%

Aggregate Internet2 Advanced Layer 2 Service Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.98960%99.99253%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
I2-ALBA-BOST-100GE-09210 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99393%99.99924%
I2-ALBA-CLEV-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98767%99.99981%
I2-ASHB-CHIC-100GE-11803 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98900%99.98975%
I2-ASHB-PITT-100GE-07737 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86130%99.88065%
I2-ASHB-WASH-100GE-09106 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886%99.99981%
I2-ASHB-WASH-100GE-11823 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-CHAR-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97932%99.97932%
I2-ATLA-CHIC-100GE-07740 1 hr 22 min0 hr 2 min 99.18651%99.98016% 98.74696%98.83557%
I2-ATLA-HOUH-10GE-07742 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-JACK-100GE-07739 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99222%100.00000%
I2-ATLA-JCSN-100GE-10734 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.67934%99.72336%
I2-ATLA-WASH-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-BATO-HOUH-100GE-08860 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90361%99.92847%
I2-BATO-JACK-100GE-11005 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.70287%99.73323%
I2-BOST-NEWY32AOA-100GE-09211 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98634%100.00000%
I2-CHAR-RALE-100GE-10633 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97894%99.97970%
I2-CHIC-COLU4-100GE-11554 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96471%99.97875%
I2-CHIC-KANS-100GE-07745 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75600%99.91006%
I2-CHIC-STAR-100GE-07743 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84100%99.86358%
I2-CLEV-NEWY32AOA-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98691%100.00000%
I2-CLEV-PITT-100GE-10334 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99336%100.00000%
I2-CLEV-STAR-100GE-07736 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95750%99.98596%
I2-COLU4-KANS-100GE-11548 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.98179%99.98216%
I2-DALL-HOUH-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92600%99.92866%
I2-DALL-TULS-100GE-11300 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84403%99.84479%
I2-DENV-ELPA-100GE-07748 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97913%99.99260%
I2-DENV-KANS-100GE-07746 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.83910%99.88141%
I2-DENV-SALT-100GE-07747 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90494%99.96983%
I2-ELPA-HOUH-100GE-07749 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.31960%99.39132%
I2-ELPA-PHOE-100GE-07750 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89507%99.91595%
I2-EQCH-STAR-100GE-09299 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96300%99.97439%
I2-EQCH-MINN-100GE-12184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99753%100.00000%
I2-HOUH-JCSN-100GE-10783 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91310%99.91405%
I2-HOUH-TULS-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.68788%99.75068%
I2-KANS-TULS-100GE-07753 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%99.99981%
I2-LOSA-PHOE-100GE-09190 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78408%99.80874%
I2-LOSA-SALT-100GE-07757 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.88274%99.93226%
I2-LOSA-SUNN-100GE-07755 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829%99.99943%
I2-MINN-SEAT-100GE-09130 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.35318%99.54425%
I2-NEWY23AOA-PHIL-100GE-07759 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%99.99981%
I2-PHIL-WASH-100GE-10867 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89356%99.99981%
I2-PORT-SEAT-100GE-08997 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829%100.00000%
I2-PORT-SUNN-100GE-10343 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829%99.99962%
I2-RALE-WASH-100GE-08888 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79945%99.82829%
I2-SALT-SUNN-100GE-07766 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98122%99.99545%

Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits 1 hr 24 min1 hr 20 min 99.98188%99.99914% 99.87475%99.90088%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:1817:135
Subject:Maintenance - I2 AL2S Various Backbones
Affected:Backbone ASHB-PITT
Backbone ASHB-WASH
Backbone CHIC-STAR
Backbone CLEV-PITT
Backbone CLEV-STAR
Backbone KANS-TULS
Backbone ASHB-CHIC
Backbone ASHB-WASH
Backbone ATLA-CHIC
Start Time:Thursday, June 26, 2014, 4:00 AM (0400) UTC
End Time:Thursday, June 26, 2014, 11:00 AM (1100) UTC
Description: The backbones listed above will be unavailable while Level(3) Commincations Engineers perform maintenance. Outages are expected; however, the entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1818:135
Subject:Maintenance - I2 AL2S Various Backbones
Affected:Backbone BOST-NEWY32AOA
Backbone LOSA-SUNN
Backbone NEWY32A0A-PHIL
Backbone PHIL-WASH
Backbone CHIC-COLU4
Start Time:Friday, June 27, 2014, 4:00 AM (0400) UTC
End Time:Friday, June 27, 2014, 11:00 AM (1100) UTC
Description: The backbones listed above will be unavailable while Level(3) Communications Engineers perform maintenance. Outages are expected, and the entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1886:135
Subject:Maintenance 1 of 2 - I2 AL2S Backbone DALL-HOUH
Affected:Backbone DALL-HOUH
Start Time:Saturday, June 28, 2014, 5:00 AM (0500) UTC
End Time:Saturday, June 28, 2014, 11:00 AM (1100) UTC
Description: Backbone DALL-HOUH will be unavailable while Level(3) Communications replaces damaged cable in Bardwell, TX. An outage is expected, and the entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. * This is the 1st of 2 maintenance windows *

Ticket No.:1887:135
Subject:Maintenance 2 of 2 - I2 AL2S Backbone DALL-HOUH
Affected:Backbone DALL-HOUH
Start Time:Sunday, June 29, 2014, 5:00 AM (0500) UTC
End Time:Sunday, June 29, 2014, 11:00 AM (1100) UTC
Description: Backbone DALL-HOUH will be unavailable while Level(3) Communications replaces damaged cable in Bardwell, TX. An outage is expected, and the entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. * This is the 2nd of 2 maintenance windows *

Ticket No.:1856:135
Subject:Maintenance - I2 AL2S Backbone HOUH-JCSN
Affected:Backbone HOUH-JCSN
Start Time:Tuesday, July 1, 2014, 4:00 AM (0400) UTC
End Time:Tuesday, July 1, 2014, 11:00 AM (1100) UTC
Description: Backbone HOUH-JCSN will be unavailable while Level(3) Communications performs software upgrade maintenance. Outages are expected, and the entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1820:135
Subject:Maintenance - I2 AL2S Various Backbonese
Affected:Backbone ATLA-JCSN
Backbone ATLA-CHIC
Backbone ATLA-CHAR
Backbone CHAR-RALE
Backbone CHIC-KANS
Backbone DALL-HOUH
Backbone RALE-WASH
Start Time:Thursday, July 3, 2014, 4:00 AM (0400) UTC
End Time:Thursday, July 3, 2014, 11:00 AM (1100) UTC
Description: The above listed backbones will be unavailable while Level(3) Engineers perform maintenance. Outages are expected; however, the entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:1869:135
Subject:Maintenance - I2 AL2S Backbones CHIC-KANS and CHIC-COLU4
Affected:Backbone CHIC-KANS
Backbone CHIC-COLU4
Start Time:Sunday, July 6, 2014, 5:00 AM (0500) UTC
End Time:Sunday, July 6, 2014, 7:00 AM (0700) UTC
Description: Backbones CHIC-KANS and CHIC-COLU4 will be unavailable while Level(3) Communications performs maintenance to replace a card in Plainfield, IN. An outage is expected, and the entire window is reserved. Workgroup administrators will receive notifications from OESS regarding circuits re- routed on the backbone.