Unified - Internet2 Advanced Layer 2 Service Network Operations Report
12/21/2015 - 12/27/2015

Unified - Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Network Resources

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

67594-Normal 1-Critical Brief Outage Resolved - I2 AL2S Core Node JCSN HardwareVendor 12/24/2015 4:37 PM 12/24/2015 4:41 PM
67664-Normal 2-High Brief Outage Resolved - I2 AL2S Backbone ALTA-JCSN UndeterminedUndetermined 12/25/2015 9:51 AM 12/25/2015 9:52 AM
67684-Normal 3-Elevated Brief Outage Resolved - I2 AL2S Backbone KANS-MINN Unannounced MaintenanceVendor 12/26/2015 6:32 PM 12/26/2015 6:42 PM

Unscheduled Outages Detail


Ticket No.:6759:144
Subject:Brief Outage Resolved - I2 AL2S Core Node JCSN
Source Of Impact:Vendor
Affected:AL2S Core Node JCSN
AL2S Backbone ATLA-JCSN
AL2S Backbone HOUH-JCSN
AL2S Participant USDA
All Direct Connections to the Core Node
Start Time:Thursday, December 24, 2015, 4:37 PM (1637) UTC
End Time:Thursday, December 24, 2015, 4:41 PM (1641) UTC
Description:The above listed assets are now available. Internet2 Engineers have advised that the cause for this issue was a routing engine hardware failure in the Jackson, MS core node. Services transitioned to the back up routing engine and were restored. All connections to the Core Node were affected. No further impact from this event is expected.

Ticket No.:6766:144
Subject:Brief Outage Resolved - I2 AL2S Backbone ALTA-JCSN
Source Of Impact:Undetermined
Affected:AL2S Backbone ALTA-JCSN
Start Time:Friday, December 25, 2015, 9:51 AM (0951) UTC
End Time:Friday, December 25, 2015, 9:52 AM (0952) UTC
Description:The above listed asset is available after a brief outage. Internet2 Engineers are investigating the cause and determined the reason for the outage is undetermined. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:6768:144
Subject:Brief Outage Resolved - I2 AL2S Backbone KANS-MINN
Source Of Impact:Vendor
Affected:AL2S Backbone KANS-MINN-100GE-12675
Start Time:Saturday, December 26, 2015, 6:32 PM (1832) UTC
End Time:Saturday, December 26, 2015, 6:42 PM (1842) UTC
Description:The above listed asset is now available after a brief outage. The reason for the outage was scheduled maintenance. The maintenance is now complete. No further outages are expected.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

None during this report period

Downtime and Availability



Unified - Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability
sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99260% 99.99545%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97875% 99.97875%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98805% 99.98843%
sdn-sw.bato.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99032% 99.99545%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99412% 99.99545%
sdn-sw.colu4.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99393% 99.99545%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.eqch.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99393% 99.99545%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98501% 99.99545%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.jcsn.net.internet2.edu 0 hr 4 min0 hr 4 min 99.96032%99.96032% 99.99469% 99.99469%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98900% 99.99545%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99526% 99.99545%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.miss2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99374% 99.99393%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99146% 99.99393%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99545% 99.99545%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98900% 99.99393%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97154% 99.99469%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96243% 99.99545%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99317% 99.99545%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99222% 99.99545%
sdn-srv2.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981% 100.00000%
sdn-srv3.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981% 100.00000%

Aggregate Unified - Internet2 Advanced Layer 2 Service Core Nodes0 hr 4 min0 hr 4 min99.99887%99.99887%99.99215%99.99499%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Unified - Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
I2-ALBA-BOST-100GE-09210 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99602%100.00000%
I2-ALBA-CLEV-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99260%100.00000%
I2-ASHB-CHIC-100GE-11803 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86358%99.92866%
I2-ASHB-PITT-100GE-07737 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94346%99.94820%
I2-ASHB-WASH-100GE-09106 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92524%99.92790%
I2-ASHB-WASH-100GE-11823 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91272%99.95579%
I2-ATLA-CHAR-100GE-07739 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-CINC-100GE-07740 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96357%99.99981%
I2-ATLA-HOUH-10GE-07742 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-JACK-100GE-07739 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96452%99.99621%
I2-ATLA-JCSN-100GE-10734 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784 0 hr 5 min0 hr 5 min 99.95040%99.95040% 99.72146%99.84460%
I2-ATLA-CHAR-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96718%99.99886%
I2-ATLA-WASH-100GE-54536 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%99.99905%
I2-BATO-HOUH-100GE-08860 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98824%100.00000%
I2-BATO-JACK-100GE-11005 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.57138%99.64196%
I2-BOST-HART2-100GE-09211 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93777%99.94763%
I2-CHAR-RALE-100GE-10633 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.87819%99.88065%
I2-CHIC-INDI-100GE-50993 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92733%99.93245%
I2-CINC-INDI-100GE-51692 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97173%99.99962%
I2-CINC-LOUI-100GE-54197 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981%99.99981%
I2-CHIC-COLU4-100GE-11554 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91670%99.97420%
I2-CHIC-KANS-100GE-07745 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95276%99.99886%
I2-CHIC-STAR-100GE-07743 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97021%99.99924%
I2-CLEV-EQCH-100GE-07736 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97154%99.98084%
I2-CLEV-NEWY32AOA-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CLEV-PITT-100GE-10334 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99564%100.00000%
I2-CLEV-STAR-100GE-07736 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-COLU4-KANS-100GE-11548 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98900%99.99810%
I2-DALL-HOUH-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75619%99.83512%
I2-DALL-TULS-100GE-11300 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80191%99.83739%
I2-DENV-ELPA-100GE-07748 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99146%99.99867%
I2-DENV-KANS-100GE-07746 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98349%99.99962%
I2-DENV-SALT-100GE-07747 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93511%99.98065%
I2-ELPA-HOUH-100GE-07749 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.65676%99.71387%
I2-ELPA-PHOE-100GE-07750 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ELPA-TUCS-100GE-07750 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%99.99905%
I2-EQCH-STAR-100GE-09299 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93435%99.99924%
I2-EQCH-MINN-100GE-12184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.69737%99.72393%
I2-HART2-NEWY32AOA-100GE-12947 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.72829%99.73057%
I2-HOUH-HOUS-100GE-09379 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.77174%99.80571%
I2-HOUH-JCSN-100GE-10783 0 hr 4 min0 hr 4 min 99.96032%99.96032% 99.94972%99.98197%
I2-HOUH-TULS-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-KANS-MINN-100GE-12675 0 hr 10 min0 hr 10 min 99.90079%99.90079% 99.97761%99.98046%
I2-KANS-TULS-100GE-07753 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93739%99.94972%
I2-LASV-LOSA-100GE-53802 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90798%99.93359%
I2-LASV-SALT-100GE-07757 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98596%100.00000%
I2-LOSA-PHOE-100GE-09190 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99791%99.99829%
I2-LOSA-SUNN-100GE-07755 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96338%99.99981%
I2-MINN-MISS2-100GE-09130 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.90729%99.18260%
I2-MISS2-SEAT-100GE-13237 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.77838%99.81595%
I2-NEWY23AOA-PHIL-100GE-07759 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99374%99.99981%
I2-PHIL-WASH-100GE-10867 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.83701%99.90077%
I2-PHOE-TUCS-100GE-11990 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94687%99.94706%
I2-PORT-SEAT-100GE-08997 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96224%99.99791%
I2-PORT-SUNN-100GE-10343 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85219%99.88635%
I2-RALE-WASH-100GE-08888 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98444%99.99791%
I2-SALT-SEAT-100GE-08998 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74139%99.74632%
I2-RENO-SALT-100GE-53725 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98387%100.00000%
I2-RENO-SUNN-100GE-07766 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.69433%99.74556%

Aggregate All Unified - Internet2 Advanced Layer 2 Service Backbone Circuits 0 hr 19 min0 hr 0 min 99.99686%99.99686% 99.89961%99.92734%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:6758:144
Subject:Maintenance - I2 AL2S Circuit I2-SEAT-SEAT-10GE-09312
Affected:
Start Time:Thursday, December 31, 2015, 11:00 AM (1100) UTC
End Time:Thursday, December 31, 2015, 2:00 PM (1400) UTC
Description: The above listed assset will be unavailable while Internet2 Engineers perform software maintenance. An outage is expected. The entire window is reserved.

Ticket No.:6783:144
Subject:Maintenance - I2 Core Node SING
Affected:Core Node Singapore and its Connectors and Participants
Start Time:Saturday, January 2, 2016, 1:00 AM (0100) UTC
End Time:Saturday, January 2, 2016, 5:00 AM (0500) UTC
Description: The above listed asset is expected to remain available while TATA performs power maintenance. No outages are expected. The entire window is reserved. All connections to the Core Node will be affected in the unlikely event of impact by this maintenance.

Ticket No.:6781:144
Subject:Maintenance - I2 Optical Member ESnet
Affected:ESNET-NEWY32AOA-WASH-100GE-07598
Start Time:Tuesday, January 5, 2016, 6:00 AM (0600) UTC
End Time:Tuesday, January 5, 2016, 8:00 AM (0800) UTC
Description: Member ESnet's Optical circuit ESNET-NEWY32AOA-WASH-100GE-07598 will be unavailable while Level3 Engineers perform maintenance. A brief outage is expected, however the entire maintenance window has been reserved.

Ticket No.:6764:144
Subject:Maintenance *Tracking* 1 of 2 - I2 Optical Member ESnet
Affected:Member ESnet
Start Time:Wednesday, January 6, 2016, 6:00 AM (0600) UTC
End Time:Wednesday, January 6, 2016, 12:00 PM (1200) UTC
Description: Member ESnet's Optical circuit ESNET-CHAT-NASH-DKFBR-10442 will be unavailable while Level(3) Engineers perform maintenance. No alarms are expected, however the entire maintenance window has been reserved.

Ticket No.:6791:144
Subject:Maintenance - I2 Optical DWDM System SNLL-SACR
Affected:DWDM System SNLL-SACR
Customer ESnet
Start Time:Wednesday, January 6, 2016, 7:00 AM (0700) UTC
End Time:Wednesday, January 6, 2016, 9:00 AM (0900) UTC
Description: The above listed assets will be unavailable while Level(3) Communications replace a SFP card in Modesto, CA. An outage of 2 hours is expected. The entire window is reserved.

Ticket No.:6657:144
Subject:Maintenance - I2 Optical DWDMs CLEV-DETR, DETR-EQCH DWDM
Affected:DWDM System CLEV-DETR
DWDM System DETR-EQCH
AL2S Backbones(s) ASHB-CHIC and CLEV-EQCH
IP Backbone CHIC-CLEV, CHIC-NEWY, and CHIC-WASH
Customer NORDUnet
Customer Merit Network
Optical Member ESnet
Optical Member NOAA N-Wave
Start Time:Thursday, January 7, 2016, 6:00 AM (0600) UTC
End Time:Thursday, January 7, 2016, 11:00 AM (1100) UTC
Description: The above listed assets will be unavailable while Internet2 Engineers move the optical node in Detroit to a new rack location. Outages are expected. The entire window is reserved.

Ticket No.:6765:144
Subject:Maintenance *Tracking* 2 of 2 - I2 Optical Member ESnet
Affected:Member ESnet
Start Time:Thursday, January 7, 2016, 6:00 AM (0600) UTC
End Time:Thursday, January 7, 2016, 12:00 PM (1200) UTC
Description: Member ESnet's Optical circuit ESNET-CHAT-NASH-DKFBR-10442 will be unavailable while Level(3) Engineers perform maintenance. No alarms are expected, however the entire maintenance window has been reserved.

Ticket No.:6648:144
Subject:Maintenance 1 of 2 - I2 Optical DWDM System ASHB-PITT
Affected:DWDM System ASHB-PITT
AL2S Backbone(s) ASHB-PITT and ASHB-CHIC
IP Backbone(s) ATLA-CLEV, CHIC-WASH, CLEV-WASH
Connector 3ROX (ASHB)
Customer NORDUnet
Optical Member ESnet
Optical Member NOAA N-Wave
Start Time:Saturday, January 9, 2016, 5:00 AM (0500) UTC
End Time:Saturday, January 9, 2016, 11:00 AM (1100) UTC
Description: The above listed assets will be unavailable while Level(3) Communications perform maintenance to relocate cable in Hancock, MD. An outage of 6 hours is expected; however, the entire window is reserved.

Ticket No.:6762:144
Subject:Maintenance 1 of 2 *Tracking* - I2 IP oob.atla
Affected:
Start Time:Saturday, January 9, 2016, 5:00 AM (0500) UTC
End Time:Saturday, January 9, 2016, 11:00 AM (1100) UTC
Description: The above listed assets will be unavailable while Level(3) engineers perform software maintenance to upgrade code on the IP platform. No impact to production is expected. The entire window is reserved.

Ticket No.:6650:144
Subject:Maintenance 2 of 2 - I2 Optical DWDM System ASHB-PITT
Affected:DWDM System ASHB-PITT
AL2S Backbone(s) ASHB-PITT and ASHB-CHIC
IP Backbone(s) ATLA-CLEV, CHIC-WASH, CLEV-WASH
Connector 3ROX (ASHB)
Customer NORDUnet
Optical Member ESnet
Optical Member NOAA N-Wave
Start Time:Sunday, January 10, 2016, 5:00 AM (0500) UTC
End Time:Sunday, January 10, 2016, 11:00 AM (1100) UTC
Description: The above listed assets will be unavailable while Level(3) Communications perform maintenance to relocate cable in Hancock, MD. An outage of 6 hours is expected; however, the entire window is reserved. This is an alternate maintenance window if needed.

Ticket No.:6249:144
Subject:Maintenance - I2 Core Node SING
Affected:Core Node Singapore and its Connectors and Participants
Start Time:Thursday, January 14, 2016, 1:00 AM (0100) UTC
End Time:Friday, January 22, 2016, 1:00 PM (1300) UTC
Description: The above listed asset is expected to remain available while TATA performs power maintenance. This power maintenance is set to happen one feed at a time to avoid unnecessary impact. It is a multi-day event. No outages are expected. The entire window is reserved. All connections to the Core Node will be affected in the unlikely event of impact by this maintenance.

Ticket No.:6763:144
Subject:Maintenance 2 of 2 *Tracking* - I2 IP oob.atla
Affected:
Start Time:Sunday, January 24, 2016, 5:00 AM (0500) UTC
End Time:Sunday, January 24, 2016, 11:00 AM (1100) UTC
Description: The above listed assets will be unavailable while Level(3) engineers perform software maintenance to upgrade code on the IP platform. No impact to production is expected. The entire window is reserved.