Unified - Internet2 Advanced Layer 2 Service Network Operations Report
01/02/2017 - 01/08/2017

Unified - Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Network Resources

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

116584-Normal 1-Critical Brief Outage Resolved - I2 Optical DWDM System ASHB-WASH Human ErrorVendor 01/02/2017 7:59 PM 01/02/2017 8:01 PM
117224-Normal 1-Critical Outage Resolved - I2 Optical DWDM System DENV-KANS Cut or Damaged FiberVendor 01/07/2017 5:17 PM 01/07/2017 10:32 PM
117264-Normal 1-Critical Outage Resolved - I2 Optical DWDM System DENV-KANS Cut or Damaged FiberVendor 01/08/2017 7:49 PM 01/09/2017 3:31 AM

Unscheduled Outages Detail


Ticket No.:11658:144
Subject:Brief Outage Resolved - I2 Optical DWDM System ASHB-WASH
Source Of Impact:Vendor
Affected:DWDM System ASHB-WASH
AL2S Backbones ASHB-WASH and ATLA-JCSN
IP Backbones ASHB-ATLA, ASHB-EQNY, ASHB-LOSA, ASHB-NEWY32AOA,
ATLA-CLEV, and CLEV-WASH
Optical Member ESnet
Optical Member 3ROX
Optical member NOAA N-Wave
Optical Member MCNC
Optical member NCREN
Optical Member MissiON
IP Peer GEANT
Start Time:Monday, January 2, 2017, 7:59 PM (1959) UTC
End Time:Monday, January 2, 2017, 8:01 PM (2001) UTC
Description:The above listed assets are now available following a brief outage. After completing their investigation, Level (3) Communications Engineers have reported the reason for the outage is due to a fiber bump of undetermined origin.

Ticket No.:11722:144
Subject:Outage Resolved - I2 Optical DWDM System DENV-KANS
Source Of Impact:Vendor
Affected:DWDM System DENV-KANS
AL2S Backbone DENV-KANS
IP Backbone KANS-SALT
Optical Member ESnet
Optical Member NOAA N-Wave
Optical Member CENIC

Peer GEANT
Start Time:Saturday, January 7, 2017, 5:17 PM (1717) UTC
End Time:Saturday, January 7, 2017, 10:32 PM (2232) UTC
Description:The above listed assets are now available to the community. Level(3) Communications Engineers have reported the outage was caused by a buildup of ice in a fiber conduit under a bridge in Kansas. Services restored after the ice was cleared. Field services worked to seal off the conduit to prevent further buildup. No further outages expected.

Ticket No.:11726:144
Subject:Outage Resolved - I2 Optical DWDM System DENV-KANS
Source Of Impact:Vendor
Affected:DWDM System DENV-KANS
AL2S Backbone DENV-KANS
IP Backbone KANS-SALT
Optical Member ESnet
Optical Member NOAA N-Wave
Optical Member CENIC
Optical Member Front Range GigaPOP
Peer GEANT
Start Time:Sunday, January 8, 2017, 7:49 PM (1949) UTC
End Time:Monday, January 9, 2017, 3:31 AM (0331) UTC
Description:The above listed assets are now available to the community. Level(3) Communications Engineers arrived on site and reported the outage was due to extensive fiber damage caused by ice buildup. A splicing crew was onsite preparing the replacement fiber. Splicing crews have completed splicing on all tubes. This issue has been resolved. No further outages are expected.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

11659 3-Elevated 3-Elevated Maintenance Completed - I2 AL2S Backbone MISS2-SEAT Hardware Internal01/06/2017 8:46 AM 01/06/2017 8:48 AM
11679 3-Elevated 2-High Maintenance Completed - I2 AL2S Backbone CLEV-EQCH CircuitInternal 01/08/2017 6:09 AM 01/08/2017 6:11 AM

Scheduled Maintenances Detail

Ticket No.:11659:144
Subject:Maintenance Completed - I2 AL2S Backbone MISS2-SEAT
Source Of Impact:Internal
Affected:Backbone MISS2-SEAT
Net+ Provider Code42 (SEAT)
Start Time:Friday, January 6, 2017, 8:46 AM (0846) UTC
End Time:Friday, January 6, 2017, 8:48 AM (0848) UTC
Description: The above listed asset is available after Internet2 Engineers performed maintenance. Maintenance has been completed. No further outages are expected.

Ticket No.:11679:144
Subject:Maintenance Completed - I2 AL2S Backbone CLEV-EQCH
Source Of Impact:Internal
Affected:AL2S Backbone CLEV-EQCH
Start Time:Sunday, January 8, 2017, 6:09 AM (0609) UTC
End Time:Sunday, January 8, 2017, 6:11 AM (0611) UTC
Description: The above listed asset was briefly unavailable while Internet2 Engineers performed maintenance to replace an optic. Maintenance has been completed. Backbone traffic re- routed during this maintenance. Workgroup administrators received notifications from OESS regarding circuits re-routed on the backbone.


Downtime and Availability



Unified - Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability
sdn-sw.reno.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99338% 100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96537% 100.00000%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96386% 100.00000%
sdn-sw.bato.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96083% 100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95402% 100.00000%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.colu4.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962% 100.00000%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95269% 99.99924%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93964% 100.00000%
sdn-sw.eqch.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96367% 100.00000%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95686% 100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92639% 100.00000%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96405% 100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.miss2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99659% 100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94815% 100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97824% 99.99243%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94323% 100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95326% 100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96708% 100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92677% 100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94437% 100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93869% 100.00000%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94267% 100.00000%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95023% 100.00000%
sdn-srv2.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
sdn-srv3.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%

Aggregate Unified - Internet2 Advanced Layer 2 Service Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.97305%99.99977%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Unified - Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
I2-ALBA-BOST-100GE-09210 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89763%99.90444%
I2-ALBA-CLEV-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94040%100.00000%
I2-ASHB-CHIC-100GE-11803 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.65675%99.79942%
I2-ASHB-PITT-100GE-07737 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78391%99.92601%
I2-ASHB-WASH-100GE-09106 0 hr 2 min0 hr 2 min 99.98016%99.98016% 99.66035%99.90274%
I2-ASHB-WASH-100GE-11823 0 hr 2 min0 hr 2 min 99.98016%99.98016% 99.58958%99.74682%
I2-ATLA-CHAR-100GE-07739 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-CINC-100GE-07740 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-HOUH-10GE-07742 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-JACK-100GE-07739 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91863%99.99868%
I2-ATLA-JCSN-100GE-10734 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784 0 hr 2 min0 hr 2 min 99.98016%99.98016% 99.25920%99.48853%
I2-ATLA-LOUI-100GE-07740 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.48059%99.64956%
I2-ATLA-CHAR-100GE-07738 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80548%99.88079%
I2-ATLA-WASH-100GE-54536 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.65997%99.83462%
I2-BATO-HOUH-100GE-08860 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94796%100.00000%
I2-BATO-JACK-100GE-11005 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.04367%99.25163%
I2-BOST-HART2-100GE-09211 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97975%99.98127%
I2-CHAR-RALE-100GE-10633 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94285%99.99849%
I2-CHIC-INDI-100GE-50993 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93926%99.99981%
I2-CINC-INDI-100GE-51692 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CINC-LOUI-100GE-54197 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76404%99.77293%
I2-CHIC-COLU4-100GE-11554 0 hr 0 min0 hr 0 min 100.00000%100.00000% 98.95398%99.11577%
I2-CHIC-KANS-100GE-07745 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85789%99.99622%
I2-CHIC-STAR-100GE-07743 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85525%100.00000%
I2-CLEV-EQCH-100GE-66186 0 hr 2 min0 hr 0 min 99.98016%100.00000% 99.99149%100.00000%
I2-CLEV-NEWY32AOA-100GE-07735 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CLEV-PITT-100GE-10334 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89290%99.98448%
I2-CLEV-STAR-100GE-07736 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-COLU4-KANS-100GE-11548 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92620%100.00000%
I2-DALL-HOUH-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.60831%99.74190%
I2-DALL-TULS-100GE-11300 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.66091%99.74966%
I2-DENV-ELPA-100GE-07748 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85222%99.99924%
I2-DENV-KANS-100GE-07746 9 hr 26 min9 hr 26 min 94.38492%94.38492% 99.47983%99.68854%
I2-DENV-SALT-100GE-07747 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91977%99.99924%
I2-ELPA-HOUH-100GE-07749 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.72639%99.87549%
I2-ELPA-PHOE-100GE-07750 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ELPA-TUCS-100GE-07750 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91996%100.00000%
I2-EQCH-STAR-100GE-09299 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91561%99.99981%
I2-EQCH-MINN-100GE-12184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.53395%99.73906%
I2-HART2-NEWY32AOA-100GE-12947 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91882%99.98959%
I2-HOUH-HOUS-100GE-09379 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92980%99.97710%
I2-HOUH-JCSN-100GE-10783 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89612%99.93245%
I2-HOUH-TULS-100GE-07751 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-KANS-MINN-100GE-12675 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.88855%99.96216%
I2-KANS-TULS-100GE-07753 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80718%99.99981%
I2-LASV-LOSA-100GE-53802 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96405%100.00000%
I2-LASV-SALT-100GE-07757 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.72336%99.90236%
I2-LOSA-PHOE-100GE-09190 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80775%99.94475%
I2-LOSA-SUNN-100GE-07755 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90123%99.99849%
I2-MINN-MISS2-100GE-09130 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.27093%99.61891%
I2-MISS2-SEAT-100GE-13237 0 hr 2 min0 hr 0 min 99.98016%100.00000% 99.50008%99.68911%
I2-NEWY23AOA-PHIL-100GE-07759 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.39071%99.48210%
I2-PHIL-WASH-100GE-10867 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.53830%99.66356%
I2-PHOE-TUCS-100GE-11990 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92791%99.99924%
I2-PORT-SEAT-100GE-08997 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85411%99.96556%
I2-PORT-SUNN-100GE-10343 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89536%99.95667%
I2-RALE-WASH-100GE-08888 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.83046%99.96348%
I2-SALT-SEAT-100GE-08998 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79810%99.99905%
I2-RENO-SALT-100GE-53725 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.77483%99.84768%
I2-RENO-SUNN-100GE-07766 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.60131%99.79110%

Aggregate All Unified - Internet2 Advanced Layer 2 Service Backbone Circuits 9 hr 36 min0 hr 4 min 99.90632%99.90697% 99.78006%99.88046%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:11623:144
Subject:Maintenance 2 of 2 - I2 Optical DWDM System DALL-TULS
Affected:DWDM System DALL-TULS
AL2S Backbone DALL-TULS
IP Backbone HOUS-KANS, HOUH-TULS
Optical Member ESnet
Optical Member NOAA N-Wave
Optical Member OneNet
Start Time:Saturday, January 14, 2017, 6:00 AM (0600) UTC
End Time:Saturday, January 14, 2017, 12:00 PM (1200) UTC
Description: The above listed assets will be unavailable while Level(3) Communications performs fiber relocation maintenance in Denton, TX. An outage is expected. The entire window is reserved. This is maintenance window 2 of 2.

Ticket No.:11771:144
Subject:Maintenance - I2 Optical DWDM System DENV-KANS
Affected:DWDM System DENV-KANS
AL2S Backbone DENV-KANS
IP Backbone KANS-SALT
Optical Member ESnet
Optical Member CENIC
Optical Member NOAA N-Wave
Peer GEANT
Start Time:Tuesday, January 17, 2017, 6:00 AM (0600) UTC
End Time:Tuesday, January 17, 2017, 12:00 PM (1200) UTC
Description: The above listed assets will be unavailable while Level(3) Communications performs maintenance to replace damaged cable on an abandoned Railroad bridge in Kansas City, MO. An outage of is expected. The entire window is reserved.

Ticket No.:11772:144
Subject:Maintenance - I2 AL2S Backbone EQCH-MINN
Affected:AL2S Backbone EQCH-MINN
Net+ Provider Code42 (CHIC)
Start Time:Tuesday, January 17, 2017, 7:00 AM (0700) UTC
End Time:Tuesday, January 17, 2017, 11:00 AM (1100) UTC
Description: The above listed asset will be unavailable while Zayo Engineers perform maintenance. An outage is expected. The entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:11761:144
Subject:Maintenance - I2 Optical Member ESnet
Affected:Member ESnet
Start Time:Wednesday, January 18, 2017, 5:00 AM (0500) UTC
End Time:Wednesday, January 18, 2017, 6:30 AM (0630) UTC
Description: Member ESnet's Optical circuit ESNET-NEWY32AOA-WASH-100GE-07598 will be unavailable while ESnet Engineers perform maintenance. A brief outage is expected, however the entire maintenance window has been reserved.

Ticket No.:11774:144
Subject:Maintenance - I2 Optical Node opt2.new32aoa
Affected:AL2S/AL3S Core Node NEWY (All Connections)
DWDM System NEWY1118TH-NEWY32AOA
AL2S Backbone HART2-NEWY32AOA & NEWY32AOA-PHIL
IP Backbones ASHB-NEWY32AOA & NEWY32AOA-WASH
Optical Member NOAA N-Wave
Optical Member ESNet
Optical Member MAX GigaPOP
Interconnect AL2S to EQNY
Interconnect MAN LAN to WIX (ANA)
Start Time:Friday, January 20, 2017, 5:00 AM (0500) UTC
End Time:Friday, January 20, 2017, 11:00 AM (1100) UTC
Description: The above listed will be unavailable while the Internet2 Optical Vendor performs maintenance to replace an optical chassis in New York City, NY. Outages are expected. The entire window is reserved.

Ticket No.:11730:144
Subject:Maintenance - I2 Optical Circuit GLOBAL-LOND-WASH2-100GE-01601
Affected:
Start Time:Monday, January 23, 2017, 5:00 AM (0500) UTC
End Time:Monday, January 23, 2017, 10:00 AM (1000) UTC
Description: *Maintenance Rescheduled* The above listed asset will be unavailable while vendor engineers perform maintenance. Outages are expected. The entire window is reserved.

Ticket No.:11739:144
Subject:Maintenance - I2 Optical Member NOAA N-Wave
Affected:Member NOAA N-Wave
Start Time:Thursday, January 26, 2017, 5:00 AM (0500) UTC
End Time:Thursday, January 26, 2017, 11:00 AM (1100) UTC
Description: Member NOAA N-Wave's Optical circuit I2-ATLA-CHAR-10GE-07618 will be unavailable while N-Wave Engineers perform maintenance. Outages are expected. The entire maintenance window has been reserved.

Ticket No.:11709:144
Subject:Maintenance - I2 Optical Member Center for Education Network Initiatives in California
Affected:Member Center for Education Network Initiatives in California
Start Time:Sunday, January 29, 2017, 8:00 PM (2000) UTC
End Time:Monday, January 30, 2017, 3:00 AM (0300) UTC
Description: Member Center for Education Network Initiatives in California's Optical circuit I2- SEAT-SUNN-100GE-07910 will be unavailable while CENIC Engineers perform maintenance. Outages are expected. The entire window is reserved.