Internet2 Advanced Layer 2 Service Network Operations Report
07/14/2014 - 07/20/2014

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Network Resources

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Source Of Impact
Start Time (UTC)

End Time (UTC)





19831-Critical
1-Critical

Outage Resolved - I2 AL2S Core Node WASH
SoftwareVendor
07/14/2014 4:33 AM
07/14/2014 5:58 AM


19872-High
2-High

Brief Outage Resolved - I2 AL2S Backbone ELPA-HOUH
PowerVendor
07/14/2014 5:38 PM
07/14/2014 5:42 PM






Unscheduled Outages Detail






Ticket No.:1983:135



Subject:Outage Resolved - I2 AL2S Core Node WASH



Source Of Impact:Vendor



Affected:Core Node WASH



Start Time:Monday, July 14, 2014, 4:33 AM (0433) UTC



End Time:Monday, July 14, 2014, 5:58 AM (0558) UTC


Description:Core Node WASH is now available after a hardware failure.  Internet2
Engineers have indicated that a switch module failure caused an
isolation of the core node. Internet2 Engineers are investigating the
long term resolution of this issue. All connections to the Core Node
were affected.







Ticket No.:1987:135



Subject:Brief Outage Resolved - I2 AL2S Backbone ELPA-HOUH



Source Of Impact:Vendor



Affected:Backbone ELPA-HOUH



Start Time:Monday, July 14, 2014, 5:38 PM (1738) UTC



End Time:Monday, July 14, 2014, 5:42 PM (1742) UTC


Description:Backbone ELPA-HOUH is currently available to the
community after a brief outage.  Internet2's fiber vendor report the reason for outage was due to a power event that has been resolved. Workgroup administrators receive notifications
from OESS regarding circuits re-routed on the backbone.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Source Of Impact
Start Time (UTC)
End Time (UTC)





1961
3-Elevated
1-Critical

Maintenance Completed - I2 AL2S Core Node JACK
Software
Internal07/16/2014 5:01 AM
07/16/2014 8:12 AM


1966
3-Elevated
1-Critical

Maintenance Completed - I2 AL2S Core Node TULS
SoftwareInternal
07/16/2014 6:10 AM
07/16/2014 7:29 AM


1942
3-Elevated
2-High

Maintenance Completed - I2 AL2S Backbone ATLA-CHIC
Hardware
Vendor07/17/2014 7:16 AM
07/17/2014 7:19 AM


1949
3-Elevated
3-Elevated

Maintenance Completed - I2 AL2S Backbone MINN-SEAT
CircuitVendor
07/20/2014 2:06 PM
07/20/2014 4:41 PM




Scheduled Maintenances Detail





Ticket No.:1961:135



Subject:Maintenance Completed - I2 AL2S Core Node JACK



Source Of Impact:Internal



Affected:Core Node JACK



Start Time:Wednesday, July 16, 2014, 5:01 AM (0501) UTC



End Time:Wednesday, July 16, 2014, 8:12 AM (0812) UTC


Description:   Core Node JACK was unavailable while Internet2 Engineers performed
a Software Upgrade.  The maintenance has been completed. The upgrade
has been reverted; notification will be provided for a new maintenance
window.Backbone traffic was re-routed during this maintenance.
Workgroup administrators  received notifications from OESS regarding
circuits re-routed on the backbone.



  







Ticket No.:1966:135



Subject:Maintenance Completed - I2 AL2S Core Node TULS



Source Of Impact:Internal



Affected:Core Node TULS



Start Time:Wednesday, July 16, 2014, 6:10 AM (0610) UTC



End Time:Wednesday, July 16, 2014, 7:29 AM (0729) UTC


Description:   Core Node TULS was unavailable while Internet2 Engineers performed a
Software Upgrade. The upgrade was reverted; notification will be
provided for a new maintenance window. All connections to the Core
Node were affected.  Backbone traffic was re-routed during this
maintenance. The maintenance has been completed. Workgroup
administrators received notifications from OESS regarding circuits
re-routed on the backbone.



  







Ticket No.:1942:135



Subject:Maintenance Completed - I2 AL2S Backbone ATLA-CHIC



Source Of Impact:Vendor



Affected:Backbone ATLA-CHIC



Start Time:Thursday, July 17, 2014, 7:16 AM (0716) UTC



End Time:Thursday, July 17, 2014, 7:19 AM (0719) UTC


Description:   Backbone ATLA-CHIC was unavailable while Level(3)
Communications performed hardware maintenance in Louisville, KY.
Maintenance has been completed. No further outages are expected.  
Backbone traffic re-routed during this maintenance. Workgroup 
administrators will receive notifications from OESS regarding circuits re-
routed on the backbone.



  







Ticket No.:1949:135



Subject:Maintenance Completed - I2 AL2S Backbone MINN-SEAT



Source Of Impact:Vendor



Affected:Backbone MINN-SEAT



Start Time:Sunday, July 20, 2014, 2:06 PM (1406) UTC



End Time:Sunday, July 20, 2014, 4:41 PM (1641) UTC


Description:   Backbone MINN-SEAT was unavailable while Zayo Engineers performed
fiber relocation in Judson, ND. Outages were expected throughout the entire 
window. Backbone traffic re-routed during this maintenance. No further 
outages are anticipated. Maintenance has been completed.



  










Downtime and Availability







Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability


sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.bato.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99772%  100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96471%  99.98975%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.colu4.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85864%  99.85902%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.eqch.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92828%  99.92885%
sdn-sw.jack.net.internet2.edu 3 hr 11 min0 hr 0 min 98.10516%100.00000% 99.96319%  100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98425%  99.98520%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886%  99.99943%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98596%  100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962%  100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962%  100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99810%  99.99886%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%  100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.tuls.net.internet2.edu 1 hr 19 min0 hr 0 min 99.21627%100.00000% 99.98444%  100.00000%
sdn-sw.wash.net.internet2.edu 1 hr 25 min1 hr 25 min 99.15675%99.15675% 99.98273%  99.98387%
      
Aggregate Internet2 Advanced Layer 2 Service Core Nodes5 hr 55 min1 hr 55 min99.88994%99.97365%99.98857%99.99203%

 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


I2-ALBA-BOST-100GE-09210
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98634%100.00000%
I2-ALBA-CLEV-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97932%99.99981%
I2-ASHB-CHIC-100GE-11803
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89811%99.98975%
I2-ASHB-PITT-100GE-07737
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.77117%99.88065%
I2-ASHB-WASH-100GE-09106
               1 hr 25 min1 hr 25 min
               99.15675%99.15675%
               99.89261%99.98368%
I2-ASHB-WASH-100GE-11823
               1 hr 25 min1 hr 25 min
               99.15675%99.15675%
               99.89261%99.98311%
I2-ATLA-CHAR-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96812%99.97932%
I2-ATLA-CHIC-100GE-07740
               0 hr 3 min0 hr 0 min
               99.97024%100.00000%
               99.52546%99.71577%
I2-ATLA-HOUH-10GE-07742
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JACK-100GE-07739
               3 hr 11 min0 hr 0 min
               98.10516%100.00000%
               99.95617%100.00000%
I2-ATLA-JCSN-100GE-10734
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.44843%99.50364%
I2-ATLA-WASH-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-BATO-HOUH-100GE-08860
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.90361%99.92847%
I2-BATO-JACK-100GE-11005
               3 hr 11 min0 hr 0 min
               98.10516%100.00000%
               99.62470%99.73285%
I2-BOST-NEWY32AOA-100GE-09211
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98160%100.00000%
I2-CHAR-RALE-100GE-10633
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96774%99.97970%
I2-CHIC-COLU4-100GE-11554
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95978%99.97856%
I2-CHIC-KANS-100GE-07745
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.74480%99.91006%
I2-CHIC-STAR-100GE-07743
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.67099%99.78370%
I2-CLEV-EQCH-100GE-07736
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-CLEV-NEWY32AOA-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99962%100.00000%
I2-CLEV-PITT-100GE-10334
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.90323%100.00000%
I2-CLEV-STAR-100GE-07736
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.86737%99.98596%
I2-COLU4-KANS-100GE-11548
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98197%99.98235%
I2-DALL-HOUH-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.82980%99.87325%
I2-DALL-TULS-100GE-11300
               1 hr 19 min0 hr 0 min
               99.21627%100.00000%
               99.82886%99.84460%
I2-DENV-ELPA-100GE-07748
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97875%99.99260%
I2-DENV-KANS-100GE-07746
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.83872%99.88141%
I2-DENV-SALT-100GE-07747
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93340%99.96983%
I2-ELPA-HOUH-100GE-07749
               0 hr 4 min0 hr 4 min
               99.96032%99.96032%
               99.33421%99.39170%
I2-ELPA-PHOE-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89507%99.91595%
I2-ELPA-TUCS-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-EQCH-STAR-100GE-09299
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96300%99.97439%
I2-EQCH-MINN-100GE-12184
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99753%100.00000%
I2-HOUH-JCSN-100GE-10783
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91177%99.91405%
I2-HOUH-TULS-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.68788%99.75068%
I2-KANS-TULS-100GE-07753
               1 hr 19 min0 hr 0 min
               99.21627%100.00000%
               99.89413%99.99981%
I2-LOSA-PHOE-100GE-09190
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.78408%99.80874%
I2-LOSA-SALT-100GE-07757
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.88293%99.93226%
I2-LOSA-SUNN-100GE-07755
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99355%99.99943%
I2-MINN-SEAT-100GE-09130
               2 hr 35 min0 hr 0 min
               98.46230%100.00000%
               99.31675%99.54425%
I2-NEWY23AOA-PHIL-100GE-07759
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99431%99.99981%
I2-PHIL-WASH-100GE-10867
               1 hr 25 min1 hr 25 min
               99.15675%99.15675%
               99.87269%99.98368%
I2-PORT-SEAT-100GE-08997
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98900%100.00000%
I2-PORT-SUNN-100GE-10343
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98843%99.99810%
I2-RALE-WASH-100GE-08888
               1 hr 25 min1 hr 25 min
               99.15675%99.15675%
               99.77193%99.81197%
I2-SALT-SUNN-100GE-07766
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97287%99.99545%
      
Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits
                   17 hr 22 min11 hr 38 min
                   99.78464%99.92890%
                   99.86632%99.91457%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  

Upcoming Scheduled Maintenances





Ticket No.:2012:135



Subject:Maintenance - I2 AL2S Connector Southern Crossroads (SOX; ATLA)



Affected:Connector Southern Crossroads (SOX)



Start Time:Thursday, July 24, 2014, 8:00 AM (0800) UTC



End Time:Thursday, July 24, 2014, 9:00 AM (0900) UTC



Description:   Connector Southern Crossroads (SOX)  will be unavailable while
Southern Crossroads (SOX) Engineers perform fiber cleaning
maintenance.  An outage of 15 minutes is expected; however, the entire
window is reserved.



  







Ticket No.:2006:135



Subject:Maintenance - I2 AL2S Backbone DENV-SALT



Affected:Backbone DENV-SALT



Start Time:Friday, July 25, 2014, 10:00 AM (1000) UTC



End Time:Friday, July 25, 2014, 12:00 PM (1200) UTC



Description:   The above listed will become available while vendor engineers perform 
maintenance to replace a faulty CFP in Denver, CO.  Outages are 
anticipated and the entire maintenance window has been reserved.



  







Ticket No.:2014:135



Subject:Maintenance - I2 AL2S Core Node WASH



Affected:Core Node WASH
AL2S to IP Interconnect



Start Time:Tuesday, July 29, 2014, 4:00 AM (0400) UTC



End Time:Tuesday, July 29, 2014, 6:00 AM (0600) UTC



Description:   Core Node WASH will be unavailable while Internet2 Engineers execute
power maintenance. Outages are expected during the window. The entire
window is reserved. All connections to the core node will be affected.



  







Ticket No.:2007:135



Subject:Maintenance - I2 AL2S Backbone COLU4-KANS



Affected:Backbone COLU4-KANS



Start Time:Tuesday, July 29, 2014, 5:00 AM (0500) UTC



End Time:Tuesday, July 29, 2014, 10:00 AM (1000) UTC



Description:   Backbone COLU4-KANS is involved in a maintenance being executed by an
Internet2 fiber vendor.  No outages are expected.  The entire window
is reserved.



  







Ticket No.:2010:135



Subject:Maintenance 1 of 2 - I2 AL2S Backbones  ATLA-CHIC and ATLA-JCSN 



Affected:Backbone ATLA-CHIC
Backbone ATLA-JCSN



Start Time:Friday, August 1, 2014, 4:00 AM (0400) UTC



End Time:Friday, August 1, 2014, 10:00 AM (1000) UTC



Description:   Backbones ATLA-CHIC and ATLA-JCSN will be unavailable while fiber
provider Engineers perform maintenance.  An outage is expected, and
the entire window is reserved.  Backbone traffic will re-route during
this maintenance. Workgroup administrators will receive notifications
from OESS regarding circuits re-routed on the backbone. This is the
first of two maintenance windows.



  







Ticket No.:2011:135



Subject:Maintenance 2 of 2 - I2 AL2S Backbones ATLA-CHIC and ATLA-JCSN



Affected:Backbone ATLA-CHIC
Backbone ATLA-JCSN



Start Time:Saturday, August 2, 2014, 4:00 AM (0400) UTC



End Time:Saturday, August 2, 2014, 10:00 AM (1000) UTC



Description:   Backbones ATLA-CHIC and ATLA-JCSN will be unavailable while fiber
provider Engineers perform maintenance.  An outage is expected, and
the entire window is reserved.  Backbone traffic will re-route during
this maintenance. Workgroup administrators will receive notifications
from OESS regarding circuits re-routed on the backbone. This is the
second of two maintenance windows.