Internet2 Advanced Layer 2 Service Network Operations Report
07/28/2014 - 08/03/2014

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Network Resources

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Source Of Impact
Start Time (UTC)

End Time (UTC)





20292-High
2-High

Brief Outage - I2 AL2S Backbone CLEV-EQCH
InvestigatingUndetermined
07/29/2014 12:05 AM
07/29/2014 12:06 AM


20332-High
2-High

Outage Resolved - I2 AL2S Backbones ASHB-CHIC, CLEV-EQCH
Cut or Damaged FiberVendor
07/30/2014 1:43 PM
07/30/2014 9:26 PM


20362-High
2-High

Outage Resolved - I2 AL2S Backbone MINN-SEAT
Cut or Damaged FiberVendor
07/30/2014 4:14 PM
07/30/2014 11:23 PM


20382-High
2-High

Brief Outage - I2 AL2S Backbone MINN-SEAT
UndeterminedUndetermined
07/31/2014 7:48 AM
07/31/2014 7:49 AM


20452-High
2-High

Brief Outage - I2 AL2S Backbone PHIL-WASH
InvestigatingUndetermined
08/02/2014 8:43 AM
08/02/2014 8:44 AM


20462-High
2-High

Brief Outage - I2 AL2S Backbone BATO-JACK
InvestigatingUndetermined
08/03/2014 9:43 PM
08/03/2014 9:44 PM






Unscheduled Outages Detail






Ticket No.:2029:135



Subject:Brief Outage - I2 AL2S Backbone CLEV-EQCH



Source Of Impact:Undetermined



Affected:Backbone CLEV-EQCH



Start Time:Tuesday, July 29, 2014, 12:05 AM (0005) UTC



End Time:Tuesday, July 29, 2014, 12:06 AM (0006) UTC


Description:Backbone CLEV-EQCH was briefly unavailable. Internet2 Engineers are
investigating the cause; however, the reason for the outage is
pending. Workgroup administrators receive notifications from OESS
regarding circuits re-routed on the backbone.







Ticket No.:2033:135



Subject:Outage Resolved - I2 AL2S Backbones ASHB-CHIC, CLEV-EQCH



Source Of Impact:Vendor



Affected:Backbone CLEV-EQCH
Backbone ASHB-CHIC



Start Time:Wednesday, July 30, 2014, 1:43 PM (1343) UTC



End Time:Wednesday, July 30, 2014, 9:26 PM (2126) UTC


Description:The above listed backbones are now available.  Internet2's fiber provider
has indicated that the reason for the outage was fiber damage due to
construction.  All repair work as been completed and no further outages 
are expected.  Workgroup administrators receive notifications from OESS 
regarding circuits re-routed on the backbone.







Ticket No.:2036:135



Subject:Outage Resolved - I2 AL2S Backbone MINN-SEAT



Source Of Impact:Vendor



Affected:Backbone MINN-SEAT



Start Time:Wednesday, July 30, 2014, 4:14 PM (1614) UTC



End Time:Wednesday, July 30, 2014, 11:23 PM (2323) UTC


Description:Backbone MINN-SEAT is now available. Internet2's fiber provider has
indicated that the outage is due to fiber damage, which has now been 
repaired.  No further outages are expected.  Workgroup administrators 
receive notifications from OESS regarding circuits re-routed on the 
backbone.







Ticket No.:2038:135



Subject:Brief Outage - I2 AL2S Backbone MINN-SEAT



Source Of Impact:Undetermined



Affected:Backbone MINN-SEAT



Start Time:Thursday, July 31, 2014, 7:48 AM (0748) UTC



End Time:Thursday, July 31, 2014, 7:49 AM (0749) UTC


Description:Backbone MINN-SEAT was briefly unavailable. Internet2's fiber vendor
indicates that the root cause is undetermined. Workgroup
administrators receive notifications from OESS
regarding circuits re-routed on the backbone.







Ticket No.:2045:135



Subject:Brief Outage - I2 AL2S Backbone PHIL-WASH



Source Of Impact:Undetermined



Affected:Backbone PHIL-WASH



Start Time:Saturday, August 2, 2014, 8:43 AM (0843) UTC



End Time:Saturday, August 2, 2014, 8:44 AM (0844) UTC


Description:Backbone PHIL-WASH was briefly unavailable. Internet2 Engineers are
investigating the cause; however, the reason for the outage is
pending. Workgroup administrators receive notifications from OESS
regarding circuits re-routed on the backbone.







Ticket No.:2046:135



Subject:Brief Outage - I2 AL2S Backbone BATO-JACK



Source Of Impact:Undetermined



Affected:Backbone BATO-JACK



Start Time:Sunday, August 3, 2014, 9:43 PM (2143) UTC



End Time:Sunday, August 3, 2014, 9:44 PM (2144) UTC


Description:Backbone BATO-JACK was briefly unavailable. Internet2's fiber provider is
investigating the cause; however, the reason for the outage is
pending. Workgroup administrators receive notifications from OESS
regarding circuits re-routed on the backbone.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Source Of Impact
Start Time (UTC)
End Time (UTC)





2021
3-Elevated
2-High

Maintenance Completed - I2 AL2S Backbone LOSA-PHOE
Circuit
Vendor07/28/2014 5:24 AM
07/28/2014 7:28 AM


2014
3-Elevated
1-Critical

Maintenance Completed - I2 AL2S Core Node WASH
PowerInternal
07/29/2014 4:02 AM
07/29/2014 6:49 AM


2007
3-Elevated
3-Elevated

Maintenance Completed - I2 AL2S Backbone COLU4-KANS
Circuit
Vendor07/29/2014 5:20 AM
07/29/2014 6:46 AM


2041
3-Elevated
2-High

Emergency Maintenance Completed - I2 AL2S Backbone PORT-SUNN
CircuitVendor
08/01/2014 7:10 AM
08/01/2014 7:40 AM




Scheduled Maintenances Detail





Ticket No.:2021:135



Subject:Maintenance Completed - I2 AL2S Backbone LOSA-PHOE



Source Of Impact:Vendor



Affected:Backbone LOSA-PHOE



Start Time:Monday, July 28, 2014, 5:24 AM (0524) UTC



End Time:Monday, July 28, 2014, 7:28 AM (0728) UTC


Description:   Backbone LOSA-PHOE was unavailable while Internet2's fiber provider
performed circuit maintenance.  Maintenance has been completed. 
Backbone traffic re-routed during this maintenance. Workgroup
administrators will receive notifications from OESS regarding circuits
re-routed on the backbone.



  







Ticket No.:2014:135



Subject:Maintenance Completed - I2 AL2S Core Node WASH



Source Of Impact:Internal



Affected:Core Node WASH
AL2S to IP Interconnect



Start Time:Tuesday, July 29, 2014, 4:02 AM (0402) UTC



End Time:Tuesday, July 29, 2014, 6:49 AM (0649) UTC


Description:   Core Node WASH was  unavailable while Internet2 Engineers executed
power maintenance. Outages were experienced during the window. The 
maintenance is now complete.



  







Ticket No.:2007:135



Subject:Maintenance Completed - I2 AL2S Backbone COLU4-KANS



Source Of Impact:Vendor



Affected:Backbone COLU4-KANS



Start Time:Tuesday, July 29, 2014, 5:20 AM (0520) UTC



End Time:Tuesday, July 29, 2014, 6:46 AM (0646) UTC


Description:   Backbone COLU4-KANS was involved in a maintenance being executed by
Internet2 fiber vendor. This was not supposed to be service impacting,
however it was.  Maintenance has been completed and services have
restored.



  







Ticket No.:2041:135



Subject:Emergency Maintenance Completed - I2 AL2S Backbone PORT-SUNN



Source Of Impact:Vendor



Affected:Backbone PORT-SUNN



Start Time:Friday, August 1, 2014, 7:10 AM (0710) UTC



End Time:Friday, August 1, 2014, 7:40 AM (0740) UTC


Description:   Backbone PORT-SUNN was unavailable while Level(3) Communications 
performed emergency maintenance to relocate cable to a new bridge in 
Oregon, which is completed.  Backbone traffic re-routed during this 
maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.



  










Downtime and Availability







Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability


sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.bato.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99772%  100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96471%  99.98975%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.colu4.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85864%  99.85902%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.eqch.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92828%  99.92885%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96319%  100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98425%  99.98520%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886%  99.99943%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98596%  100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962%  100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962%  100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99810%  99.99886%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%  100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98444%  100.00000%
sdn-sw.wash.net.internet2.edu 2 hr 47 min0 hr 0 min 98.34325%100.00000% 99.95105%  99.98387%
      
Aggregate Internet2 Advanced Layer 2 Service Core Nodes2 hr 47 min0 hr 47 min99.94823%100.00000%99.98758%99.99203%

 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


I2-ALBA-BOST-100GE-09210
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98634%100.00000%
I2-ALBA-CLEV-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97932%99.99981%
I2-ASHB-CHIC-100GE-11803
               7 hr 43 min7 hr 43 min
               95.40675%95.40675%
               99.81026%99.90190%
I2-ASHB-PITT-100GE-07737
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.77117%99.88065%
I2-ASHB-WASH-100GE-09106
               2 hr 47 min0 hr 0 min
               98.34325%100.00000%
               99.86092%99.98368%
I2-ASHB-WASH-100GE-11823
               2 hr 47 min0 hr 0 min
               98.34325%100.00000%
               99.86092%99.98311%
I2-ATLA-CHAR-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96812%99.97932%
I2-ATLA-CHIC-100GE-07740
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.52546%99.71577%
I2-ATLA-HOUH-10GE-07742
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JACK-100GE-07739
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95617%100.00000%
I2-ATLA-JCSN-100GE-10734
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.44824%99.50345%
I2-ATLA-WASH-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-BATO-HOUH-100GE-08860
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.90361%99.92847%
I2-BATO-JACK-100GE-11005
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.62394%99.73209%
I2-BOST-NEWY32AOA-100GE-09211
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98160%100.00000%
I2-CHAR-RALE-100GE-10633
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96774%99.97970%
I2-CHIC-COLU4-100GE-11554
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94403%99.97856%
I2-CHIC-KANS-100GE-07745
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.72905%99.91006%
I2-CHIC-STAR-100GE-07743
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.67384%99.78597%
I2-CLEV-EQCH-100GE-07736
               7 hr 44 min7 hr 44 min
               95.39683%95.39683%
               99.91196%99.91196%
I2-CLEV-NEWY32AOA-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99962%100.00000%
I2-CLEV-PITT-100GE-10334
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.90323%100.00000%
I2-CLEV-STAR-100GE-07736
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.86737%99.98596%
I2-COLU4-KANS-100GE-11548
               1 hr 26 min0 hr 0 min
               99.14683%100.00000%
               99.96566%99.98235%
I2-DALL-HOUH-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.82980%99.87325%
I2-DALL-TULS-100GE-11300
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.82886%99.84460%
I2-DENV-ELPA-100GE-07748
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97875%99.99260%
I2-DENV-KANS-100GE-07746
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.70458%99.74727%
I2-DENV-SALT-100GE-07747
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.83132%99.86775%
I2-ELPA-HOUH-100GE-07749
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.33155%99.39170%
I2-ELPA-PHOE-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89507%99.91595%
I2-ELPA-TUCS-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-EQCH-STAR-100GE-09299
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96300%99.97439%
I2-EQCH-MINN-100GE-12184
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99753%100.00000%
I2-HOUH-JCSN-100GE-10783
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91177%99.91405%
I2-HOUH-TULS-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.68940%99.75068%
I2-KANS-TULS-100GE-07753
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89413%99.99981%
I2-LOSA-PHOE-100GE-09190
               2 hr 4 min0 hr 0 min
               98.76984%100.00000%
               99.76055%99.80874%
I2-LOSA-SALT-100GE-07757
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.88730%99.93226%
I2-LOSA-SUNN-100GE-07755
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99374%99.99962%
I2-MINN-SEAT-100GE-09130
               7 hr 10 min7 hr 10 min
               95.73413%95.73413%
               99.22738%99.45488%
I2-NEWY23AOA-PHIL-100GE-07759
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99431%99.99981%
I2-PHIL-WASH-100GE-10867
               2 hr 48 min0 hr 1 min
               98.33333%99.99008%
               99.84081%99.98349%
I2-PORT-SEAT-100GE-08997
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98900%100.00000%
I2-PORT-SUNN-100GE-10343
               0 hr 30 min0 hr 0 min
               99.70238%100.00000%
               99.98273%99.99810%
I2-RALE-WASH-100GE-08888
               2 hr 47 min0 hr 0 min
               98.34325%100.00000%
               99.74025%99.81197%
I2-SALT-SUNN-100GE-07766
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97780%99.99545%
      
Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits
                   37 hr 47 min15 hr 8 min
                   99.53146%99.71912%
                   99.85184%99.90415%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  

Upcoming Scheduled Maintenances





Ticket No.:2042:135



Subject:Maintenance - I2 AL2S Backbone BATO-JACK 



Affected:Backbone BATO-JACK



Start Time:Friday, August 8, 2014, 4:00 AM (0400) UTC



End Time:Friday, August 8, 2014, 9:00 AM (0900) UTC



Description:   Backbone BATO-JACK will be unavailable while fiber provider Engineers 
perform maintenance in Tallahassee, FL.  Outages are expected, and the 
entire window is reserved.  Backbone traffic will re-route during this 
maintenance. Workgroup administrators will receive notifications from 
OESS regarding circuits re-routed on the backbone.