Internet2 Advanced Layer 2 Service Network Operations Report
06/02/2014 - 06/08/2014

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades
OESS 1.1.4, 06/02/2014 @ 08:00 UTC

OESS 1.1.4a, 06/05/2014 @ 22:00 UTC

New Network Resources

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Source Of Impact
Start Time (UTC)

End Time (UTC)





18122-High
2-High

Brief Outage - I2 AL2S Backbone PHIL-WASH
UndeterminedUndetermined
06/02/2014 8:57 PM
06/02/2014 8:58 PM


18222-High
2-High

Brief Outage Resolved - I2 AL2S Backbone ATLA-JCSN
SoftwareVendor
06/04/2014 6:50 AM
06/04/2014 6:51 AM


18232-High
2-High

Brief Outage Resolved - I2 AL2S Backbone CHIC-KANS
SoftwareVendor
06/04/2014 7:32 AM
06/04/2014 7:36 AM


18252-High
2-High

Brief Outage - I2 AL2S Backbone MINN-SEAT
UndeterminedUndetermined
06/04/2014 5:59 PM
06/04/2014 6:00 PM


18342-High
2-High

Brief Outage - I2 AL2S Backbone COLU4-KANS
UndeterminedUndetermined
06/05/2014 9:56 PM
06/05/2014 9:57 PM


18352-High
2-High

Availability - I2 AL2S Backbones CHIC-KANS and CHIC-COLU4
HardwareVendor
06/06/2014 8:55 AM
06/06/2014 9:52 AM






Unscheduled Outages Detail






Ticket No.:1812:135



Subject:Brief Outage - I2 AL2S Backbone PHIL-WASH



Source Of Impact:Undetermined



Affected:Backbone PHIL-WASH



Start Time:Monday, June 2, 2014, 8:57 PM (2057) UTC



End Time:Monday, June 2, 2014, 8:58 PM (2058) UTC


Description:Backbone PHIL-WASH was briefly unavailable. Internet2 Engineers are
investigating the cause; however, the reason for the outage is
pending. Workgroup administrators receive notifications from OESS
regarding circuits re-routed on the backbone.







Ticket No.:1822:135



Subject:Brief Outage Resolved - I2 AL2S Backbone ATLA-JCSN



Source Of Impact:Vendor



Affected:Backbone ATLA-JCSN



Start Time:Wednesday, June 4, 2014, 6:50 AM (0650) UTC



End Time:Wednesday, June 4, 2014, 6:51 AM (0651) UTC


Description:Backbone ATLA-JCSN was briefly unavailable. Level(3) Engineers have 
indicated that the reason for the outage is a problem with a software 
upgrade. Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.







Ticket No.:1823:135



Subject:Brief Outage Resolved - I2 AL2S Backbone CHIC-KANS



Source Of Impact:Vendor



Affected:Backbone CHIC-KANS



Start Time:Wednesday, June 4, 2014, 7:32 AM (0732) UTC



End Time:Wednesday, June 4, 2014, 7:36 AM (0736) UTC


Description:Backbone CHIC-KANS was briefly unavailable. Internet2 Fiber Vendor
experienced a software issue that caused this outage.   Workgroup
administrators receive notifications from OESS regarding circuits
re-routed on the backbone.







Ticket No.:1825:135



Subject:Brief Outage - I2 AL2S Backbone MINN-SEAT



Source Of Impact:Undetermined



Affected:Backbone MINN-SEAT



Start Time:Wednesday, June 4, 2014, 5:59 PM (1759) UTC



End Time:Wednesday, June 4, 2014, 6:00 PM (1800) UTC


Description:Backbone MINN-SEAT was briefly unavailable.  Zayo Engineers have stated 
that the reason for the outage is indeterminate.  Workgroup administrators 
receive notifications from OESS regarding circuits re-routed on the 
backbone.







Ticket No.:1834:135



Subject:Brief Outage - I2 AL2S Backbone COLU4-KANS



Source Of Impact:Undetermined



Affected:Backbone COLU4-KANS



Start Time:Thursday, June 5, 2014, 9:56 PM (2156) UTC



End Time:Thursday, June 5, 2014, 9:57 PM (2157) UTC


Description:Backbone COLU4-KANS was briefly unavailable. Internet2 Engineers are
investigating the cause; however, the reason for the outage is
pending. Workgroup administrators receive notifications from OESS
regarding circuits re-routed on the backbone.







Ticket No.:1835:135



Subject:Availability - I2 AL2S Backbones CHIC-KANS and CHIC-COLU4



Source Of Impact:Vendor



Affected:Backbone CHIC-KANS
Backbone CHIC-COLU4



Start Time:Friday, June 6, 2014, 8:55 AM (0855) UTC



End Time:Friday, June 6, 2014, 9:52 AM (0952) UTC


Description:Backbones CHIC-KANS and CHIC-COLU4 are now available. Level(3)
Communications Engineers report the outage was due to a card failure
in Plainfield, IL. Workgroup administrators received notifications from
OESS regarding circuits re-routed on the backbone.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Source Of Impact
Start Time (UTC)
End Time (UTC)





1789
3-Elevated
2-High

Maintenance Completed - I2 AL2S Backbone DENV-ELPA
Hardware
Vendor06/03/2014 5:00 AM
06/03/2014 6:01 AM




Scheduled Maintenances Detail





Ticket No.:1789:135



Subject:Maintenance Completed - I2 AL2S Backbone DENV-ELPA



Source Of Impact:Vendor



Affected:Backbone DENV-ELPA



Start Time:Tuesday, June 3, 2014, 5:00 AM (0500) UTC



End Time:Tuesday, June 3, 2014, 6:01 AM (0601) UTC


Description:   Backbone DENV-ELPA was unavailable while Level(3)
Communications performed maintenance to replace a faulted card in
Bernardo, NM.  Workgroup administrators received notifications from
OESS regarding
circuits re-routed on the backbone.



  










Downtime and Availability







Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability


sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99696%  100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99696%  100.00000%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%  100.00000%
sdn-sw.bato.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99564%  100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96376%  99.98975%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%  100.00000%
sdn-sw.colu4.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85770%  99.85902%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.eqch.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92752%  99.92885%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829%  100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98425%  99.98520%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99810%  99.99943%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886%  100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98596%  100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99715%  100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962%  100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956%  99.99886%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829%  100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99279%  100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99791%  100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%  100.00000%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%  100.00000%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99810%  100.00000%
      
Aggregate Internet2 Advanced Layer 2 Service Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.98960%99.99253%

 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


I2-ALBA-BOST-100GE-09210
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99393%99.99924%
I2-ALBA-CLEV-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98767%99.99981%
I2-ASHB-CHIC-100GE-11803
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98900%99.98975%
I2-ASHB-PITT-100GE-07737
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.86130%99.88065%
I2-ASHB-WASH-100GE-09106
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99886%99.99981%
I2-ASHB-WASH-100GE-11823
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-CHAR-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97932%99.97932%
I2-ATLA-CHIC-100GE-07740
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.86434%99.93568%
I2-ATLA-HOUH-10GE-07742
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JACK-100GE-07739
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99412%100.00000%
I2-ATLA-JCSN-100GE-10734
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.67934%99.72336%
I2-ATLA-WASH-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-BATO-HOUH-100GE-08860
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92543%99.92847%
I2-BATO-JACK-100GE-11005
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.86453%99.89488%
I2-BOST-NEWY32AOA-100GE-09211
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98634%100.00000%
I2-CHAR-RALE-100GE-10633
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97894%99.97970%
I2-CHIC-COLU4-100GE-11554
               0 hr 57 min0 hr 57 min
               99.43452%99.43452%
               99.97799%99.97875%
I2-CHIC-KANS-100GE-07745
               1 hr 1 min1 hr 1 min
               99.39484%99.39484%
               99.76928%99.91006%
I2-CHIC-STAR-100GE-07743
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.84100%99.86358%
I2-CLEV-NEWY32AOA-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98691%100.00000%
I2-CLEV-PITT-100GE-10334
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99336%100.00000%
I2-CLEV-STAR-100GE-07736
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95921%99.98596%
I2-COLU4-KANS-100GE-11548
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.98235%99.98235%
I2-DALL-HOUH-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92600%99.92866%
I2-DALL-TULS-100GE-11300
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.84403%99.84479%
I2-DENV-ELPA-100GE-07748
               1 hr 0 min0 hr 0 min
               99.40476%100.00000%
               99.98141%99.99279%
I2-DENV-KANS-100GE-07746
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.83910%99.88141%
I2-DENV-SALT-100GE-07747
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92676%99.96983%
I2-ELPA-HOUH-100GE-07749
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.40991%99.48163%
I2-ELPA-PHOE-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89716%99.91595%
I2-EQCH-STAR-100GE-09299
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99753%100.00000%
I2-EQCH-MINN-100GE-12184
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99753%100.00000%
I2-HOUH-JCSN-100GE-10783
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91310%99.91405%
I2-HOUH-TULS-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.68788%99.75068%
I2-KANS-TULS-100GE-07753
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99924%99.99981%
I2-LOSA-PHOE-100GE-09190
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.78616%99.80874%
I2-LOSA-SALT-100GE-07757
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.88464%99.93226%
I2-LOSA-SUNN-100GE-07755
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99829%99.99943%
I2-MINN-SEAT-100GE-09130
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.37538%99.54444%
I2-NEWY23AOA-PHIL-100GE-07759
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99905%99.99981%
I2-PHIL-WASH-100GE-10867
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.89356%99.99981%
I2-PORT-SEAT-100GE-08997
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99829%100.00000%
I2-PORT-SUNN-100GE-10343
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99829%99.99962%
I2-RALE-WASH-100GE-08888
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.79945%99.82829%
I2-SALT-SUNN-100GE-07766
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97666%99.99658%
      
Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits
                   3 hr 2 min1 hr 0 min
                   99.96075%99.97369%
                   99.90745%99.93087%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  

Upcoming Scheduled Maintenances





Ticket No.:1800:135



Subject:Maintenance - I2 AL2S Various Backbones



Affected:Backbone DENV-ELPA
Backbone ELPA-PHOE
Backbone LOSA-PHOE



Start Time:Wednesday, June 11, 2014, 4:00 AM (0400) UTC



End Time:Wednesday, June 11, 2014, 11:00 AM (1100) UTC



Description:   The above listed backbones will be unavailable while Level (3) 
Engineers perform software upgrade maintenance.  An outage is 
expected and the entire window is reserved.  Backbone traffic will re-
route during this maintenance. Workgroup administrators will
receive notifications from OESS regarding circuits re-routed on the
backbone.



  







Ticket No.:1804:135



Subject:Maintenance - I2 AL2S CLEV-STAR Backbone



Affected:Backbone CLEV-STAR



Start Time:Wednesday, June 11, 2014, 8:00 AM (0800) UTC



End Time:Wednesday, June 11, 2014, 10:00 AM (1000) UTC



Description:   Backbone CLEV-STAR will be unavailable while Internet2 Engineers 
perform maintenance to create a new AL2S Backbone. The entire window 
is reserved.  Backbone traffic will re-route during this maintenance. 
Workgroup administrators will receive notifications from OESS regarding 
circuits re-routed on the backbone.



  







Ticket No.:1836:135



Subject:Maintenance - I2 AL2S Backbones CHIC-KANS and CHIC-COLU4



Affected:Backbone CHIC-KANS
Backbone CHIC-COLU4



Start Time:Thursday, June 12, 2014, 2:00 AM (0200) UTC



End Time:Thursday, June 12, 2014, 4:00 AM (0400) UTC



Description:   Backbones CHIC-KANS and CHIC-COLU4 while Level(3) Communications 
performs maintenance to replace a card in Plainfield, IN. An outage is 
expected, and the entire window is reserved. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.



  







Ticket No.:1799:135



Subject:Maintenance - I2 AL2S Various Backbones



Affected:Backbone DENV-SALT
Backbone BATO-HOUH
Backbone SALT-SEAT



Start Time:Thursday, June 12, 2014, 4:00 AM (0400) UTC



End Time:Thursday, June 12, 2014, 11:00 AM (1100) UTC



Description:   The backbones listed above will be unavailable while
Level(3) Engineers perform software update
maintenance. Outages are expected and the entire window is 
reserved.  Backbone traffic will re-route during this maintenance. 
Workgroup administrators will receive notifications from OESS 
regarding circuits re-routed on the backbones.



  







Ticket No.:1807:135



Subject:Maintenance - I2 ALS2 Backbone EQCH-STAR 



Affected:Backbone EQCH-STAR



Start Time:Thursday, June 12, 2014, 9:00 AM (0900) UTC



End Time:Thursday, June 12, 2014, 10:00 AM (1000) UTC



Description:   Backbone EQCH-STAR will be unavailable while Internet2 Engineers
perform maintenance.  Outages are expected, and the entire window is
reserved.  Backbone traffic will re-route during this maintenance.
Workgroup administrators will receive notifications from OESS
regarding circuits re-routed on the backbone.



  







Ticket No.:1596:135



Subject:Maintenance - I2 AL2S Backbone MINN-SEAT



Affected:Backbone MINN-SEAT



Start Time:Saturday, June 14, 2014, 1:00 PM (1300) UTC



End Time:Saturday, June 14, 2014, 11:00 PM (2300) UTC



Description:   Backbone MINN-SEAT will be unavailable while our fiber provider's third
party provider performs a cable relocation in Judson and Dickinson, ND.
This work must take place during daylight hours as the cable is located
along the railroad. An outage of up to 3 hours is expected; however the
entire window has been reserved.



  







Ticket No.:1817:135



Subject:Maintenance - I2 AL2S Various Backbones



Affected:Backbone ASHB-PITT
Backbone ASHB-WASH
Backbone CHIC-STAR
Backbone CLEV-PITT
Backbone CLEV-STAR
Backbone KANS-TULS
Backbone ASHB-CHIC
Backbone ASHB-WASH
Backbone ATLA-CHIC



Start Time:Thursday, June 26, 2014, 4:00 AM (0400) UTC



End Time:Thursday, June 26, 2014, 11:00 AM (1100) UTC



Description:   The backbones listed above will be unavailable while Level(3)
Commincations Engineers perform maintenance.  Outages are expected;
however, the entire window is reserved.  Backbone traffic will
re-route during this maintenance. Workgroup administrators will
receive notifications from OESS regarding circuits re-routed on the
backbone.



  







Ticket No.:1818:135



Subject:Maintenance - I2 AL2S Various Backbones



Affected:Backbone BOST-NEWY32AOA
Backbone LOSA-SUNN
Backbone NEWY32A0A-PHIL
Backbone PHIL-WASH
Backbone CHIC-COLU4



Start Time:Friday, June 27, 2014, 4:00 AM (0400) UTC



End Time:Friday, June 27, 2014, 11:00 AM (1100) UTC



Description:   The backbones listed above will be unavailable while Level(3)
Communications Engineers perform maintenance.  Outages are expected,
and the entire window is reserved.  Backbone traffic will re-route
during this maintenance. Workgroup administrators will receive
notifications from OESS regarding circuits re-routed on the backbone.



  







Ticket No.:1820:135



Subject:Maintenance - I2 AL2S Various Backbones



Affected:Backbone ATLA-JCSN
Backbone ATLA-CHIC
Backbone CHAR-RALE
Backbone CHIC-KANS
Backbone DALL-HOUH
Backbone RALE-WASH



Start Time:Sunday, June 29, 2014, 4:00 AM (0400) UTC



End Time:Sunday, June 29, 2014, 11:00 AM (1100) UTC



Description:   The above listed backbones will be unavailable while Level(3) Engineers 
perform maintenance.  Outages are expected; however, the entire window 
is reserved.  Backbone traffic will re-route during this maintenance. 
Workgroup administrators will receive notifications from OESS regarding 
circuits re-routed on the backbone.