Internet2 Advanced Layer 2 Service Network Operations Report
01/13/2014 - 01/19/2014

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Services

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Start Time (UTC)

End Time (UTC)





11952-High
2-High

Instability Resolved - I2 AL2S Backbone CLEV-STAR
Circuit - Bumped Fiber
01/13/2014 11:12 PM
01/13/2014 11:18 PM


12002-High
2-High

Brief Outage Resolved - I2 AL2S Backbone LOSA-PHOE
Power
01/14/2014 4:52 PM
01/14/2014 4:56 PM


12012-High
2-High

Brief Outage Resolved - I2 AL2S Backbone BATO-HOUH
Hardware
01/14/2014 6:12 PM
01/14/2014 6:13 PM


12082-High
2-High

Brief Outage Resolved - I2 AL2S Backbone MINN-SEAT
Circuit - Bumped Fiber
01/15/2014 5:12 PM
01/15/2014 5:13 PM


12102-High
2-High

Outage Resolved - I2 AL2S Backbone ASHB-PITT
Circuit - Damaged Fiber
01/16/2014 4:40 PM
01/17/2014 1:01 AM


12232-High
2-High

Brief Outage - I2 AL2S Backbone DENV-SALT
Undetermined
01/18/2014 1:16 PM
01/18/2014 1:17 PM






Unscheduled Outages Detail






Ticket No.:1195:135



Subject:Instability Resolved - I2 AL2S Backbone CLEV-STAR



Affected:Backbone CLEV-STAR



Start Time:Monday, January 13, 2014, 11:12 PM (2312) UTC



End Time:Monday, January 13, 2014, 11:18 PM (2318) UTC


Description:Backbone CLEV-STAR was briefly unstable. Level(3) Communications reports 
the reason for the instability was fiber disturbance caused by construction 
crews preparing for maintenance. Workgroup administrators receive 
notifications from OESS regarding circuits re-routed on the backbone.  No 
further instability is expected.







Ticket No.:1200:135



Subject:Brief Outage Resolved - I2 AL2S Backbone LOSA-PHOE



Affected:Backbone LOSA-PHOE



Start Time:Tuesday, January 14, 2014, 4:52 PM (1652) UTC



End Time:Tuesday, January 14, 2014, 4:56 PM (1656) UTC


Description:Backbone LOSA-PHOE was briefly unavailable. Internet2's layer 1
vendor is investigating the cause, preliminary investigation has revealed
that the outage was due to a power event in Pine Valley (Live Oak
Springs), CA. Workgroup administrators receive notifications from OESS
regarding circuits re-routed on the backbone.







Ticket No.:1201:135



Subject:Brief Outage Resolved - I2 AL2S Backbone BATO-HOUH



Affected:Backbone BATO-HOUH



Start Time:Tuesday, January 14, 2014, 6:12 PM (1812) UTC



End Time:Tuesday, January 14, 2014, 6:13 PM (1813) UTC


Description:Backbone BATO-HOUH was briefly unavailable. Internet2's fiber provider
advised that this was caused by a hardware issue. Workgroup
administrators receive notifications from OESS regarding circuits
briefly re-routed on the backbone.







Ticket No.:1208:135



Subject:Brief Outage Resolved - I2 AL2S Backbone MINN-SEAT



Affected:Backbone MINN-SEAT



Start Time:Wednesday, January 15, 2014, 5:12 PM (1712) UTC



End Time:Wednesday, January 15, 2014, 5:13 PM (1713) UTC


Description:Backbone MINN-SEAT was briefly unavailable. Internet2's circuit provider has indicated that the reason for the outage is a fiber disturbance. 
Workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone.







Ticket No.:1210:135



Subject:Outage Resolved - I2 AL2S Backbone ASHB-PITT



Affected:Backbone ASHB-PITT
Connector Three Rivers Optical Exchange (3ROX/PSC)



Start Time:Thursday, January 16, 2014, 4:40 PM (1640) UTC



End Time:Friday, January 17, 2014, 1:01 AM (0101) UTC


Description:Backbone ASHB-PITT is available.  Level(3) Communications technicians
have confirmed that Splicing has been completed. No further outages
are expected.







Ticket No.:1223:135



Subject:Brief Outage - I2 AL2S Backbone DENV-SALT



Affected:Backbone DENV-SALT



Start Time:Saturday, January 18, 2014, 1:16 PM (1316) UTC



End Time:Saturday, January 18, 2014, 1:17 PM (1317) UTC


Description:Backbones DENV-SALT was briefly unavailable. Internet2 Engineers are
investigating the cause; however, the reason for the outage is
pending. Workgroup administrators receive notifications from OESS
regarding circuits re-routed on the backbone.

*Please note the change to the affected; only DENV-SALT 07747 was
affected.*







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Start Time (UTC)
End Time (UTC)





1181
3-Elevated
2-High

Maintenance Completed - I2 AL2S Backbone CLEV-STAR
Circuit
01/14/2014 6:32 AM
01/14/2014 6:51 AM


1180
3-Elevated
2-High

Maintenance Completed - I2 AL2S Backbone PHIL-WASH
Hardware
01/15/2014 5:27 AM
01/15/2014 2:40 PM




Scheduled Maintenances Detail





Ticket No.:1181:135



Subject:Maintenance Completed - I2 AL2S Backbone CLEV-STAR



Affected:Backbone CLEV-STAR



Start Time:Tuesday, January 14, 2014, 6:32 AM (0632) UTC



End Time:Tuesday, January 14, 2014, 6:51 AM (0651) UTC


Description:   Backbone CLEV-STAR was unavailable while Level(3)
Communications relocated backbone cable in Chicago, IL. Backbone traffic
should have re-routed during this maintenance. Workgroup administrators will
receive notifications from OESS regarding circuits re-routed on the
backbone.  Maintenance has been completed.



  







Ticket No.:1180:135



Subject:Maintenance Completed - I2 AL2S Backbone PHIL-WASH



Affected:Backbone PHIL-WASH



Start Time:Wednesday, January 15, 2014, 5:27 AM (0527) UTC



End Time:Wednesday, January 15, 2014, 2:40 PM (1440) UTC


Description:   Backbone PHIL-WASH was unavailable while I2's Layer 1 vendor
Engineers performed maintenance.  Maintenance has been completed. Workgroup administrators will
receive notifications from OESS regarding circuits re-routed on the
backbone.



  










Downtime and Availability







Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability


sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99772%  100.00000%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97495%  100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99658%  100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95560%  100.00000%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97970%  100.00000%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84574%  99.86604%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98027%  100.00000%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97970%  100.00000%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97970%  100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98520%  99.98520%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97951%  100.00000%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97989%  100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98653%  100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98008%  100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99791%  100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962%  100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.69642%  99.73550%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97970%  100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99374%  100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97894%  100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97970%  100.00000%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97970%  100.00000%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97913%  100.00000%
      
Aggregate Internet2 Advanced Layer 2 Service Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.96985%99.98469%

 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


I2-ASHB-PITT-100GE-07737
               8 hr 21 min8 hr 21 min
               95.02976%95.02976%
               99.89811%99.89868%
I2-ATLA-CHAR-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-CHIC-100GE-07740
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.61616%99.69054%
I2-ATLA-HOUH-10GE-07742
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96148%99.96148%
I2-ATLA-JACK-100GE-07739
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99412%100.00000%
I2-ATLA-JCSN-100GE-10734
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-WASH-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99526%100.00000%
I2-BATO-HOUH-100GE-08860
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.99962%99.99962%
I2-BATO-JACK-100GE-11005
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99981%99.99981%
I2-CHAR-RALE-100GE-10633
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-CHIC-KANS-100GE-07745
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97230%100.00000%
I2-CHIC-STAR-100GE-07743
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.75581%99.77004%
I2-CLEV-NEWY32AOA-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.57366%99.60819%
I2-CLEV-PITT-100GE-10334
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99336%100.00000%
I2-CLEV-STAR-100GE-07736
               0 hr 25 min0 hr 6 min
               99.75198%99.94048%
               99.94782%99.99526%
I2-DENV-KANS-100GE-07746
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.86434%99.90912%
I2-DENV-SALT-100GE-07747
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.95617%99.99962%
I2-ELPA-HOUH-100GE-07749
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.37329%99.48163%
I2-ELPA-LOSA-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99981%100.00000%
I2-HOUH-JCSN-100GE-10783
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98520%99.98520%
I2-HOUH-TULS-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.67213%99.74461%
I2-KANS-TULS-100GE-07753
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91462%99.91519%
I2-LOSA-SALT-100GE-07757
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92638%99.93188%
I2-LOSA-SUNN-100GE-07755
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89716%99.89830%
I2-NEWY23AOA-PHIL-100GE-07759
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-PHIL-WASH-100GE-10867
               9 hr 13 min0 hr 0 min
               94.51389%100.00000%
               99.89451%100.00000%
I2-PORT-SEAT-100GE-08997
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-PORT-SUNN-100GE-10343
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99905%99.99962%
I2-SALT-SUNN-100GE-07766
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95541%99.96850%
      
Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits
                   18 hr 1 min9 hr 32 min
                   99.63020%99.82588%
                   99.90157%99.92267%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  

Upcoming Scheduled Maintenances





Ticket No.:1198:135



Subject:Maintenance 1 of 2 - I2 AL2S Backbone HOUH-TULS



Affected:Backbone HOUH-TULS



Start Time:Thursday, January 23, 2014, 6:00 AM (0600) UTC



End Time:Thursday, January 23, 2014, 8:00 AM (0800) UTC



Description:   Backbone HOUH-TULS will be unavailable while Internet2 Engineers 
perform maintenance to insert a new AL2S node in Dallas, TX.
After the maintenance Backbone HOUH-TULS will be broken into two
Backbones spanning DALL-HOUH and DALL-TULS. Outages are
expected and the entire window is reserved. Backbone traffic will re-
route
during this maintenance. Workgroup administrators will receive
notifications from OESS regarding circuits re-routed on the backbone.
An alternate window has been scheduled for 1-24-2014.



  







Ticket No.:1231:135



Subject:Maintenance *Tracking* 1 of 2 - I2 AL2S Backbone MINN-STAR



Affected:Backbone MINN-STAR



Start Time:Thursday, January 23, 2014, 6:01 AM (0601) UTC



End Time:Thursday, January 23, 2014, 11:00 AM (1100) UTC



Description:   Backbone MINN-STAR should remain available while Zayo Engineers perform maintenance.  No outage is expected; 
however, the entire window is reserved.  Backbone traffic will re-route during this maintenance. Workgroup administrators 
will receive notifications from OESS regarding circuits re-routed on the backbone.



  







Ticket No.:1226:135



Subject:Maintenance - I2 AL2S Backbones NEWY-PHIL and PHIL-WASH



Affected:Backbone NEWY-PHIL and PHIL-WASH
Connector MAGPI



Start Time:Friday, January 24, 2014, 5:00 AM (0500) UTC



End Time:Friday, January 24, 2014, 10:00 AM (1000) UTC



Description:   The above listed should remain available while
Internet2 Engineers perform software maintenance in New York, NY and
McLean, VA. No outage is expected; however the entire window is
reserved. Workgroup administrators will receive notifications from OESS
regarding circuits re-routed on the backbone.



  







Ticket No.:1199:135



Subject:Maintenance 2 of 2 - I2 AL2S Backbone HOUH-TULS



Affected:Backbone HOUH-TULS



Start Time:Friday, January 24, 2014, 6:00 AM (0600) UTC



End Time:Friday, January 24, 2014, 8:00 AM (0800) UTC



Description:   Backbone HOUH-TULS will be unavailable while Internet2 engineers
Engineers perform maintenance to insert a new AL2S node in Dallas, TX.
After the maintenance Backbone HOUH-TULS will be broken into two
Backbones spanning DALL-HOUH and DALL-TULS. Outages are expected
and
the entire window is reserved.
Backbone traffic will re-route during this maintenance. Workgroup
administrators will receive notifications from OESS regarding circuits
re-routed on the backbone.
This alternate window has been scheduled in case of need for work
started on 1-24-2014.



  







Ticket No.:1232:135



Subject:Maintenance *Tracking* 2 of 2 - I2 AL2S Backbone MINN-STAR



Affected:Backbone MINN-STAR



Start Time:Friday, January 24, 2014, 6:01 AM (0601) UTC



End Time:Friday, January 24, 2014, 11:00 AM (1100) UTC



Description:   Backbone MINN-STAR should remain available while Zayo Engineers 
perform maintenance.  No outage is expected;
however, the entire window is reserved.  Backbone traffic will re-route 
during this maintenance. Workgroup administrators
will receive notifications from OESS regarding circuits re-routed on the 
backbone.



  







Ticket No.:1177:135



Subject:Maintenance Window 1 of 2 - I2 AL2S Backbone MINN-SEAT



Affected:Backbone MINN-SEAT



Start Time:Friday, January 24, 2014, 8:01 AM (0801) UTC



End Time:Friday, January 24, 2014, 1:00 PM (1300) UTC



Description:   * Window 1 of 2
Backbone MINN-SEAT will be unavailable while Zayo Engineers perform 
maintenance.  An outage is expected, and the entire window is reserved.
Backbone traffic will re-route during this maintenance. Workgroup
administrators will receive notifications from OESS regarding circuits re-
routed on the backbone.



  







Ticket No.:1185:135



Subject:Maintenance 1 of 2 - I2 AL2S Backbone CHIC-NASH 



Affected:Backbone CHIC-NASH



Start Time:Wednesday, January 29, 2014, 5:00 AM (0500) UTC



End Time:Wednesday, January 29, 2014, 11:00 AM (1100) UTC



Description:   Backbone CHIC-NASH will be unavailable while vendor Engineers perform
maintenance.  Outages are expected, and the entire window is reserved.
 Backbone traffic will re-route during this maintenance. Workgroup
administrators will receive notifications from OESS regarding circuits
re-routed on the backbone. This is the first of two maintenance windows.



  







Ticket No.:1186:135



Subject:Maintenance 2 of 2 - I2 AL2S Backbone CHIC-NASH



Affected:Backbone CHIC-NASH



Start Time:Thursday, January 30, 2014, 5:00 AM (0500) UTC



End Time:Thursday, January 30, 2014, 11:00 AM (1100) UTC



Description:   Backbone CHIC-NASH will be unavailable while vendor Engineers perform
maintenance.  Outages are expected, and the entire window is reserved.
Backbone traffic will re-route during this maintenance. Workgroup
administrators will receive notifications from OESS regarding circuits
re-routed on the backbone. This is the second of two maintenance windows.



  







Ticket No.:1178:135



Subject:Maintenance Window 2 of 2 - I2 AL2S Backbone MINN-SEAT



Affected:Backbone MINN-SEAT



Start Time:Friday, January 31, 2014, 8:01 AM (0801) UTC



End Time:Friday, January 31, 2014, 1:00 PM (1300) UTC



Description:   * Maintenance Window 2 of 2
Backbone MINN-SEAT will be unavailable while Zayo Engineers perform 
maintenance.  An outage is expected, and the entire window is reserved.
Backbone traffic will re-route during this maintenance. Workgroup
administrators will receive notifications from OESS regarding circuits re-
routed on the backbone.