Internet2 Advanced Layer 2 Service Network Operations Report
04/21/2014 - 04/27/2014

Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

ConnectorTypeDateSponsor
Sun Corridor (TUCS)Participant4/23/2014
TR-CPS (CHIC)Participant4/24/2014


Upgrades

None

New Services

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Start Time (UTC)

End Time (UTC)





15983-Elevated
2-High

Outage Resolved - I2 AL2S Backbone ATLA-JCSN
Unannounced Maintenance
04/21/2014 10:00 AM
04/21/2014 11:03 AM


16012-High
2-High

Stability - I2 AL2S Backbone ATLA-JCSN
Undetermined
04/22/2014 4:25 AM
04/22/2014 4:56 AM


16022-High
2-High

Brief Outage Resolved - I2 AL2S Backbone CHIC-KANS
Undetermined
04/22/2014 2:47 PM
04/22/2014 2:48 PM


16212-High
2-High

Outage Resolved - I2 AL2S Backbone MINN-SEAT
Hardware
04/27/2014 11:30 AM
04/27/2014 1:57 PM






Unscheduled Outages Detail






Ticket No.:1598:135



Subject:Outage Resolved - I2 AL2S Backbone ATLA-JCSN



Affected:Backbone ATLA-JCSN



Start Time:Monday, April 21, 2014, 10:00 AM (1000) UTC



End Time:Monday, April 21, 2014, 11:03 AM (1103) UTC


Description:Backbone ATLA-JCSN is currently unavailable to the
community.  Zayo Engineering confirmed
that the outage was due to an emergency maintenance extension, which
has now been completed. No futher outages are expected.
Workgroup administrators will receive notifications from OESS
regarding circuits re-routed on the backbone.







Ticket No.:1601:135



Subject:Stability - I2 AL2S Backbone ATLA-JCSN



Affected:Backbone ATLA-JCSN



Start Time:Tuesday, April 22, 2014, 4:25 AM (0425) UTC



End Time:Tuesday, April 22, 2014, 4:56 AM (0456) UTC


Description:Backbone ATLA-JCSN  was unstable to the
community. Level(3) Communications technicians are
currently investigating the reason for the instability. This continued
into a planned maintenance by Zayo Engineers. Updates will be provided
as they become available.







Ticket No.:1602:135



Subject:Brief Outage Resolved - I2 AL2S Backbone CHIC-KANS



Affected:Backbone CHIC-KANS



Start Time:Tuesday, April 22, 2014, 2:47 PM (1447) UTC



End Time:Tuesday, April 22, 2014, 2:48 PM (1448) UTC


Description:Backbone CHIC-KANS was briefly unavailable. Level (3) Communications 
has indicated that the reason for the outage was a fiber bump, the cause of 
which could not be determined. Workgroup administrators receive 
notifications from OESS regarding circuits re-routed on the backbone.







Ticket No.:1621:135



Subject:Outage Resolved - I2 AL2S Backbone MINN-SEAT



Affected:Backbone MINN-SEAT



Start Time:Sunday, April 27, 2014, 11:30 AM (1130) UTC



End Time:Sunday, April 27, 2014, 1:57 PM (1357) UTC


Description:Backbone MINN-SEAT is now available. Vendor Zayo
reported the issue was due to an optical circuit issue in Elbow Lake
Minnesota.  A reboot of the device restored service and no further
outages are expected.
Workgroup administrators received notifications from OESS
regarding circuits re-routed on the backbone.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Start Time (UTC)
End Time (UTC)





1587
3-Elevated
2-High

Maintenance 1 of 3 Completed - I2 AL2S Backbone ATLA-JCSN
Circuit
04/21/2014 6:14 AM
04/21/2014 10:00 AM


1588
3-Elevated
2-High

Maintenance 2 of 3 Completed - I2 AL2S Backbone ATLA-JCSN
Circuit
04/22/2014 5:24 AM
04/22/2014 5:25 AM


1575
3-Elevated
1-Critical

Maintenance 1 of 2 Completed - I2 AL2S Backbone ATLA-CHIC
Circuit
04/24/2014 3:59 AM
04/24/2014 5:55 AM


1618
3-Elevated
2-High

Emergency Maintenance Completed - I2 AL2S to IP Interconnect in KANS
Circuit
04/26/2014 3:03 AM
04/26/2014 3:04 AM


1535
3-Elevated
2-High

Maintenance Completed 1 of 2 - I2 AL2S Backbone MINN-SEAT
Hardware
04/26/2014 9:31 AM
04/26/2014 9:47 AM


1605
3-Elevated
2-High

Maintenance Completed - I2 AL2S Backbone MINN-SEAT
Circuit
04/26/2014 7:09 PM
04/26/2014 8:49 PM




Scheduled Maintenances Detail





Ticket No.:1587:135



Subject:Maintenance 1 of 3 Completed - I2 AL2S Backbone ATLA-JCSN



Affected:Backbone ATLA-JCSN



Start Time:Monday, April 21, 2014, 6:14 AM (0614) UTC



End Time:Monday, April 21, 2014, 10:00 AM (1000) UTC


Description:   Backbone ATLA-JCSN was unavailable while Zayo Engineers
performed maintenance. Maintenance has been completed. 
Backbone traffic re-routed during this window.
Workgroup administrators will receive notifications from OESS
regarding circuits re-routed on the backbone. This was maintenance
window 1 of 3.



  







Ticket No.:1588:135



Subject:Maintenance 2 of 3 Completed - I2 AL2S Backbone ATLA-JCSN



Affected:Backbone ATLA-JCSN



Start Time:Tuesday, April 22, 2014, 5:24 AM (0524) UTC



End Time:Tuesday, April 22, 2014, 5:25 AM (0525) UTC


Description:   Backbone ATLA-JCSN was briefly unavailable while Zayo Engineers
performed maintenance.  Maintenance has been completed. This was
maintenance window 2 of 3.



  







Ticket No.:1575:135



Subject:Maintenance 1 of 2 Completed - I2 AL2S Backbone ATLA-CHIC



Affected:Backbone ATLA-CHIC



Start Time:Thursday, April 24, 2014, 3:59 AM (0359) UTC



End Time:Thursday, April 24, 2014, 5:55 AM (0555) UTC


Description:   Backbone ATLA-CHIC was unavailable while
Level(3) Communications relocated cable due to a mandated bridge
installation project between Greensburg, IN and Indianapolis, IN.  
The maintenance has been complete4d, and no further outages are expected.

*This was the first of two maintenance windows*



  







Ticket No.:1618:135



Subject:Emergency Maintenance Completed - I2 AL2S to IP Interconnect in KANS



Affected:I2-KANS-KANS-100GE-09167



Start Time:Saturday, April 26, 2014, 3:03 AM (0303) UTC



End Time:Saturday, April 26, 2014, 3:04 AM (0304) UTC


Description:   The interconnect between IP KANS and AL2S KANS was unavailable
while Level(3) Engineers performed fiber cleaning to resolve errors.
The maintenance has been completed.



  







Ticket No.:1535:135



Subject:Maintenance Completed 1 of 2 - I2 AL2S Backbone MINN-SEAT



Affected:Backbone MINN-SEAT



Start Time:Saturday, April 26, 2014, 9:31 AM (0931) UTC



End Time:Saturday, April 26, 2014, 9:47 AM (0947) UTC


Description:   Backbone MINN-SEAT was unavailable while Vendor Zayo Engineers
performed a hardware upgrade in Sprague, WA. Backbone traffic was re-
routed during this maintenance. Maintenance has been completed.



  







Ticket No.:1605:135



Subject:Maintenance Completed - I2 AL2S Backbone MINN-SEAT



Affected:Backbone MINN-SEAT



Start Time:Saturday, April 26, 2014, 7:09 PM (1909) UTC



End Time:Saturday, April 26, 2014, 8:49 PM (2049) UTC


Description:   Backbone MINN-SEAT was unavailable while our fiber provider's
third party provider performed a cable relocation in Fallon, MT. The
maintenance has been completed and no more outages are expected.
Backbone traffic was re-routed during this maintenance. Workgroup
administrators received notifications from OESS regarding circuits
re-routed on the backbone.



  










Downtime and Availability







Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability


sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99696%  100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99677%  100.00000%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%  100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99564%  100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96376%  99.98975%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%  100.00000%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85770%  99.85902%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943%  100.00000%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92752%  99.92885%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829%  100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98425%  99.98520%
sdn-sw.kans.net.internet2.edu 0 hr 1 min0 hr 0 min 99.99008%100.00000% 99.99848%  100.00000%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886%  100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98596%  100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99905%  100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99715%  100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962%  100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.72602%  99.73550%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99829%  100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99279%  100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99791%  100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%  100.00000%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%  100.00000%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99810%  100.00000%
      
Aggregate Internet2 Advanced Layer 2 Service Core Nodes0 hr 1 min0 hr 1 min99.99966%100.00000%99.97948%99.98270%

 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


I2-ALBA-BOST-100GE-09210
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99393%99.99924%
I2-ALBA-CLEV-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99279%99.99981%
I2-ASHB-CHIC-100GE-11803
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98900%99.98975%
I2-ASHB-WASH-100GE-11823
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-CHAR-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97970%99.97970%
I2-ATLA-CHIC-100GE-07740
               1 hr 56 min0 hr 0 min
               98.84921%100.00000%
               99.71767%99.78806%
I2-ATLA-HOUH-10GE-07742
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JACK-100GE-07739
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99412%100.00000%
I2-ATLA-JCSN-100GE-10734
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784
               5 hr 20 min1 hr 33 min
               96.82540%99.07738%
               99.71103%99.75505%
I2-ATLA-WASH-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-BATO-HOUH-100GE-08860
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92771%99.92847%
I2-BATO-JACK-100GE-11005
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98824%99.99962%
I2-BOST-NEWY32AOA-100GE-09211
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98634%100.00000%
I2-CHAR-RALE-100GE-10633
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97894%99.97970%
I2-CHIC-COLU4-100GE-11554
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98881%99.98956%
I2-CHIC-KANS-100GE-07745
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.96774%99.96888%
I2-CHIC-STAR-100GE-07743
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.84859%99.86358%
I2-CLEV-NEWY32AOA-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98615%99.99924%
I2-CLEV-PITT-100GE-10334
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99336%100.00000%
I2-CLEV-STAR-100GE-07736
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94991%99.98368%
I2-COLU4-KANS-100GE-11548
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98254%99.98254%
I2-DALL-HOUH-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92619%99.92885%
I2-DALL-TULS-100GE-11300
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.84403%99.84479%
I2-DENV-KANS-100GE-07746
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.83075%99.88141%
I2-DENV-SALT-100GE-07747
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92676%99.96983%
I2-ELPA-HOUH-100GE-07749
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.37272%99.48163%
I2-ELPA-PHOE-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89716%99.91595%
I2-HOUH-JCSN-100GE-10783
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91310%99.91405%
I2-HOUH-TULS-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.68636%99.75068%
I2-KANS-TULS-100GE-07753
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99924%99.99981%
I2-LOSA-PHOE-100GE-09190
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.80779%99.80912%
I2-LOSA-SALT-100GE-07757
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91481%99.93226%
I2-LOSA-SUNN-100GE-07755
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99829%99.99943%
I2-MINN-SEAT-100GE-09130
               4 hr 23 min2 hr 27 min
               97.39087%98.54167%
               99.50535%99.67441%
I2-MINN-STAR-100GE-09299
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.88654%99.90475%
I2-NEWY23AOA-PHIL-100GE-07759
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99924%100.00000%
I2-PHIL-WASH-100GE-10867
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89375%100.00000%
I2-PORT-SEAT-100GE-08997
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99829%100.00000%
I2-PORT-SUNN-100GE-10343
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99829%99.99962%
I2-RALE-WASH-100GE-08888
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.79926%99.82829%
I2-SALT-SUNN-100GE-07766
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97533%99.99658%
      
Aggregate All Internet2 Advanced Layer 2 Service Backbone Circuits
                   11 hr 40 min7 hr 39 min
                   99.83466%99.94307%
                   99.90833%99.92948%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  

Upcoming Scheduled Maintenances





Ticket No.:1596:135



Subject:Maintenance - I2 AL2S Backbone MINN-SEAT



Affected:Backbone MINN-SEAT



Start Time:Saturday, May 10, 2014, 1:00 PM (1300) UTC



End Time:Saturday, May 10, 2014, 11:00 PM (2300) UTC



Description:   Backbone MINN-SEAT will be unavailable while our fiber provider's
third party provider performs a cable relocation in Judson ND. This work
must take place during daylight hours as the cable is located along the
railroad. An outage of up to 3 hours is expected; however the entire
window
has been reserved.