Unified - Internet2 Advanced Layer 2 Service Network Operations Report
04/18/2016 - 04/24/2016

Unified - Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Network Resources

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Source Of Impact
Start Time (UTC)

End Time (UTC)





81164-Normal
1-Critical

Brief Outage Resolved - I2 Optical DWDM System CLEV-DETR
Human ErrorVendor
04/21/2016 3:40 PM
04/21/2016 3:41 PM


04/21/2016 3:48 PM
04/21/2016 3:49 PM


81244-Normal
1-Critical

Brief Outage Resolved - I2 Optical DWDM System CHIC-INDI
UndeterminedVendor
04/22/2016 12:35 AM
04/22/2016 12:36 AM


81264-Normal
2-High

Brief Outage Resolved - I2 AL2S Backbone EQCH-MINN
Human ErrorVendor
04/22/2016 1:09 PM
04/22/2016 1:10 PM


81774-Normal
2-High

Brief Outage Resolved - I2 AL2S Backbone LOSA-PHOE
UndeterminedUndetermined
04/24/2016 7:56 PM
04/24/2016 7:57 PM






Unscheduled Outages Detail






Ticket No.:8116:144



Subject:Brief Outage Resolved - I2 Optical DWDM System CLEV-DETR



Source Of Impact:Vendor



Affected:DWDM System CLEV-DETR
AL2S Backbones ASHB-CHIC and CLEV-EQCH
IP Backbones ASHB-CHIC, CHIC-CLEV, CHIC-EQCH, CHIC-NEWY32AOA, CHIC-WASH, 
and CLEV-EQCH
AL2S Participant MERIT



Start Time:Thursday, April 21, 2016, 3:40 PM (1540) UTC



End Time:Thursday, April 21, 2016, 3:41 PM (1541) UTC


Start Time:Thursday, April 21, 2016, 3:48 PM (1548) UTC



End Time:Thursday, April 21, 2016, 3:49 PM (1549) UTC


Description:The above listed assets were briefly unavailable.
Level (3) Communications Engineers have investigated the outage and have 
determined that it was due to a fiber bump. The reason for the fiber bump is 
undetermined. No further outages are expected.







Ticket No.:8124:144



Subject:Brief Outage Resolved - I2 Optical DWDM System CHIC-INDI



Source Of Impact:Vendor



Affected:DWDM System CHIC-INDI
AL2S Backbone CHIC-INDI
IP Backbone ATLA-CHIC
Member NOAA N-Wave
Member ESnet
Connector University of Memphis
Connector SOX
Connector Indiana GigaPOP
Participant SLIAC
Member NORDUnet
Peer NISN



Start Time:Friday, April 22, 2016, 12:35 AM (0035) UTC



End Time:Friday, April 22, 2016, 12:36 AM (0036) UTC


Description:The above listed assets were briefly unavailable. Level (3) Communications 
Engineers have reviewed the outage and the reason for the outage is 
undetermined. No further outages are expected.







Ticket No.:8126:144



Subject:Brief Outage Resolved - I2 AL2S Backbone EQCH-MINN



Source Of Impact:Vendor



Affected:AL2S Backbone EQCH-MINN
AL2S Participant Northern Lights Gigapop
Net+ Provider Code42



Start Time:Friday, April 22, 2016, 1:09 PM (1309) UTC



End Time:Friday, April 22, 2016, 1:10 PM (1310) UTC


Description:The above listed assets are now available after a brief outage. Zayo has reported that the outage was 
caused by a field technician inadvertently bumping fibers while working in a splice case. Zayo has 
confirmed work is done and they are hands off. No further impact is expected.







Ticket No.:8177:144



Subject:Brief Outage Resolved - I2 AL2S Backbone LOSA-PHOE



Source Of Impact:Undetermined



Affected:AL2S Backbone LOSA-PHOE
IP Backbone HOUS-LOSA



Start Time:Sunday, April 24, 2016, 7:56 PM (1956) UTC



End Time:Sunday, April 24, 2016, 7:57 PM (1957) UTC


Description:The above listed asset was briefly unavailable. Level(3) Communication Engineers 
have reviewed the outage and the reason for the outage is undetermined. No 
further outages are expected. Workgroup administrators receive notifications 
from OESS
regarding circuits re-routed on the backbone.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Source Of Impact
Start Time (UTC)
End Time (UTC)





8000
3-Elevated
1-Critical

Maintenance 1 of 2 Completed - I2 Optical DWDM System MEMP-NASH
Circuit
Vendor04/21/2016 5:57 AM
04/21/2016 7:44 AM




Scheduled Maintenances Detail





Ticket No.:8000:144



Subject:Maintenance 1 of 2 Completed - I2 Optical DWDM System MEMP-NASH



Source Of Impact:Vendor



Affected:DWDM System MEMP-NASH
AL2S Backbone ATLA-JCSN
IP Connector MissiON
IP Connector University of Memphis



Start Time:Thursday, April 21, 2016, 5:57 AM (0557) UTC



End Time:Thursday, April 21, 2016, 7:44 AM (0744) UTC


Description:   The above listed assets are now available after Level(3)
Communications performed cable repair maintenance in Mt Pleasant, TN. The 
maintenance has been completed.



  










Downtime and Availability







Unified - Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability


sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99262%  99.99546%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99508%  99.99546%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98808%  99.98846%
sdn-sw.bato.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99035%  99.99546%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.colu4.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99394%  99.99546%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99130%  99.99167%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.eqch.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99394%  99.99546%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98505%  99.99546%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99470%  99.99470%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99262%  99.99546%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99527%  99.99546%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.miss2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97370%  99.98789%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93794%  99.99470%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99546%  99.99546%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99054%  99.99546%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97162%  99.99470%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96253%  99.99546%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99319%  99.99546%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99489%  99.99546%
sdn-srv2.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-srv3.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
      
Aggregate Unified - Internet2 Advanced Layer 2 Service Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.99068%99.99526%

 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Unified - Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


I2-ALBA-BOST-100GE-09210
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99603%100.00000%
I2-ALBA-CLEV-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97559%100.00000%
I2-ASHB-CHIC-100GE-11803
               0 hr 2 min0 hr 2 min
               99.98016%99.98016%
               99.62402%99.76177%
I2-ASHB-PITT-100GE-07737
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.82951%99.89139%
I2-ASHB-WASH-100GE-09106
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.79242%99.87114%
I2-ASHB-WASH-100GE-11823
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.77445%99.83651%
I2-ATLA-CHAR-100GE-07739
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-CINC-100GE-07740
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96367%99.99981%
I2-ATLA-HOUH-10GE-07742
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JACK-100GE-07739
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96462%99.99622%
I2-ATLA-JCSN-100GE-10734
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784
               1 hr 47 min0 hr 0 min
               98.93849%100.00000%
               99.50613%99.71844%
I2-ATLA-CHAR-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96613%99.99773%
I2-ATLA-WASH-100GE-54536
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98789%99.98827%
I2-BATO-HOUH-100GE-08860
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98959%100.00000%
I2-BATO-JACK-100GE-11005
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.57747%99.64010%
I2-BOST-HART2-100GE-09211
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91920%99.92904%
I2-CHAR-RALE-100GE-10633
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.88249%99.88249%
I2-CHIC-INDI-100GE-50993
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.99470%99.99981%
I2-CINC-INDI-100GE-51692
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97200%99.99981%
I2-CINC-LOUI-100GE-54197
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99981%99.99981%
I2-CHIC-COLU4-100GE-11554
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94191%99.99830%
I2-CHIC-KANS-100GE-07745
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95913%99.99981%
I2-CHIC-STAR-100GE-07743
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92715%99.99924%
I2-CLEV-EQCH-100GE-07736
               0 hr 2 min0 hr 2 min
               99.98016%99.98016%
               99.84635%99.87057%
I2-CLEV-NEWY32AOA-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-CLEV-PITT-100GE-10334
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99697%100.00000%
I2-CLEV-STAR-100GE-07736
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-COLU4-KANS-100GE-11548
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99281%99.99811%
I2-DALL-HOUH-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.76536%99.84143%
I2-DALL-TULS-100GE-11300
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.65675%99.70954%
I2-DENV-ELPA-100GE-07748
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97162%99.99868%
I2-DENV-KANS-100GE-07746
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.77937%99.87152%
I2-DENV-SALT-100GE-07747
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93529%99.98070%
I2-ELPA-HOUH-100GE-07749
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.70614%99.71692%
I2-ELPA-PHOE-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ELPA-TUCS-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99905%99.99905%
I2-EQCH-STAR-100GE-09299
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93453%99.99924%
I2-EQCH-MINN-100GE-12184
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.60055%99.71541%
I2-HART2-NEWY32AOA-100GE-12947
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.73036%99.73149%
I2-HOUH-HOUS-100GE-09379
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.77237%99.80624%
I2-HOUH-JCSN-100GE-10783
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.90596%99.93812%
I2-HOUH-TULS-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-KANS-MINN-100GE-12675
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94323%99.94607%
I2-KANS-TULS-100GE-07753
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94248%99.95005%
I2-LASV-LOSA-100GE-53802
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.90823%99.93377%
I2-LASV-SALT-100GE-07757
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98600%100.00000%
I2-LOSA-PHOE-100GE-09190
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.92639%99.99849%
I2-LOSA-SUNN-100GE-07755
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96234%99.99868%
I2-MINN-MISS2-100GE-09130
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.03497%99.42268%
I2-MISS2-SEAT-100GE-13237
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.80870%99.84332%
I2-NEWY23AOA-PHIL-100GE-07759
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.67889%99.69781%
I2-PHIL-WASH-100GE-10867
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.78126%99.89328%
I2-PHOE-TUCS-100GE-11990
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89101%99.94796%
I2-PORT-SEAT-100GE-08997
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96386%99.99943%
I2-PORT-SUNN-100GE-10343
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.85279%99.88685%
I2-RALE-WASH-100GE-08888
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99111%99.99943%
I2-SALT-SEAT-100GE-08998
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.74398%99.74890%
I2-RENO-SALT-100GE-53725
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94380%99.99981%
I2-RENO-SUNN-100GE-07766
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.60074%99.74285%
      
Aggregate All Unified - Internet2 Advanced Layer 2 Service Backbone Circuits
                   1 hr 54 min1 hr 47 min
                   99.98115%99.99884%
                   99.86829%99.91160%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  

Upcoming Scheduled Maintenances





Ticket No.:8223:144



Subject:Maintenance *Tracking* 2 of 2 - I2 AL2S Backbone EQCH-MINN



Affected:AL2S Backbone EQCH-MINN
Net+ Provider Code42



Start Time:Saturday, April 30, 2016, 5:00 AM (0500) UTC



End Time:Saturday, April 30, 2016, 10:00 AM (1000) UTC



Description:   The above listed asset should remain available while Zayo Engineers perform 
maintenance.  No outages are expected. The entire window is reserved.



  







Ticket No.:8228:144



Subject:Maintenance *Tracking* - I2 AL2S Backbone COLU4-KANS



Affected:AL2S Backbone COLU4-KANS



Start Time:Wednesday, May 4, 2016, 5:00 AM (0500) UTC



End Time:Wednesday, May 4, 2016, 10:00 AM (1000) UTC



Description:   The above listed asset will be unavailable while MOREnet's third-party vendor performs maintenance.  An outage is not expected; however, the entire window 
is reserved.  Backbone traffic will re-route during this maintenance. Workgroup 
administrators will receive notifications from OESS regarding circuits re-routed 
on the backbone.



  







Ticket No.:8229:144



Subject:Maintenance - I2 IP Backbone LOSA-PAIX



Affected:Backbone LOSA-PAIX



Start Time:Wednesday, May 4, 2016, 11:45 AM (1145) UTC



End Time:Wednesday, May 4, 2016, 12:15 PM (1215) UTC



Description:   The above assets should remain available while Internet2 Engineers perform software
maintenance. No impact to production services is expected, however the entire window
is reserved.  IP traffic will re-route during this maintenance, should the backbone go
down.



  







Ticket No.:8067:144



Subject:Maintenance  - I2 Various Optical Circuits



Affected:CA*Net/CANARIE
Net+ Provider Code42
AL2S BB MINN-MISS2



Start Time:Saturday, May 7, 2016, 12:00 PM (1200) UTC



End Time:Saturday, May 7, 2016, 11:00 PM (2300) UTC



Description:   The above listed optical circuits will be unavailable
while Zayo Engineers perform circuit maintenance. An
outage of 3 hours expected, however the entire maintenance window has been
reserved. Workgroup administrators receive notifications from OESS
regarding circuits re-routed on the backbone.



  







Ticket No.:8205:144



Subject:Maintenance - I2 AL2S Participant USDA



Affected:AL2S Participant USDA



Start Time:Monday, May 16, 2016, 5:00 AM (0500) UTC



End Time:Monday, May 16, 2016, 10:00 AM (1000) UTC



Description:   The above listed asset will be unavailable while CenturyLink Engineers perform a
maintenance to replace network hardware.  An outage is expected. The entire window is
reserved.