Unified - Internet2 Advanced Layer 2 Service Network Operations Report
12/12/2016 - 12/18/2016

Unified - Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Network Resources

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Source Of Impact
Start Time (UTC)

End Time (UTC)





114244-Normal
1-Critical

Brief Outage - I2 Optical DWDM System PHOE-TUCS
UndeterminedVendor
12/12/2016 8:50 PM
12/12/2016 8:53 PM


114884-Normal
2-High

Brief Outage Resolved - I2 AL2S Backbone MISS2-SEAT
UndeterminedVendor
12/16/2016 2:12 AM
12/16/2016 2:14 AM


114914-Normal
2-High

Brief Outage Resolved - I2 AL2S Backbone EQCH-STAR
UndeterminedVendor
12/16/2016 6:01 AM
12/16/2016 6:02 AM


115264-Normal
1-Critical

Brief Outage Resolved - I2 Optical DWDM System KANS-SAIN
SoftwareVendor
12/17/2016 1:58 PM
12/17/2016 2:10 PM






Unscheduled Outages Detail






Ticket No.:11424:144



Subject:Brief Outage - I2 Optical DWDM System PHOE-TUCS



Source Of Impact:Vendor



Affected:DWDM System PHOE-TUCS
AL2S Backbone PHOE-TUCS
IP Backbone HOUS-LOSA
Optical Member ESnet
Optical Member Sun Corridor



Start Time:Monday, December 12, 2016, 8:50 PM (2050) UTC



End Time:Monday, December 12, 2016, 8:53 PM (2053) UTC


Description:The above listed assets are currently available to the community following a brief
outage. After investigation, Level (3) Communications Engineers reported the reason for 
the outage was undetermined.







Ticket No.:11488:144



Subject:Brief Outage Resolved - I2 AL2S Backbone MISS2-SEAT



Source Of Impact:Vendor



Affected:AL2S Backbone MISS2-SEAT
Net+ Provider Code42



Start Time:Friday, December 16, 2016, 2:12 AM (0212) UTC



End Time:Friday, December 16, 2016, 2:14 AM (0214) UTC


Description:The above listed asset is now available after a brief outage. Internet2 Engineers 
investigated and reported the reason for the outage is undetermined. 
Workgroup administrators received notifications from OESS regarding circuits re-
routed on the backbone.







Ticket No.:11491:144



Subject:Brief Outage Resolved - I2 AL2S Backbone EQCH-STAR



Source Of Impact:Vendor



Affected:AL2S Backbone EQCH-STAR
IP Backbone CHIC-CLEV



Start Time:Friday, December 16, 2016, 6:01 AM (0601) UTC



End Time:Friday, December 16, 2016, 6:02 AM (0602) UTC


Description:The above listed assets are now available after a brief outage. Level(3) Engineers
investigated the cause. The reason for the outage is undetermined.







Ticket No.:11526:144



Subject:Brief Outage Resolved - I2 Optical DWDM System KANS-SAIN



Source Of Impact:Vendor



Affected:DWDM System KANS-SAIN
AL2S Backbone(s) CHIC-KANS
IP Backbone(s) CHIC-KANS
All Connectors/Peers



Start Time:Saturday, December 17, 2016, 1:58 PM (1358) UTC



End Time:Saturday, December 17, 2016, 2:10 PM (1410) UTC


Description:The above listed assets are now available after a brief outage.
Level (3) Communications Engineers have stated that the outage was due to a 
circuit pack failure. A card restart has been completed, which has restored the 
circuits. No further outages are expected.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Source Of Impact
Start Time (UTC)
End Time (UTC)





11442
3-Elevated
2-High

Emergency Maintenance Completed - I2 AL2S Backbone CLEV-EQCH
Circuit
Internal12/16/2016 6:21 AM
12/16/2016 6:33 AM




Scheduled Maintenances Detail





Ticket No.:11442:144



Subject:Emergency Maintenance Completed - I2 AL2S Backbone CLEV-EQCH



Source Of Impact:Internal



Affected:AL2S Backbone CLEV-EQCH
Connector NYSERNet (EQCH)*
Participant Northern Lights Gigapop (CLEV)*



Start Time:Friday, December 16, 2016, 6:21 AM (0621) UTC



End Time:Friday, December 16, 2016, 6:33 AM (0633) UTC


Description:   The above listed assets are now available afte Internet2 Engineers performed maintenance. 
Maintenance has completed. Backbone traffic re-routed during this maintenance. Workgroup
administrators received notifications from OESS regarding circuits re-routed on the backbone.
*Denotes multihomed status and should have remained reachable to the community.*



  










Downtime and Availability







Unified - Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability


sdn-sw.reno.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99338%  100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96537%  100.00000%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96386%  100.00000%
sdn-sw.bato.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96083%  100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95402%  100.00000%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.colu4.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99584%  99.99622%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95269%  99.99924%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93964%  100.00000%
sdn-sw.eqch.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96367%  100.00000%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95686%  100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99924%  99.99924%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92639%  100.00000%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96405%  100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.miss2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99659%  100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94815%  100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97824%  99.99243%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94323%  100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95326%  100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96708%  100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92677%  100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94437%  100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93869%  100.00000%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94267%  100.00000%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95023%  100.00000%
sdn-srv2.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-srv3.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
      
Aggregate Unified - Internet2 Advanced Layer 2 Service Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.97292%99.99964%

 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Unified - Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


I2-ALBA-BOST-100GE-09210
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89763%99.90444%
I2-ALBA-CLEV-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94040%100.00000%
I2-ASHB-CHIC-100GE-11803
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.63404%99.79942%
I2-ASHB-PITT-100GE-07737
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.78391%99.92601%
I2-ASHB-WASH-100GE-09106
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.66073%99.90312%
I2-ASHB-WASH-100GE-11823
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.58996%99.74720%
I2-ATLA-CHAR-100GE-07739
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-CINC-100GE-07740
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-HOUH-10GE-07742
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JACK-100GE-07739
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91863%99.99868%
I2-ATLA-JCSN-100GE-10734
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.25863%99.48797%
I2-ATLA-LOUI-100GE-07740
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.48040%99.64937%
I2-ATLA-CHAR-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.80548%99.88079%
I2-ATLA-WASH-100GE-54536
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.65997%99.83462%
I2-BATO-HOUH-100GE-08860
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94796%100.00000%
I2-BATO-JACK-100GE-11005
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               98.84896%99.05692%
I2-BOST-HART2-100GE-09211
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97975%99.98127%
I2-CHAR-RALE-100GE-10633
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94285%99.99849%
I2-CHIC-INDI-100GE-50993
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93926%99.99981%
I2-CINC-INDI-100GE-51692
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-CINC-LOUI-100GE-54197
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.76404%99.77293%
I2-CHIC-COLU4-100GE-11554
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               98.95398%99.11577%
I2-CHIC-KANS-100GE-07745
               0 hr 12 min0 hr 12 min
               99.88095%99.88095%
               99.85789%99.99622%
I2-CHIC-STAR-100GE-07743
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.85525%100.00000%
I2-CLEV-EQCH-100GE-66186
               0 hr 12 min0 hr 0 min
               99.88095%100.00000%
               99.99186%100.00000%
I2-CLEV-NEWY32AOA-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-CLEV-PITT-100GE-10334
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89290%99.98448%
I2-CLEV-STAR-100GE-07736
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-COLU4-KANS-100GE-11548
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92620%100.00000%
I2-DALL-HOUH-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.60453%99.73812%
I2-DALL-TULS-100GE-11300
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.65713%99.74587%
I2-DENV-ELPA-100GE-07748
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.85222%99.99924%
I2-DENV-KANS-100GE-07746
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.58693%99.79564%
I2-DENV-SALT-100GE-07747
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91977%99.99924%
I2-ELPA-HOUH-100GE-07749
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.72639%99.87549%
I2-ELPA-PHOE-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ELPA-TUCS-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.91996%100.00000%
I2-EQCH-STAR-100GE-09299
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.91561%99.99981%
I2-EQCH-MINN-100GE-12184
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.53470%99.73906%
I2-HART2-NEWY32AOA-100GE-12947
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.88609%99.95686%
I2-HOUH-HOUS-100GE-09379
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92980%99.97710%
I2-HOUH-JCSN-100GE-10783
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89536%99.93169%
I2-HOUH-TULS-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-KANS-MINN-100GE-12675
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.88647%99.96007%
I2-KANS-TULS-100GE-07753
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.80718%99.99981%
I2-LASV-LOSA-100GE-53802
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96405%100.00000%
I2-LASV-SALT-100GE-07757
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.72336%99.90236%
I2-LOSA-PHOE-100GE-09190
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.80775%99.94475%
I2-LOSA-SUNN-100GE-07755
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.90123%99.99849%
I2-MINN-MISS2-100GE-09130
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.27093%99.61891%
I2-MISS2-SEAT-100GE-13237
               0 hr 2 min0 hr 2 min
               99.98016%99.98016%
               99.42704%99.61569%
I2-NEWY23AOA-PHIL-100GE-07759
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.39071%99.48210%
I2-PHIL-WASH-100GE-10867
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.53830%99.66356%
I2-PHOE-TUCS-100GE-11990
               0 hr 3 min0 hr 3 min
               99.97024%99.97024%
               99.92791%99.99924%
I2-PORT-SEAT-100GE-08997
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.85411%99.96556%
I2-PORT-SUNN-100GE-10343
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89536%99.95667%
I2-RALE-WASH-100GE-08888
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.83046%99.96348%
I2-SALT-SEAT-100GE-08998
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.79867%99.99962%
I2-RENO-SALT-100GE-53725
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.77483%99.84768%
I2-RENO-SUNN-100GE-07766
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.60131%99.79110%
      
Aggregate All Unified - Internet2 Advanced Layer 2 Service Backbone Circuits
                   0 hr 30 min0 hr 12 min
                   99.99512%99.99707%
                   99.77637%99.87713%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  

Upcoming Scheduled Maintenances





Ticket No.:11502:144



Subject:Maintenance - I2 AL2S Participant Mid Atlantic Crossroads



Affected:Participant Mid Atlantic Crossroads



Start Time:Wednesday, December 28, 2016, 6:00 PM (1800) UTC



End Time:Wednesday, December 28, 2016, 10:00 PM (2200) UTC



Description:   The above listed asset will be unavailable while Mid Atlantic Crossroads Engineers 
perform software maintenance. An outage is expected. The entire window is 
reserved.



  







Ticket No.:11603:144



Subject:Emergency Maintenance Rescheduled - I2 Optical Member ESnet



Affected:Optical Member ESnet



Start Time:Friday, December 30, 2016, 8:00 AM (0800) UTC



End Time:Saturday, December 31, 2016, 12:00 PM (1200) UTC



Description:   *Please note this maintenance has been rescheduled.*
Member ESnet's above listed Optical circuits will be unavailable
while Level(3) Engineers perform an emergency maintenance to clean fiber. An
outage is expected, however the entire
maintenance window has been reserved.



  







Ticket No.:11577:144



Subject:Maintenance *Tracking* - I2 AL2S Backbone MINN-MISS2 



Affected:AL2S Backbone MINN-MISS2
Net+ Provider Code42



Start Time:Thursday, January 5, 2017, 6:00 AM (0600) UTC



End Time:Thursday, January 5, 2017, 11:00 AM (1100) UTC



Description:   The above listed assets should remain available while ZAYO Engineers perform
maintenance.  No outages are expected. The entire window is reserved.  Backbone 
traffic will re-route during this maintenance. Workgroup administrators will
receive notifications from OESS regarding circuits re-routed on the backbone.



  







Ticket No.:11428:144



Subject:Maintenance 1 of 2 - I2 AL2S Backbone EQCH-MINN



Affected:AL2S Backbone EQCH-MINN
Net+ Provider Code42 (CHIC)



Start Time:Tuesday, January 10, 2017, 6:00 AM (0600) UTC



End Time:Tuesday, January 10, 2017, 11:00 AM (1100) UTC



Description:   The above listed asset will be unavailable while Zayo Engineers perform maintenance.  
An outage of 5 hours is expected. The entire window is reserved.  Backbone traffic will
re-route during this maintenance. Workgroup administrators will
receive notifications from OESS regarding circuits re-routed on the
backbone.



  







Ticket No.:11608:144



Subject:Maintenance Rescheduled 1 of 2 - I2 AL2S Backbone EQCH-MINN



Affected:AL2S Backbone EQCH-MINN



Start Time:Tuesday, January 10, 2017, 6:00 AM (0600) UTC



End Time:Tuesday, January 10, 2017, 11:00 AM (1100) UTC



Description:   The above listed asset will be unavailable while Zayo Engineers perform
maintenance.  An outage is
expected. The entire window is reserved.  Backbone traffic will
re-route during this maintenance. Workgroup administrators will
receive notifications from OESS regarding circuits re-routed on the
backbone.



  







Ticket No.:11429:144



Subject:Maintenance 2 of 2 - I2 AL2S Backbone EQCH-MINN



Affected:AL2S Backbone EQCH-MINN
Net+ Provider Code42 (CHIC)



Start Time:Wednesday, January 11, 2017, 6:00 AM (0600) UTC



End Time:Wednesday, January 11, 2017, 11:00 AM (1100) UTC



Description:   The above listed asset will be unavailable while Zayo Engineers perform maintenance.  
An outage of 5 hours is expected. The entire window is reserved.  Backbone traffic will 
re-route during this maintenance. Workgroup administrators will
receive notifications from OESS regarding circuits re-routed on the
backbone.



  







Ticket No.:11602:144



Subject:Maintenance Rescheduled 2 of 2 - I2 AL2S Backbone EQCH-MINN



Affected:AL2S Backbone EQCH-MINN



Start Time:Wednesday, January 11, 2017, 6:00 AM (0600) UTC



End Time:Wednesday, January 11, 2017, 11:00 AM (1100) UTC



Description:   The above listed asset will be unavailable while Zayo Engineers perform
maintenance.  An outage is
expected. The entire window is reserved.  Backbone traffic will
re-route during this maintenance. Workgroup administrators will
receive notifications from OESS regarding circuits re-routed on the
backbone.