Unified - Internet2 Advanced Layer 2 Service Network Operations Report
12/15/2014 - 12/21/2014

Unified - Internet2 Advanced Layer 2 Service Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Network Resources

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Source Of Impact
Start Time (UTC)

End Time (UTC)





18802-High


Outage Resolved - I2 AL2S Backbone MINN-MISS2
Unannounced MaintenanceUndetermined
12/16/2014 7:14 AM
12/16/2014 7:29 AM


19384-Normal


Brief Outage Resolved - I2 AL2S Backbone ELPA-HOUH
HardwareVendor
12/19/2014 5:57 PM
12/19/2014 6:09 PM


19522-High


Brief Outage - I2 AL2S Backbone BATO-JACK
InvestigatingUndetermined
12/21/2014 4:59 AM
12/21/2014 5:00 AM






Unscheduled Outages Detail






Ticket No.:1880:144



Subject:Outage Resolved - I2 AL2S Backbone MINN-MISS2



Source Of Impact:Undetermined



Affected:AL2S Backbone MINN-MISS2
Net+ Provider Code42 (SEAT) *



Start Time:Tuesday, December 16, 2014, 7:14 AM (0714) UTC



End Time:Tuesday, December 16, 2014, 7:29 AM (0729) UTC


Description:The above listed is now available. The reason for the outage is unannounced 
maintenance. The maintenance has been completed. Workgroup administrators 
received notifications from OESS regarding circuits re-routed on the backbone.
* Denotes Net+ Provider is multihomed and remained reachable.







Ticket No.:1938:144



Subject:Brief Outage Resolved - I2 AL2S Backbone ELPA-HOUH



Source Of Impact:Vendor



Affected:AL2S Backbone ELPA-HOUH
IP Backbone HOUS-LOSA



Start Time:Friday, December 19, 2014, 5:57 PM (1757) UTC



End Time:Friday, December 19, 2014, 6:09 PM (1809) UTC


Description:The above listed were briefly unavailable. Level(3) communications reports the outage 
was caused by a failed circuit pack and resolved by performing a cold reset of the card. 
There will be a future maintenance scheduled to replace the failing card. Workgroup 
administrators receive notifications from OESS regarding circuits re-routed on the 
backbone.







Ticket No.:1952:144



Subject:Brief Outage - I2 AL2S Backbone BATO-JACK



Source Of Impact:Undetermined



Affected:AL2S Backbone BATO-JACK



Start Time:Sunday, December 21, 2014, 4:59 AM (0459) UTC



End Time:Sunday, December 21, 2014, 5:00 AM (0500) UTC


Description:AL2S Backbone BATO-JACK was briefly unavailable. Internet2 Engineers are investigating the cause; however, the reason for the outage is pending. 
Workgroup administrators received notifications from OESS regarding circuits re-
routed on the backbone.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Source Of Impact
Start Time (UTC)
End Time (UTC)





1832
3-Elevated
1-Critical

Maintenance Completed - I2 Optical Circuits I2-COLU4-KANS-100GE-11579 and I2-COLU4-SAIN-100GE-11580
Software
Vendor12/15/2014 6:37 AM
12/15/2014 7:43 AM


1879
3-Elevated


Maintenance  Completed - I2 AL2S Backbone CHIC-KANS
CircuitInternal
12/19/2014 3:17 AM
12/19/2014 3:19 AM


1948
3-Elevated


Emergency Maintenance Completed - I2 Optical DWDM System JCSN-MEMP 
Hardware
Vendor12/20/2014 10:35 PM
12/20/2014 10:47 PM




Scheduled Maintenances Detail





Ticket No.:1832:144



Subject:Maintenance Completed - I2 Optical Circuits I2-COLU4-KANS-100GE-11579 and I2-COLU4-SAIN-100GE-11580



Source Of Impact:Vendor



Affected:Vendor MOREnet
AL2S Backbones CHIC-COLU4 and COLU4-KANS



Start Time:Monday, December 15, 2014, 6:37 AM (0637) UTC



End Time:Monday, December 15, 2014, 7:43 AM (0743) UTC


Description:   The above listed circuits were unavailable while MOREnet engineers
performed a maintenance to upgrade the software on the their optical network. 
Maintenance has been completed. No further outages are expected.



  







Ticket No.:1879:144



Subject:Maintenance  Completed - I2 AL2S Backbone CHIC-KANS



Source Of Impact:Internal



Affected:AL2S Backbone CHIC-KANS
IP Backbone CHIC-KANS



Start Time:Friday, December 19, 2014, 3:17 AM (0317) UTC



End Time:Friday, December 19, 2014, 3:19 AM (0319) UTC


Description:   The above listed was briefly unavailable while Level(3) engineers with the help of 
Internet2
engineers performed a circuit maintenance in Kansas City, Missouri. A brief outage 
was
experienced. This maintenance has been completed.



  







Ticket No.:1948:144



Subject:Emergency Maintenance Completed - I2 Optical DWDM System JCSN-MEMP 



Source Of Impact:Vendor



Affected:DWDM JCSN-MEMP
AL2S Backbones ATLA-JCSN and ATLA-HOUH
IP Backbone ATLA-HOUS



Start Time:Saturday, December 20, 2014, 10:35 PM (2235) UTC



End Time:Saturday, December 20, 2014, 10:47 PM (2247) UTC


Description:   Maintenance Completed. The above listed is now available after Level(3) 
Communications performed emergency maintenance to replace hardware in Memphis, 
TN.



  










Downtime and Availability







Unified - Internet2 Advanced Layer 2 Service Core NodesDown TimeReporting Period Availability52 Week Availability


sdn-sw.albu.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.alba.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.ashb.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96034%  99.96034%
sdn-sw.atla.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.bato.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.bost.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.char.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99639%  100.00000%
sdn-sw.chic.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99962%  99.99962%
sdn-sw.clev.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.colu4.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98900%  100.00000%
sdn-sw.dall.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.denv.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98710%  99.99051%
sdn-sw.elpa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99772%  100.00000%
sdn-sw.eqch.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99753%  100.00000%
sdn-sw.houh.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.jack.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99791%  100.00000%
sdn-sw.jcsn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.kans.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99658%  100.00000%
sdn-sw.losa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99715%  100.00000%
sdn-sw.minn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.miss2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.newy32aoa.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.phil.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.phoe.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.pitt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99886%  100.00000%
sdn-sw.port.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.rale.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.salt.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99696%  100.00000%
sdn-sw.seat.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
sdn-sw.star.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99013%  100.00000%
sdn-sw.sunn.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99583%  100.00000%
sdn-sw.tuls.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99526%  100.00000%
sdn-sw.wash.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981%  99.99981%
      
Aggregate Unified - Internet2 Advanced Layer 2 Service Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.99685%99.99849%

 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Unified - Internet2 Advanced Layer 2 Service Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


I2-ALBA-BOST-100GE-09210
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99905%99.99905%
I2-ALBA-CLEV-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99450%99.99715%
I2-ASHB-CHIC-100GE-11803
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93435%99.99943%
I2-ASHB-PITT-100GE-07737
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97590%99.99507%
I2-ASHB-WASH-100GE-09106
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98065%99.99450%
I2-ASHB-WASH-100GE-11823
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98084%99.99469%
I2-ATLA-CHAR-100GE-07739
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-CHIC-100GE-07740
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.71027%99.97249%
I2-ATLA-HOUH-10GE-07742
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JACK-100GE-07739
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93207%99.99734%
I2-ATLA-JCSN-100GE-10734
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-JCSN-100GE-10784
               0 hr 12 min0 hr 0 min
               99.88095%100.00000%
               99.82202%99.99886%
I2-ATLA-WASH-100GE-07738
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-BATO-HOUH-100GE-08860
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94289%99.99715%
I2-BATO-JACK-100GE-11005
               0 hr 1 min0 hr 1 min
               99.99008%99.99008%
               99.30954%99.57555%
I2-BOST-HART2-100GE-09211
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99108%99.99791%
I2-CHAR-RALE-100GE-10633
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99639%100.00000%
I2-CHIC-COLU4-100GE-11554
               1 hr 6 min0 hr 0 min
               99.34524%100.00000%
               99.95617%99.99924%
I2-CHIC-KANS-100GE-07745
               0 hr 2 min0 hr 0 min
               99.98016%100.00000%
               99.97344%99.99924%
I2-CHIC-STAR-100GE-07743
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97666%99.99962%
I2-CLEV-EQCH-100GE-07736
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95902%99.99962%
I2-CLEV-NEWY32AOA-100GE-07735
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-CLEV-PITT-100GE-10334
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98900%100.00000%
I2-CLEV-STAR-100GE-07736
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-COLU4-KANS-100GE-11548
               1 hr 6 min0 hr 0 min
               99.34524%100.00000%
               99.92069%99.98729%
I2-DALL-HOUH-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.89526%99.99469%
I2-DALL-TULS-100GE-11300
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99526%100.00000%
I2-DENV-ELPA-100GE-07748
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98444%99.99051%
I2-DENV-KANS-100GE-07746
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93378%99.99051%
I2-DENV-SALT-100GE-07747
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97742%99.98975%
I2-ELPA-HOUH-100GE-07749
               0 hr 12 min0 hr 12 min
               99.88095%99.88095%
               99.85732%99.93169%
I2-ELPA-PHOE-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ELPA-TUCS-100GE-07750
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99772%100.00000%
I2-EQCH-STAR-100GE-09299
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99374%100.00000%
I2-EQCH-MINN-100GE-12184
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99734%99.99981%
I2-HART2-NEWY32AOA-100GE-12947
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-HOUH-JCSN-100GE-10783
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.74158%99.82202%
I2-HOUH-TULS-100GE-07751
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-KANS-TULS-100GE-07753
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99070%100.00000%
I2-LOSA-PHOE-100GE-09190
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.80362%99.82715%
I2-LOSA-SALT-100GE-07757
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98900%100.00000%
I2-LOSA-SUNN-100GE-07755
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99298%100.00000%
I2-MINN-MISS2-100GE-09130
               0 hr 15 min0 hr 15 min
               99.85119%99.85119%
               99.97078%99.99450%
I2-MISS2-SEAT-100GE-13237
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99962%99.99962%
I2-NEWY23AOA-PHIL-100GE-07759
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99564%100.00000%
I2-PHIL-WASH-100GE-10867
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99450%99.99867%
I2-PHOE-TUCS-100GE-11990
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99734%100.00000%
I2-PORT-SEAT-100GE-08997
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98956%99.99962%
I2-PORT-SUNN-100GE-10343
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98994%99.99981%
I2-RALE-WASH-100GE-08888
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99677%99.99981%
I2-SALT-SUNN-100GE-07766
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99279%100.00000%
      
Aggregate All Unified - Internet2 Advanced Layer 2 Service Backbone Circuits
                   2 hr 54 min2 hr 26 min
                   99.96615%99.99455%
                   99.94944%99.98122%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  

Upcoming Scheduled Maintenances





Ticket No.:1949:144



Subject:Maintenance - I2 AL2S Backbone ELPA-HOUH



Affected:AL2S Backbone ELPA-HOUH
IP Backbone HOUS-LOSA



Start Time:Wednesday, December 24, 2014, 4:00 AM (0400) UTC



End Time:Wednesday, December 24, 2014, 6:00 AM (0600) UTC



Description:   The above listed will be unavailable while Level(3) Communications performs hardware 
maintenance in El Paso, TX.  An outage is expected; however the entire window is 
reserved.



  







Ticket No.:1950:144



Subject:Maintenance - I2 Optical DWDM System JCSN-MEMP



Affected:DWDM JCSN-MEMP
AL2S Backbones ATLA-JCSN and ATLA-HOUH
IP Backbone ATLA-HOUS



Start Time:Friday, December 26, 2014, 6:00 AM (0600) UTC



End Time:Friday, December 26, 2014, 8:00 AM (0800) UTC



Description:   The above listed will be unavailable while Level(3) Communications performs
maintenance to replace hardware in Memphis, TN. An outage is expected;
however, the entire window is reserved.