Unified - Internet2 IP Network Operations Report
03/30/2015 - 04/05/2015

Unified - Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Services

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Source Of Impact
Start Time (UTC)

End Time (UTC)





32654-Normal


Brief Outage - I2 AL2S Backbone CHIC-KANS
HardwareVendor
03/30/2015 4:05 PM
03/30/2015 4:06 PM


32814-Normal


Brief Outage Resolved - I2 AL2S Backbone CINC-INDI
UndeterminedVendor
03/31/2015 5:07 AM
03/31/2015 5:08 AM


33304-Normal


Outage Resolved - I2 AL2S Backbone CHIC-INDI
HardwareVendor
04/03/2015 3:53 AM
04/03/2015 9:49 AM






Unscheduled Outages Detail






Ticket No.:3265:144



Subject:Brief Outage - I2 AL2S Backbone CHIC-KANS



Source Of Impact:Vendor



Affected:AL2S Backbone CHIC-KANS
IP Backbone CHIC-KANS



Start Time:Monday, March 30, 2015, 4:05 PM (1605) UTC



End Time:Monday, March 30, 2015, 4:06 PM (1606) UTC


Description:The above listed asset is available after a brief outage. Internet2
Engineers  have determined that the issue was caused by hardware
failure. Workgroup administrators receive notifications from OESS
regarding circuits re-routed on the backbone.







Ticket No.:3281:144



Subject:Brief Outage Resolved - I2 AL2S Backbone CINC-INDI



Source Of Impact:Vendor



Affected:Optical Member ESnet
AL2S Backbone CINC-INDI
IP Backbone ATLA-CHIC



Start Time:Tuesday, March 31, 2015, 5:07 AM (0507) UTC



End Time:Tuesday, March 31, 2015, 5:08 AM (0508) UTC


Description:The above listed is available after a brief outage. Level(3) and Ciena Engineers
have determined that fiber disturbance caused the outage.
Workgroup administrators receive notifications from OESS regarding circuits re-
routed on the backbone.







Ticket No.:3330:144



Subject:Outage Resolved - I2 AL2S Backbone CHIC-INDI



Source Of Impact:Vendor



Affected:AL2S Backbone CHIC-INDI
IP Backbone ATLA-CHIC



Start Time:Friday, April 3, 2015, 3:53 AM (0353) UTC



End Time:Friday, April 3, 2015, 9:49 AM (0949) UTC


Description:The above listed asset is now available after an outage. Internet2 Engineers reported 
the outage was caused by a failed 100g line card in Indianapolis, which has now been 
replaced. Workgroup administrators received notifications from OESS regarding circuits 
re-routed on the backbone.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Source Of Impact
Start Time (UTC)
End Time (UTC)





3255
3-Elevated


Emergency Maintenance Completed - I2 AL2S Backbone ASHB-PITT
Circuit
Internal03/30/2015 1:14 AM
03/30/2015 1:16 AM


3212
3-Elevated


Maintenance Completed - I2 AL2S Core Node Insertion INDI
HardwareInternal
03/30/2015 8:01 AM
03/30/2015 9:53 AM


3295
3-Elevated


Emergency Maintenance Completed - I2 AL2S Backbones CHIC-KANS and DENV-KANS
Hardware
Internal04/02/2015 5:02 AM
04/02/2015 5:09 AM




Scheduled Maintenances Detail





Ticket No.:3255:144



Subject:Emergency Maintenance Completed - I2 AL2S Backbone ASHB-PITT



Source Of Impact:Internal



Affected:AL2S Backbone ASHB-PITT
IP Backbone CLEV-WASH
IP Backbone ATLA-CLEV



Start Time:Monday, March 30, 2015, 1:14 AM (0114) UTC



End Time:Monday, March 30, 2015, 1:16 AM (0116) UTC


Description:   The above listed asset was unavailable while Internet2 Engineers performed emergency circuit maintenance. A brief outage was experienced. Backbone traffic re-routed during this maintenance. Workgroup administrators received notifications from OESS regarding circuits re-routed on 
the backbone. Maintenance has been completed. No further outages are expected.



  







Ticket No.:3212:144



Subject:Maintenance Completed - I2 AL2S Core Node Insertion INDI



Source Of Impact:Internal



Affected:AL2S Core Node INDI
AL2S Backbone CHIC-CINC
IP Backbone ATLA-CHIC



Start Time:Monday, March 30, 2015, 8:01 AM (0801) UTC



End Time:Monday, March 30, 2015, 9:53 AM (0953) UTC


Description:   The above listed assets were unavailable while Internet2 Engineers performed 
insertion maintenance. Internet2 Engineers completed inserting the AL2S Core
Node INDI between CHIC and CINC. OESS administrators received notifications
of circuits re-routing. Maintenance has been completed. No further outages are 
expected.



  







Ticket No.:3295:144



Subject:Emergency Maintenance Completed - I2 AL2S Backbones CHIC-KANS and DENV-KANS



Source Of Impact:Internal



Affected:AL2S Backbones CHIC-KANS and DENV-KANS
IP Backbones CHIC-KANS and KANS-SALT



Start Time:Thursday, April 2, 2015, 5:02 AM (0502) UTC



End Time:Thursday, April 2, 2015, 5:09 AM (0509) UTC


Description:   The above listed assets are now available. Internet2 Engineers, with the
assistance of Level3 Technicians, performed emergency maintenance. Backbone traffic 
re-routed during this maintenance.



  










Downtime and Availability







Unified - Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability


ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
rtsw0.sing1.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
rtsw.sing2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%  100.00000%
      
Aggregate Unified - Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%100.00000%100.00000%

 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  
	    

	    
Unified - Internet2 IP Backbone CircuitsDown Time
Reporting Period Availability52 Week Availability


I2-ATLA-CLEV-VLAN-14832
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-CLEV-VLAN-14837
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14833
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14838
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14831
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14834
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181
               7 hr 49 min5 hr 57 min
               95.34722%96.45833%
               99.54899%99.86908%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.60876%99.99602%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92676%99.99696%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94004%99.99924%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183
               0 hr 8 min0 hr 1 min
               99.92063%99.99008%
               99.96699%99.99848%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94213%99.99469%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178
               0 hr 2 min0 hr 0 min
               99.98016%100.00000%
               99.94611%99.97666%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.90627%99.99677%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.62602%99.75125%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185
               0 hr 7 min0 hr 0 min
               99.93056%100.00000%
               99.89375%99.98975%
R&E 10G Backbone: I2-LOSA-PAIX-VLAN-23105
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Commodity 10G Backbone: I2-LOSA-PAIX-VLAN-23106
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98330%99.99905%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97647%99.99924%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97647%99.99924%
R&E 100G Backbone: I2-LOSA-WILC-VLAN-23103
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Commodity 100G Backbone: I2-LOSA-WILC-VLAN-23104
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.98216%99.99734%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99677%99.99981%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99677%99.99981%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09318
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92676%99.99696%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.73399%99.97287%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.20993%99.56208%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93871%100.00000%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.93739%99.99867%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.95788%99.99981%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99981%99.99981%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.96376%99.99962%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99867%99.99867%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.94346%99.99753%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.75789%99.82772%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92505%99.99924%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.92505%99.99924%
Legacy 10G Backbone: I2-LOSA-PAIX-10GE-05853
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99621%100.00000%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99013%100.00000%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.97818%99.99905%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99412%99.99981%
Legacy 100G Backbone: I2-LOSA-WILC-100GE-23893
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               100.00000%100.00000%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99696%99.99810%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565
               0 hr 0 min0 hr 0 min
               100.00000%100.00000%
               99.99981%99.99981%
      
Aggregate All Unified - Internet2 IP Backbone Circuits
                   8 hr 6 min2 hr 8 min
                   99.90160%99.92752%
                   99.92636%99.97780%


 NOTE: Numbers in italics represent downtime with scheduled  maintenance excluded. Internet2's definition of scheduled
  maintenance is any anticipated outage announced at least 72
  hours in advance of the outage start time.  

Upcoming Scheduled Maintenances





Ticket No.:3408:144



Subject:Maintenance - I2 Optical Various Circuits



Affected:Optical Member MAX Gigapop
Optical Member OARnet 
IP Backbone NEWY32AOA-WASH
IP Connector MAX GigaPOP and its Participants
IP Connector OARnet and its Participants



Start Time:Friday, April 24, 2015, 5:00 AM (0500) UTC



End Time:Friday, April 24, 2015, 7:00 AM (0700) UTC



Description:   The above listed optical circuits will be unavailable while Level3 Technicians 
perform maintenance to replace a card in McLean, VA. An outage is expected and the
entire maintenance window has been reserved.



  







Ticket No.:3405:144



Subject:Maintenance - I2 AL2S Participant PNWGP (CHIC and STAR)



Affected:AL2S Participant PNWGP (CHIC and STAR)



Start Time:Saturday, April 25, 2015, 3:00 PM (1500) UTC



End Time:Sunday, April 26, 2015, 1:00 AM (0100) UTC



Description:   The above listed assset will be unavailable while PNWGP Engineers perform 
maintenance.  An outage of 5 minutes  is expected; however, the entire window is 
reserved.



  







Ticket No.:3406:144



Subject:Maintenance 1 of 2 - I2 Optical Member CA*Net/CANARIE



Affected:Optical Member CA*Net/CANARIE



Start Time:Tuesday, April 28, 2015, 7:00 AM (0700) UTC



End Time:Tuesday, April 28, 2015, 12:00 PM (1200) UTC



Description:   The above listed assets may be unavailable while Zayo engineers perform
network maintenance for network optimization and durability. An outage of up to 
one hour is expected. The entire window is reserved.



  







Ticket No.:3407:144



Subject:Maintenance 2 of 2 - I2 Optical Member CA*Net/CANARIE



Affected:Optical Member CA*Net/CANARIE



Start Time:Wednesday, April 29, 2015, 7:00 AM (0700) UTC



End Time:Wednesday, April 29, 2015, 12:00 PM (1200) UTC



Description:   The above listed assets may be unavailable while Zayo engineers perform
network maintenance for network optimization and durability. An outage of up to
one hour is expected. The entire window is reserved.
*This is an alternate window for 3406:144, if necessary*