Generated Report for Internet2 IP

Internet2 IP Network Operations Report
06/16/2014 - 06/22/2014

Internet2 IP Network Operations Center
at Indiana University

New Connections

None

Upgrades

None

New Services

None

Unscheduled Outages Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Outage Type	Source Of Impact	*Start Time (UTC)*	*End Time (UTC)*

23297	3-Elevated	3-Elevated	Brief Outage - I2 IP Backbone ATLA-CHIC	Investigating	Undetermined	06/11/2014 6:16 PM	06/11/2014 6:17 PM
						06/17/2014 8:40 PM	06/17/2014 8:41 PM
						06/18/2014 3:14 PM	06/18/2014 3:15 PM
23287	1-Critical	1-Critical	Brief Outage Resolved - I2 IP Core Node SALT	Hardware	Internal	06/16/2014 10:10 AM	06/16/2014 10:11 AM
23309	2-High	2-High	Brief Outage - I2 IP Backbone ATLA-HOUS	Investigating	Undetermined	06/18/2014 8:04 PM	06/18/2014 8:05 PM

Unscheduled Outages Detail

Ticket No.:	23297:45
Subject:	Brief Outage - I2 IP Backbone ATLA-CHIC
Source Of Impact:	Undetermined
Affected:	Backbone ATLA-CHIC
Start Time:	Wednesday, June 11, 2014, 6:16 PM (1816) UTC
End Time:	Wednesday, June 11, 2014, 6:17 PM (1817) UTC
Start Time:	Tuesday, June 17, 2014, 8:40 PM (2040) UTC
End Time:	Tuesday, June 17, 2014, 8:41 PM (2041) UTC
Start Time:	Wednesday, June 18, 2014, 3:14 PM (1514) UTC
End Time:	Wednesday, June 18, 2014, 3:15 PM (1515) UTC
Description:	Backbone ATLA-CHIC was briefly unavailable. Internet2 Optical Vendor Engineers have been contacted, however the reason for the outage is pending.

Ticket No.:	23287:45
Subject:	Brief Outage Resolved - I2 IP Core Node SALT
Source Of Impact:	Internal
Affected:	Core Node SALT and its Connector(s) and Participants.
Start Time:	Monday, June 16, 2014, 10:10 AM (1010) UTC
End Time:	Monday, June 16, 2014, 10:11 AM (1011) UTC
Description:	Core Node SALT is now available after a brief outage. Internet2 Engineers have advised that this was related to a Routing Engine failure on the router in Salt Lake City, UT. All connections to the Core Node were affected.

Ticket No.:	23309:45
Subject:	Brief Outage - I2 IP Backbone ATLA-HOUS
Source Of Impact:	Undetermined
Affected:	Backbone ATLA-HOUS
Start Time:	Wednesday, June 18, 2014, 8:04 PM (2004) UTC
End Time:	Wednesday, June 18, 2014, 8:05 PM (2005) UTC
Description:	Backbone ATLA-HOUS was briefly unavailable. Internet2 Engineers are investigating the cause; however, the reason for the outage is pending. IP traffic re-routed during the outage.

Scheduled Maintenances Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Maintenance Type	Source Of Impact	*Start Time (UTC)*	*End Time (UTC)*

23319	3-Elevated	2-High	Emergency Maintenance Completed - I2 IP Backbones ATLA-CHIC and CHIC-CLEV	Hardware	Vendor	06/21/2014 5:09 AM	06/21/2014 6:29 AM

Scheduled Maintenances Detail

Ticket No.:	23319:45
Subject:	Emergency Maintenance Completed - I2 IP Backbones ATLA-CHIC and CHIC-CLEV
Source Of Impact:	Vendor
Affected:	Backbone ATLA-CHIC Backbone CHIC-CLEV Interconnect to AL2S Connector Indiana Gigapop (CHIC)* Connector ESnet (CHIC)* Net+ Provider Code42 (CHIC)* Participant GENI (CHIC)* Connector MREN (CHIC)*
Start Time:	Saturday, June 21, 2014, 5:09 AM (0509) UTC
End Time:	Saturday, June 21, 2014, 6:29 AM (0629) UTC
Description:	The above listed was unavailable while Level 3 Engineers worked with Internet2 Engineers to perform hardware maintenance. Maintenance has been completed. No further outages are expected. IP traffic re-routed during this maintenance. * indicates multihomed status, and thus the entity will remain available.

Downtime and Availability

Internet2 IP Core Nodes	Down Time		Reporting Period Availability		52 Week Availability
ATLA MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99355%	99.99867%
CHIC MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98501%	99.99905%
CLEV MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99089%	99.99924%
HOUS MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.97571%	100.00000%
KANS MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99639%	100.00000%
LOSA MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99184%	100.00000%
NEWY MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99943%	100.00000%
SALT MX960	0 hr 1 min	0 hr 1 min	99.99008%	99.99008%	99.99317%	99.99981%
SEAT MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99639%	100.00000%
WASH MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98843%	100.00000%
rtsw0.sing1.net.internet2.edu	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
rtsw.sing2.net.internet2.edu	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%

Aggregate Internet2 IP Core Nodes	0 hr 1 min	0 hr 1 min	99.99917%	99.99917%	99.99257%	99.99973%

** Less than 52 weeks of data available

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 IP Backbone Circuits	Down Time		Reporting Period Availability		52 Week Availability
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181	1 hr 22 min	0 hr 2 min	99.18651%	99.98016%	98.71642%	98.81508%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182	0 hr 1 min	0 hr 1 min	99.99008%	99.99008%	99.72260%	99.89526%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.78749%	99.84138%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.75979%	99.82848%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.92126%	99.97723%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98216%	99.99924%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.95105%	99.98179%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.72848%	99.77326%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.58428%	99.68333%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.93568%	99.97002%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.94592%	100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96205%	99.99905%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96205%	99.99905%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.94953%	99.95598%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98710%	99.99924%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98729%	99.99943%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.89564%	99.96774%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.38202%	99.73399%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.84707%	99.85030%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.84707%	99.85030%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96604%	99.98786%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.95048%	99.98710%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.95048%	99.98710%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96053%	99.99981%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.82886%	99.83891%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.67858%	99.75030%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.50269%	99.60667%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.81500%	99.90930%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.81481%	99.90912%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.74992%	99.80666%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96243%	99.99772%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.95921%	99.99772%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.78825%	99.91177%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98956%	99.99943%

Aggregate All Internet2 IP Backbone Circuits	1 hr 23 min	1 hr 20 min	99.97713%	99.99917%	99.82699%	99.88360%

* Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.

Upcoming Scheduled Maintenances

Ticket No.:	23219:45
Subject:	Maintenance - I2 IP Various Backbones
Affected:	Backbone ATLA-CHIC Backbone CHIC-CLEV Backbone HOUS-KANS Backbone CLEV-WASH ION Backbone CLEV-WASH ION Backbone HOUS-KANS ION Backbone ATLA-CHIC ION Backbone CHIC-CLEV
Start Time:	Thursday, June 26, 2014, 4:00 AM (0400) UTC
End Time:	Thursday, June 26, 2014, 11:00 AM (1100) UTC
Description:	The backbone listed above will be unavailable while Internet2 fiber provider Engineers perform maintenance. Outages are expected; however, the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:	23221:45
Subject:	Maintenance - I2 IP Various Backbones
Affected:	Backbone CLEV-NEWY32AOA Backbone LOSA-SEAT Backbone NEWY32AOA-WASH ION Backbone CLEV-NEWY32AOA ION Backbone NEWY32AOA-WASH
Start Time:	Friday, June 27, 2014, 4:00 AM (0400) UTC
End Time:	Friday, June 27, 2014, 11:00 AM (1100) UTC
Description:	The backbones listed above will be unavailable while Internet2's fiber provider Engineers perform maintenance. Outages are expected and the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:	23315:45
Subject:	Maintenance 1 of 2 - I2 IP Backbone HOUS-KANS
Affected:	Backbone HOUS-KANS
Start Time:	Saturday, June 28, 2014, 5:00 AM (0500) UTC
End Time:	Saturday, June 28, 2014, 11:00 AM (1100) UTC
Description:	Backbone HOUS-KANS will be unavailable while Level(3) Communications replaces damaged cable in Bardwell, TX. An outage is expected, and the entire window is reserved. IP traffic will re-route during this maintenance. * This is the 1st of 2 maintenance windows *

Ticket No.:	23317:45
Subject:	Maintenance 2 of 2 - I2 IP Backbone HOUS-KANS
Affected:	Backbone HOUS-KANS
Start Time:	Sunday, June 29, 2014, 5:00 AM (0500) UTC
End Time:	Sunday, June 29, 2014, 11:00 AM (1100) UTC
Description:	Backbone HOUS-KANS will be unavailable while Level(3) Communications replaces damaged cable in Bardwell, TX. An outage is expected, and the entire window is reserved. IP traffic will re-route during this maintenance. * This is the 2nd of 2 maintenance windows *

Ticket No.:	23222:45
Subject:	Maintenance - I2 IP Various Backbones
Affected:	ION Backbone ATLA-CHIC Backbone ATLA-CHIC ION Backbone ATLA-WASH Backbone ATLA-WASH ION Backbone CHIC-KANS Backbone CHIC-KANS ION Backbone HOUS-KANS Backbone HOUS-KANS
Start Time:	Thursday, July 3, 2014, 4:00 AM (0400) UTC
End Time:	Thursday, July 3, 2014, 11:00 AM (1100) UTC
Description:	The above listed backbones will be unavailable while Vendor Engineers perform maintenance. Outages are anticipated; however, the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:	23283:45
Subject:	Maintenance - I2 IP Backbone CHIC-KANS
Affected:	Backbone CHIC-KANS
Start Time:	Sunday, July 6, 2014, 5:00 AM (0500) UTC
End Time:	Sunday, July 6, 2014, 7:00 AM (0700) UTC
Description:	Backbone CHIC-KANS will be unavailable while Level(3) Communications performs maintenance to replace a card in Plainfield, IN. An outage is expected, and the entire window is reserved. IP traffic will re-route during this maintenance.