Generated Report for Internet2 IP

Internet2 IP Network Operations Report
07/28/2014 - 08/03/2014

Internet2 IP Network Operations Center
at Indiana University

New Connections

None

Upgrades

None

New Services

None

Unscheduled Outages Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Outage Type	Source Of Impact	*Start Time (UTC)*	*End Time (UTC)*

23557	2-High	2-High	Outage Resovled - I2 IP Backbone CHIC-CLEV	Investigating	Undetermined	07/29/2014 12:05 AM	07/29/2014 12:06 AM
23519	2-High	2-High	Outage Resovled - I2 IP Backbone CHIC-CLEV	Cut or Damaged Fiber	Vendor	07/30/2014 1:43 PM	07/30/2014 9:26 PM
23540	2-High	2-High	Brief Outage - I2 IP Backbone NEWY-WASH	Undetermined	Undetermined	08/02/2014 8:43 AM	08/02/2014 8:44 AM
23543	2-High	2-High	Brief Outage - I2 IP Backbone ATLA-HOUS	Undetermined	Undetermined	08/03/2014 9:43 PM	08/03/2014 9:44 PM

Unscheduled Outages Detail

Ticket No.:	23557:45
Subject:	Outage Resovled - I2 IP Backbone CHIC-CLEV
Source Of Impact:	Undetermined
Affected:	Backbone CHIC-CLEV
Start Time:	Tuesday, July 29, 2014, 12:05 AM (0005) UTC
End Time:	Tuesday, July 29, 2014, 12:06 AM (0006) UTC
Description:	Backbone CHIC-CLEV is now available after a brief outage. Internet2's fiber vendor is currently investigating the issue. Backbone traffic re-routed during this event.

Ticket No.:	23519:45
Subject:	Outage Resovled - I2 IP Backbone CHIC-CLEV
Source Of Impact:	Vendor
Affected:	Backbone CHIC-CLEV Connector MREN (STAR-WASH)
Start Time:	Wednesday, July 30, 2014, 1:43 PM (1343) UTC
End Time:	Wednesday, July 30, 2014, 9:26 PM (2126) UTC
Description:	Backbone CHIC-CLEV is now available. Internet2's fiber provider has indicated that the reason for the outage is fiber damage due to construction. All repairs have been completed and no further outages are expected. IP traffic re-routed during the outage.

Ticket No.:	23540:45
Subject:	Brief Outage - I2 IP Backbone NEWY-WASH
Source Of Impact:	Undetermined
Affected:	Backbone NEWY-WASH
Start Time:	Saturday, August 2, 2014, 8:43 AM (0843) UTC
End Time:	Saturday, August 2, 2014, 8:44 AM (0844) UTC
Description:	Backbone NEWY-WASH was briefly unavailable. Internet2 Engineers are investigating the cause; however, the reason for the outage is pending. IP traffic re-routed.

Ticket No.:	23543:45
Subject:	Brief Outage - I2 IP Backbone ATLA-HOUS
Source Of Impact:	Undetermined
Affected:	Backbone ATLA-HOUS
Start Time:	Sunday, August 3, 2014, 9:43 PM (2143) UTC
End Time:	Sunday, August 3, 2014, 9:44 PM (2144) UTC
Description:	Backbone ATLA-HOUS is unavailable. Internet2's fiber provider is investigating the cause; however, the reason for the outage is pending. IP traffic re-routed during the outage.

Scheduled Maintenances Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Maintenance Type	Source Of Impact	*Start Time (UTC)*	*End Time (UTC)*

23481	3-Elevated	1-Critical	Maintenance Completed- I2 IP Various Backbones (WASH)	Power	Internal	07/29/2014 4:02 AM	07/29/2014 6:51 AM
23529	3-Elevated	2-High	Emergency Maintenance Completed - I2 IP Backbone LOSA-SEAT	Circuit	Vendor	08/01/2014 7:10 AM	08/01/2014 7:40 AM

Scheduled Maintenances Detail

Ticket No.:	23481:45
Subject:	Maintenance Completed- I2 IP Various Backbones (WASH)
Source Of Impact:	Internal
Affected:	Backbone NEWY32AOA-WASH Backbone CLEV-WASH Backbone ATLA-WASH Backbone CHIC-WASH IP to AL2S Interconnect
Start Time:	Tuesday, July 29, 2014, 4:02 AM (0402) UTC
End Time:	Tuesday, July 29, 2014, 6:51 AM (0651) UTC
Description:	The above listed backbones and interconnect with I2 AL2S were unavailable while Internet2 Engineers executed power maintenance. Outages were experienced during the window. The maintenance is now completed.

Ticket No.:	23529:45
Subject:	Emergency Maintenance Completed - I2 IP Backbone LOSA-SEAT
Source Of Impact:	Vendor
Affected:	Backbone LOSA-SEAT
Start Time:	Friday, August 1, 2014, 7:10 AM (0710) UTC
End Time:	Friday, August 1, 2014, 7:40 AM (0740) UTC
Description:	Backbone LOSA-SEAT was unavailable while Level(3) Communications performed emergency maintenance to relocate cable to a new bridge in Oregon, which is completed. IP traffic re-routed during this maintenance.

Downtime and Availability

Internet2 IP Core Nodes	Down Time		Reporting Period Availability		52 Week Availability
ATLA MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99412%	99.99867%
CHIC MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98691%	100.00000%
CLEV MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99165%	99.99924%
HOUS MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99734%	100.00000%
KANS MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99734%	100.00000%
LOSA MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99203%	100.00000%
NEWY MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99943%	100.00000%
SALT MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99317%	99.99981%
SEAT MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99734%	100.00000%
WASH MX960	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98937%	100.00000%
rtsw0.sing1.net.internet2.edu	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
rtsw.sing2.net.internet2.edu	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%

Aggregate Internet2 IP Core Nodes	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.99489%	99.99981%

** Less than 52 weeks of data available

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 IP Backbone Circuits	Down Time		Reporting Period Availability		52 Week Availability
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.76624%	99.95560%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182	0 hr 1 min	0 hr 1 min	99.99008%	99.99008%	99.64405%	99.89451%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179	2 hr 49 min	0 hr 0 min	98.32341%	100.00000%	99.73930%	99.82525%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180	7 hr 44 min	7 hr 44 min	95.39683%	95.39683%	99.50175%	99.66056%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.90551%	99.97723%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.97230%	99.99924%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178	2 hr 49 min	0 hr 0 min	98.32341%	100.00000%	99.81273%	99.96566%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.62337%	99.71748%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.58428%	99.68333%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.68750%	99.73361%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.94592%	100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187	0 hr 30 min	0 hr 0 min	99.70238%	100.00000%	99.94896%	99.99905%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328	0 hr 30 min	0 hr 0 min	99.70238%	100.00000%	99.94422%	99.99905%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176	2 hr 50 min	0 hr 1 min	98.31349%	99.99008%	99.89640%	99.93966%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98729%	99.99943%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98729%	99.99943%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09318	2 hr 49 min	0 hr 0 min	98.32341%	100.00000%	99.69718%	99.81349%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.89507%	99.96774%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.34009%	99.73361%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.84707%	99.85030%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.84707%	99.85030%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891	7 hr 43 min	7 hr 43 min	95.40675%	95.40675%	99.65847%	99.68067%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.93473%	99.98710%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.93473%	99.98710%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.96053%	99.99981%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.82886%	99.83891%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.64879%	99.75011%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	100.00000%	100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.51617%	99.60705%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.84384%	99.90930%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.84384%	99.90930%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.74992%	99.80666%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564	0 hr 30 min	0 hr 0 min	99.70238%	100.00000%	99.95674%	99.99772%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572	0 hr 30 min	0 hr 0 min	99.70238%	100.00000%	99.95351%	99.99772%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.78825%	99.91177%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565	0 hr 0 min	0 hr 0 min	100.00000%	100.00000%	99.98956%	99.99943%

Aggregate All Internet2 IP Backbone Circuits	28 hr 45 min	13 hr 16 min	99.53748%	99.75091%	99.81572%	99.89046%

* Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.

Upcoming Scheduled Maintenances

Ticket No.:	23465:45
Subject:	Maintenance Tracking - I2 IP Node oob.kans & oob.chic
Affected:
Start Time:	Thursday, August 7, 2014, 5:00 AM (0500) UTC
End Time:	Thursday, August 7, 2014, 9:00 AM (0900) UTC
Description:	Node oob.kans may be unavailable while Level 3 Engineers perform maintenance. Level 3 has indicated a possible outage of up to 30 minutes, but Internet2 does not expect this to be service-impacting.

Ticket No.:	23537:45
Subject:	Maintenance - I2 IP Backbone ATLA-HOUS
Affected:	Backbone ATLA-HOUS
Start Time:	Friday, August 8, 2014, 4:00 AM (0400) UTC
End Time:	Friday, August 8, 2014, 9:00 AM (0900) UTC
Description:	Backbone ATLA-HOUS will be unavailable while fiber provider Engineers perform maintenance in Tallahassee, FL. Outages are expected, and the entire window is reserved. IP traffic will re-route during this maintenance.