Generated Report for Internet2 IP

Internet2 IP Network Operations Report
11/30/2009 - 12/06/2009

Internet2 IP Network Operations Center
at Indiana University

New Connections

None

Upgrades

None

New Services

None

Unscheduled Outages Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Outage Type	*Start Time (UTC)*	*End Time (UTC)*

15070	2-High	2-High	Internet2 IP Network Backbone Circuits HOUS-LOSA & LOSA-SALT Brief Outage	Circuit - Other	12/04/2009 6:24 PM	12/04/2009 6:26 PM
15075	2-High	2-High	Internet2 IP Network Backbone Circuit CHIC-NEWY Outage Resolved	Circuit - Other	12/05/2009 3:41 AM	12/05/2009 8:08 PM
15082	1-Critical	1-Critical	Internet2 IP Network Core Node LOSA Brief Outage Resolved	Software	12/06/2009 7:21 AM	12/06/2009 7:24 AM
					12/06/2009 1:02 PM	12/06/2009 1:03 PM
					12/06/2009 1:41 PM	12/06/2009 1:42 PM
					12/06/2009 2:15 PM	12/06/2009 2:23 PM

Unscheduled Outages Detail

Ticket No.:	15070:45
Subject:	Internet2 IP Network Backbone Circuits HOUS-LOSA & LOSA-SALT Brief Outage
Affected:	Backbone Circuit HOUS-LOSA Backbone Circuit LOSA-SALT Connector Oregon GigaPOP IXP PacWave
Start Time:	Friday, December 4, 2009, 6:24 PM (1824) UTC
End Time:	Friday, December 4, 2009, 6:26 PM (1826) UTC
Description:	The above listed were briefly unavailable to the community. Internet2 Engineering with the help of Juniper support determined there was a temporary hardware failure that caused the outage.

Ticket No.:	15075:45
Subject:	Internet2 IP Network Backbone Circuit CHIC-NEWY Outage Resolved
Affected:	Backbone Circuit CHIC-NEWY Connector Nysernet
Start Time:	Saturday, December 5, 2009, 3:41 AM (0341) UTC
End Time:	Saturday, December 5, 2009, 8:08 PM (2008) UTC
Description:	Backbone Backbone Circuit CHIC-NEWY was unavailable to the community. Level(3) engineers replaced a failed DLM card and service has been restored.

Ticket No.:	15082:45
Subject:	Internet2 IP Network Core Node LOSA Brief Outage Resolved
Affected:	Core Node LOSA and its Connectors, Peers and Participants
Start Time:	Sunday, December 6, 2009, 7:21 AM (0721) UTC
End Time:	Sunday, December 6, 2009, 7:24 AM (0724) UTC
Start Time:	Sunday, December 6, 2009, 1:02 PM (1302) UTC
End Time:	Sunday, December 6, 2009, 1:03 PM (1303) UTC
Start Time:	Sunday, December 6, 2009, 1:41 PM (1341) UTC
End Time:	Sunday, December 6, 2009, 1:42 PM (1342) UTC
Start Time:	Sunday, December 6, 2009, 2:15 PM (1415) UTC
End Time:	Sunday, December 6, 2009, 2:23 PM (1423) UTC
Description:	Core Node LOSA was briefly unavailable. Internet2 Engineers resolved the outage with a software change. Connectivity has been restored.

Scheduled Maintenances Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Maintenance Type	*Start Time (UTC)*	*End Time (UTC)*

15046	3-Elevated	2-High	Internet2 IP Network Backbone Circuit CHIC-NEWY Maintenance Completed	Hardware	12/04/2009 8:45 AM	12/04/2009 8:56 AM
15051	3-Elevated	2-High	Internet2 IP Network Backbone Circuit CHIC-NEWY Emergency Maintenance Completed	Circuit	12/04/2009 8:04 AM	12/04/2009 8:32 AM
15085	3-Elevated	1-Critical	Internet2 IP Network Core Node LOSA Emergency Maintenance Completed	Software	12/06/2009 2:40 PM	12/06/2009 4:26 PM

Scheduled Maintenances Detail

Ticket No.:	15046:45
Subject:	Internet2 IP Network Backbone Circuit CHIC-NEWY Maintenance Completed
Affected:	Backbone CHIC-NEWY Connector Nysernet
Start Time:	Friday, December 4, 2009, 8:45 AM (0845) UTC
End Time:	Friday, December 4, 2009, 8:56 AM (0856) UTC
Description:	IP Backbone CHIC-NEWY & Connector Nysernet was unavailable while Level(3) Communications replaced failing hardware in Lawtons, NY. Outages were experienced during the maintenance window. Maintenance has been completed.

Ticket No.:	15051:45
Subject:	Internet2 IP Network Backbone Circuit CHIC-NEWY Emergency Maintenance Completed
Affected:	Backbone CHIC-NEWY Connector NYSERNet
Start Time:	Friday, December 4, 2009, 8:04 AM (0804) UTC
End Time:	Friday, December 4, 2009, 8:32 AM (0832) UTC
Description:	IP Backbone CHIC-NEWY and Connector NYSERNet were unavailable while Level(3) performed fiber maintenance in Buffalo, NY. Outages were experienced during the maintenance window. Maintenance has been completed.

Ticket No.:	15085:45
Subject:	Internet2 IP Network Core Node LOSA Emergency Maintenance Completed
Affected:	Core Node LOSA and its Connectors, Peers and Participants
Start Time:	Sunday, December 6, 2009, 2:40 PM (1440) UTC
End Time:	Sunday, December 6, 2009, 4:26 PM (1626) UTC
Description:	Internet2 Engineers performed software maintenance in Los Angeles, CA. Maintenance has been completed.

Downtime and Availability

Internet2 IP Core Nodes	Down Time	Reporting Period Availability	52 Week Availability
CHIC T640	0 hr 0 min	100.00000%	99.98292%
NEWY T640	0 hr 0 min	100.00000%	99.97780%
SEAT T640	0 hr 0 min	100.00000%	99.99962%
WASH T640	0 hr 0 min	100.00000%	99.97571%
HOUS T640	0 hr 0 min	100.00000%	99.99203%
LOSA T640	1 hr 59 min	98.81944%	99.97704%
ATLA T640	0 hr 0 min	100.00000%	99.95636%
SALT T640	0 hr 0 min	100.00000%	100.00000%
KANS T640	0 hr 0 min	100.00000%	99.99848%

Aggregate Internet2 IP Core Nodes	1 hr 59 min	99.86883%	99.98444%

** Less than 52 weeks of data available

Internet2 IP Backbone Circuits	Down Time	Reporting Period Availability	52 Week Availability
I2-HOUS-LOSA-O192-05458	0 hr 2 min	99.98016%	99.99924%
I2-ATLA-CHIC-10GE-05419	0 hr 0 min	100.00000%	100.00000%
I2-HOUS-KANS-O192-05459	0 hr 0 min	100.00000%	99.99943%
I2-CHIC-KANS-O192-03918	0 hr 0 min	100.00000%	99.92828%
I2-CHIC-NEWY32AOA-10GE-05239	17 hr 6 min	89.82143%	99.80533%
I2-NEWY32AOA-WASH-10GE-05242	0 hr 0 min	100.00000%	100.00000%
** I2-CHIC-KANS-O192-03919	0 hr 0 min	100.00000%	99.93682%
I2-CHIC-WASH-10GE-05250	0 hr 0 min	100.00000%	100.00000%
I2-HOUS-KANS-O192-03921	0 hr 0 min	100.00000%	99.96395%
** I2-NEWY32AOA-WASH-10GE-04643	0 hr 0 min	100.00000%	99.93094%
I2-ATLA-WASH-10GE-05251	0 hr 0 min	100.00000%	99.99867%
I2-ATLA-WASH-10GE-05133	0 hr 0 min	100.00000%	99.47518%
I2-ATLA-HOUS-10GE-05423	0 hr 0 min	100.00000%	99.99962%
I2-KANS-SALT-O192-03920	0 hr 0 min	100.00000%	99.96926%
I2-KANS-SALT-10GE-05138	0 hr 0 min	100.00000%	99.96869%
I2-SALT-SEAT-O192-03926	0 hr 0 min	100.00000%	99.92486%
I2-HOUS-LOSA-O192-03923	0 hr 2 min	99.98016%	99.85314%
I2-LOSA-SALT-O192-03925	0 hr 2 min	99.98016%	99.96547%
I2-LOSA-SEAT-O192-03924	0 hr 0 min	100.00000%	99.97875%

Aggregate All Internet2 IP Backbone Circuits	17 hr 12 min	99.46115%	99.93145%

Upcoming Scheduled Maintenances

Ticket No.:	15072:45
Subject:	Internet2 IP Network Backbone NEWY-WASH Maintenance
Affected:	Backbone NEWY-WASH
Start Time:	Monday, December 14, 2009, 5:00 AM (0500) UTC
End Time:	Monday, December 14, 2009, 11:00 AM (1100) UTC
Description:	IP Backbone NEWY-WASH will be unavailable while Level(3) performs fiber relocation in Philadelphia, PA. An outage up to two hours in length is expected however, the entire maintenance window is reserved. Internet2 has requested Level(3) Communications reschedule due to a concurrent maintenance in Atlanta, GA.

Ticket No.:	15076:45
Subject:	Internet2 IP Network Backbone NEWY-WASH Maintenance (Backout Night 1 for 15072:45)
Affected:	Backbone NEWY-WASH
Start Time:	Wednesday, December 16, 2009, 5:00 AM (0500) UTC
End Time:	Wednesday, December 16, 2009, 11:00 AM (1100) UTC
Description:	IP Backbone NEWY-WASH will be unavailable while Level(3) performs fiber relocation in Philadelphia, PA. An outage up to two hours in length is expected however, the entire maintenance window is reserved. Internet2 has requested Level(3) Communications reschedule due to a concurrent maintenance in Atlanta, GA.

Ticket No.:	15077:45
Subject:	Internet2 IP Network Backbone NEWY-WASH Maintenance (Backout Night 2 for 15072:45)
Affected:	Backbone NEWY-WASH
Start Time:	Thursday, December 17, 2009, 5:00 AM (0500) UTC
End Time:	Thursday, December 17, 2009, 11:00 AM (1100) UTC
Description:	IP Backbone NEWY-WASH will be unavailable while Level(3) performs fiber relocation in Philadelphia, PA. An outage up to two hours in length is expected however, the entire maintenance window is reserved. Internet2 has requested Level(3) Communications reschedule due to a concurrent maintenance in Atlanta, GA.

Ticket No.:	15078:45
Subject:	Internet2 IP Network Backbone NEWY-WASH Maintenance (Backout Night 3 for 15072:45)
Affected:	Backbone NEWY-WASH
Start Time:	Friday, December 18, 2009, 5:00 AM (0500) UTC
End Time:	Friday, December 18, 2009, 11:00 AM (1100) UTC
Description:	IP Backbone NEWY-WASH will be unavailable while Level(3) performs fiber relocation in Philadelphia, PA. An outage up to two hours in length is expected however, the entire maintenance window is reserved. Internet2 has requested Level(3) Communications reschedule due to a concurrent maintenance in Atlanta, GA.

Ticket No.:	15041:45
Subject:	Internet2 IP Network Backbone ATLA-CHIC Maintenance
Affected:	IP Backbone ATLA-CHIC Connector KyRON Connector Indiana Gigapop (ATLA)
Start Time:	Thursday, December 10, 2009, 5:00 AM (0500) UTC
End Time:	Thursday, December 10, 2009, 11:00 AM (1100) UTC
Description:	IP Backbone ATLA-CHIC will be unavailable while Level(3) communications replaces damaged fiber in Shelbyville, IN. Outages are expected throughout the entire maintenance window.

Ticket No.:	15042:45
Subject:	Internet2 IP Network Backbone ATLA-CHIC Maintenance (Backout for 15041:45)
Affected:	IP Backbone ATLA-CHIC Connector KyRON Connector Indiana Gigapop (ATLA)
Start Time:	Friday, December 11, 2009, 5:00 AM (0500) UTC
End Time:	Friday, December 11, 2009, 11:00 AM (1100) UTC
Description:	IP Backbone ATLA-CHIC will be unavailable while Level(3) communications replaces damaged fiber in Shelbyville, IN. Outages are expected throughout the entire maintenance window.