Generated Report for Internet2 IP

Internet2 IP Network Operations Report
08/13/2007 - 08/19/2007

Internet2 IP Network Operations Center
at Indiana University

New Customers

None

Upgrades

None

New Services

None

Unscheduled Outages Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Outage Type	*Start Time (UTC)*	*End Time (UTC)*

10641	2-High	2-High	Internet2 IP Network Backbone Circuit CHIC-ATLA Outage Resolved	Hardware	08/09/2007 4:16 PM	08/10/2007 12:38 AM
					08/10/2007 1:51 AM	08/10/2007 6:17 PM
					08/11/2007 4:53 PM	08/12/2007 4:58 AM
					08/12/2007 5:45 AM	08/13/2007 2:45 AM
10686	1-Critical	1-Critical	Internet2 IP Network Core Node NEWY FPC0 Brief Outage	Undetermined	08/14/2007 11:37 AM	08/14/2007 11:38 AM
					08/14/2007 6:18 PM	08/14/2007 6:21 PM
10696	1-Critical	1-Critical	Internet2 IP Network Core Node CHIC Available	Hardware	08/15/2007 5:46 PM	08/15/2007 5:48 PM
10729	1-Critical	1-Critical	Internet2 IP Network Core Node ATLA M5 Available	Undetermined	08/18/2007 6:23 AM	08/18/2007 6:58 AM

Unscheduled Outages Detail

Ticket No.:	10641:45
Subject:	Internet2 IP Network Backbone Circuit CHIC-ATLA Outage Resolved
Affected:	Backbone Circuit CHIC-ATLA
Start Time:	Thursday, August 9, 2007, 4:16 PM (1616) UTC
End Time:	Friday, August 10, 2007, 12:38 AM (0038) UTC
Start Time:	Friday, August 10, 2007, 1:51 AM (0151) UTC
End Time:	Friday, August 10, 2007, 6:17 PM (1817) UTC
Start Time:	Saturday, August 11, 2007, 4:53 PM (1653) UTC
End Time:	Sunday, August 12, 2007, 4:58 AM (0458) UTC
Start Time:	Sunday, August 12, 2007, 5:45 AM (0545) UTC
End Time:	Monday, August 13, 2007, 2:45 AM (0245) UTC
Description:	Backbone circuit CHIC-ATLA was unavailable to the community. Internet2 NOC engineering, with the assistance of Level(3) Communications engineers, restored service by rebuilding the circuit. Service has been restored. *Traffic is re-routing

Ticket No.:	10686:45
Subject:	Internet2 IP Network Core Node NEWY FPC0 Brief Outage
Affected:	Backbone Circuit NEWY-WASH Connector NOX Peer Tenet
Start Time:	Tuesday, August 14, 2007, 11:37 AM (1137) UTC
End Time:	Tuesday, August 14, 2007, 11:38 AM (1138) UTC
Start Time:	Tuesday, August 14, 2007, 6:18 PM (1818) UTC
End Time:	Tuesday, August 14, 2007, 6:21 PM (1821) UTC
Description:	Waiting on analysis of crash information from Juniper TAC. Juniper case# 2007-0815-0431

Ticket No.:	10696:45
Subject:	Internet2 IP Network Core Node CHIC Available
Affected:	Core Node CHIC and Its Connectors and Peers
Start Time:	Wednesday, August 15, 2007, 5:46 PM (1746) UTC
End Time:	Wednesday, August 15, 2007, 5:48 PM (1748) UTC
Description:	Core Node CHIC was unavailable to the Internet 2 IP community. The routing process reset on the router causing all bgp sessions to reset. Internet 2 IP Network Engineers have opened a case with Juniper. The router is currently stable.

Ticket No.:	10729:45
Subject:	Internet2 IP Network Core Node ATLA M5 Available
Affected:	Core Node ATLA M5
Start Time:	Saturday, August 18, 2007, 6:23 AM (0623) UTC
End Time:	Saturday, August 18, 2007, 6:58 AM (0658) UTC
Description:	Core Node ATLA M5 was unavailable to the Internet2 IP Network community. The engineer indicated that the router had crashed and did not boot up properly. It had to be rebooted and now it is functioning.

Scheduled Maintenances Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Maintenance Type	*Start Time (UTC)*	*End Time (UTC)*

10681	3-Elevated	2-High	Internet2 IP Network Backbone Circuit STTL-SNVA Emergency Maintenance Completed	Circuit	08/14/2007 6:48 AM	08/14/2007 7:20 AM
					08/15/2007 6:32 AM	08/15/2007 6:36 AM
10668	3-Elevated	1-Critical	Internet2 IP Network Core Node NEWY Maintenance Completed	Software	08/18/2007 3:03 AM	08/18/2007 3:06 AM
10669	3-Elevated	1-Critical	Internet2 IP Network Core Node SEAT Maintenance Completed	Software	08/18/2007 3:13 AM	08/18/2007 3:15 AM
10670	3-Elevated	1-Critical	Internet2 IP Network Core Node ATLA Maintenance Completed	Software	08/18/2007 3:21 AM	08/18/2007 3:23 AM
10671	3-Elevated	1-Critical	Internet2 IP Network Core Node ATLA M5 Maintenance Completed	Software	08/18/2007 3:22 AM	08/18/2007 3:24 AM
10672	3-Elevated	1-Critical	Internet2 IP Network Core Node LOSA Maintenance Completed	Software	08/18/2007 3:33 AM	08/18/2007 3:36 AM
10673	3-Elevated	1-Critical	Internet2 IP Network Core Node WASH Maintenance Completed	Software	08/18/2007 3:42 AM	08/18/2007 3:44 AM
10674	3-Elevated	1-Critical	Internet2 IP Network Core Node HSTN Maintenance Completed	Software	08/18/2007 3:51 AM	08/18/2007 3:54 AM
10676	3-Elevated	1-Critical	Internet2 IP Network Core Node KANS Maintenance Completed	Software	08/18/2007 3:59 AM	08/18/2007 4:02 AM
10677	3-Elevated	1-Critical	Internet2 IP Network Core Node SNVA Maintenance Completed	Software	08/18/2007 4:11 AM	08/18/2007 4:14 AM
10678	3-Elevated	1-Critical	Internet2 IP Network Core Node CHIC Maintenance Completed	Software	08/18/2007 4:21 AM	08/18/2007 4:24 AM

Scheduled Maintenances Detail

Ticket No.:	10681:45
Subject:	Internet2 IP Network Backbone Circuit STTL-SNVA Emergency Maintenance Completed
Affected:	Backbone Circuit STTL-SNVA
Start Time:	Tuesday, August 14, 2007, 6:48 AM (0648) UTC
End Time:	Tuesday, August 14, 2007, 7:20 AM (0720) UTC
Start Time:	Wednesday, August 15, 2007, 6:32 AM (0632) UTC
End Time:	Wednesday, August 15, 2007, 6:36 AM (0636) UTC
Description:	Internet2 IP Network Backbone circuit STTL-SNVA may experience a brief outage during the above time frame while Qwest Communications relocates fiber. A 5-10 minute outage can be expected; however, the entire maintenance window has been reserved. Maintenance has been completed.

Ticket No.:	10668:45
Subject:	Internet2 IP Network Core Node NEWY Maintenance Completed
Affected:	Core Node NEWY and Its Connectors, Participants, and Peers
Start Time:	Saturday, August 18, 2007, 3:03 AM (0303) UTC
End Time:	Saturday, August 18, 2007, 3:06 AM (0306) UTC
Description:	Internet2 engineers performed software upgrades on the Internet2 core nodes. Maintenance has been completed.

Ticket No.:	10669:45
Subject:	Internet2 IP Network Core Node SEAT Maintenance Completed
Affected:	Core Node SEAT and Its Connectors, Participants, and Peers
Start Time:	Saturday, August 18, 2007, 3:13 AM (0313) UTC
End Time:	Saturday, August 18, 2007, 3:15 AM (0315) UTC
Description:	Internet2 engineers performed software upgrades on the Internet2 core nodes. Maintenance has been completed.

Ticket No.:	10670:45
Subject:	Internet2 IP Network Core Node ATLA Maintenance Completed
Affected:	Core Node ATLA and Its Connectors, Participants, and Peers
Start Time:	Saturday, August 18, 2007, 3:21 AM (0321) UTC
End Time:	Saturday, August 18, 2007, 3:23 AM (0323) UTC
Description:	Internet2 engineers performed software upgrades on the Internet2 core nodes. Maintenance has been completed.

Ticket No.:	10671:45
Subject:	Internet2 IP Network Core Node ATLA M5 Maintenance Completed
Affected:	Core Node ATLA M5 and Its Participants
Start Time:	Saturday, August 18, 2007, 3:22 AM (0322) UTC
End Time:	Saturday, August 18, 2007, 3:24 AM (0324) UTC
Description:	Internet2 engineers performed software upgrades on the Internet2 core nodes. Maintenance has been completed.

Ticket No.:	10672:45
Subject:	Internet2 IP Network Core Node LOSA Maintenance Completed
Affected:	Core Node LOSA and Its Connectors, Participants, and Peers
Start Time:	Saturday, August 18, 2007, 3:33 AM (0333) UTC
End Time:	Saturday, August 18, 2007, 3:36 AM (0336) UTC
Description:	Internet2 engineers performed software upgrades on the Internet2 core nodes. Maintenance has been completed.

Ticket No.:	10673:45
Subject:	Internet2 IP Network Core Node WASH Maintenance Completed
Affected:	Core Node WASH and Its Connectors, Participants, and Peers
Start Time:	Saturday, August 18, 2007, 3:42 AM (0342) UTC
End Time:	Saturday, August 18, 2007, 3:44 AM (0344) UTC
Description:	Internet2 engineers performed software upgrades on the Internet2 core nodes. Maintenance has been completed.

Ticket No.:	10674:45
Subject:	Internet2 IP Network Core Node HSTN Maintenance Completed
Affected:	Core Node HSTN and Its Connectors, Participants, and Peers
Start Time:	Saturday, August 18, 2007, 3:51 AM (0351) UTC
End Time:	Saturday, August 18, 2007, 3:54 AM (0354) UTC
Description:	Internet2 engineers performed software upgrades on the Internet2 core nodes. Maintenance has been completed.

Ticket No.:	10676:45
Subject:	Internet2 IP Network Core Node KANS Maintenance Completed
Affected:	Core Node KANS and Its Connectors, Participants, and Peers
Start Time:	Saturday, August 18, 2007, 3:59 AM (0359) UTC
End Time:	Saturday, August 18, 2007, 4:02 AM (0402) UTC
Description:	Internet2 engineers performed software upgrades on the Internet2 core nodes. Maintenance has been completed.

Ticket No.:	10677:45
Subject:	Internet2 IP Network Core Node SNVA Maintenance Completed
Affected:	Core Node SNVA and Its Connectors, Participants, and Peers
Start Time:	Saturday, August 18, 2007, 4:11 AM (0411) UTC
End Time:	Saturday, August 18, 2007, 4:14 AM (0414) UTC
Description:	Internet2 engineers performed software upgrades on the Internet2 core nodes. Maintenance has been completed.

Ticket No.:	10678:45
Subject:	Internet2 IP Network Core Node CHIC Maintenance Completed
Affected:	Core Node CHIC and Its Connectors, Participants, and Peers
Start Time:	Saturday, August 18, 2007, 4:21 AM (0421) UTC
End Time:	Saturday, August 18, 2007, 4:24 AM (0424) UTC
Description:	Internet2 engineers performed software upgrades on the Internet2 core nodes. Maintenance has been completed.

Downtime and Availability

Internet2 IP Core Nodes	Down Time	Reporting Period Availability	52 Week Availability
** CHIC T640	0 hr 0 min	100.00000%	100.00000%
DNVR T640	0 hr 0 min	100.00000%	99.99962%
HSTN T640	0 hr 3 min	99.97024%	99.99561%
LOSA T640	0 hr 3 min	99.97024%	98.95643%
** NEWY T640	0 hr 3 min	99.97024%	99.99943%
SNVA T640	0 hr 3 min	99.97024%	99.99695%
** SEAT T640	0 hr 2 min	99.98016%	99.99924%
** WASH T640	0 hr 0 min	100.00000%	100.00000%
ATLA M5	0 hr 37 min	99.63294%	99.99046%
** ATLA T640	0 hr 2 min	99.98016%	99.99752%
** SALT T640	0 hr 0 min	100.00000%	100.00000%
** KANS T640	0 hr 3 min	99.97024%	99.99943%

Aggregate Internet2 IP Core Nodes	0 hr 56 min	99.95370%	99.91122%

** Less than 52 weeks of data available

Internet2 IP Backbone Circuits	Down Time	Reporting Period Availability	33 Week Availability
DNVR-SNVA OC-192	0 hr 0 min	100.00000%	100.00000%
DENV-STTL OC-192	0 hr 0 min	100.00000%	99.96573%
HSTN-LOSA OC-192	0 hr 0 min	100.00000%	99.97896%
LOSA-SNVA OC-192	0 hr 0 min	100.00000%	100.00000%
ATLA-HSTN OC-192	0 hr 0 min	100.00000%	99.55477%
SNVA-STTL OC-192	0 hr 36 min	99.64286%	99.74417%
** I2-CHIC-ATLA	2 hr 45 min	98.36310%	98.94150%
** I2-CHIC-NEWY	0 hr 0 min	100.00000%	99.78656%
** I2-CHIC-KANS	0 hr 0 min	100.00000%	100.00000%
** I2-CHIC-WASH	0 hr 0 min	100.00000%	100.00000%
** I2-NEWY-WASH	0 hr 4 min	99.96032%	99.99549%
** I2-WASH-ATLA	0 hr 0 min	100.00000%	99.97956%
** I2-ATLA-HOUS	0 hr 0 min	100.00000%	99.91071%
** I2-KANS-ATLA	0 hr 0 min	100.00000%	99.74176%
** I2-KANS-SALT	0 hr 0 min	100.00000%	100.00000%
** I2-SALT-SEAT	0 hr 0 min	100.00000%	100.00000%

Aggregate All Internet2 IP Backbone Circuits	3 hr 25 min	99.87289%	99.84995%

Upcoming Scheduled Maintenances

Ticket No.:	10781:45
Subject:	Internet2 IP Network Backbone Circuit NEWY-WASH Maintenance
Affected:	Backbone circuit NEWY-WASH Peer ESNET
Start Time:	Tuesday, September 11, 2007, 4:00 AM (0400) UTC
End Time:	Tuesday, September 11, 2007, 10:00 AM (1000) UTC
Description:	Backbone circuit NEWY-WASH will be unavailable to the Internet2 IP community for 2 hours while Level(3) Communications performs circuit maintenance in Newark NJ. The entire maintenance window will be observed.