Generated Report for Internet2 IP

Internet2 IP Network Operations Report
09/10/2007 - 09/16/2007

Internet2 IP Network Operations Center
at Indiana University

New Customers

None

Upgrades

None

New Services

None

Unscheduled Outages Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Outage Type	*Start Time (UTC)*	*End Time (UTC)*

10884	2-High	2-High	Internet2 IP Network Backbone Circuit HOUS-LOSA Brief Outage Resolved	Undetermined	09/10/2007 5:21 PM	09/10/2007 5:22 PM
10916	2-High	2-High	Internet2 IP Network Backbone Circuit LOSA-SEAT Available	Undetermined	09/13/2007 5:55 PM	09/13/2007 5:57 PM
10931	2-High	2-High	Internet2 IP Network Backbone Circuit ATLA-HOUS Brief Outage	Undetermined	09/15/2007 6:54 PM	09/15/2007 6:55 PM

Unscheduled Outages Detail

Ticket No.:	10884:45
Subject:	Internet2 IP Network Backbone Circuit HOUS-LOSA Brief Outage Resolved
Affected:	Backbone Circuit HOUS-LOSA
Start Time:	Monday, September 10, 2007, 5:21 PM (1721) UTC
End Time:	Monday, September 10, 2007, 5:22 PM (1722) UTC
Description:	Backbone Circuit HOUS-LOSA was briefly unavailable to the Internet2 Community. Fiber Provider, Level(3) Communications reports that this was due to a power maintenance near our Infinera gear.

Ticket No.:	10916:45
Subject:	Internet2 IP Network Backbone Circuit LOSA-SEAT Available
Affected:	Backbone Circuit LOSA-SEAT
Start Time:	Thursday, September 13, 2007, 5:55 PM (1755) UTC
End Time:	Thursday, September 13, 2007, 5:57 PM (1757) UTC
Description:	Internet2 IP Network Backbone Circuit LOSA-SEAT was briefly unavailable to the community. Internet2 and Level(3) Engineers are investigating; however, no cause for the outage has been determined.

Ticket No.:	10931:45
Subject:	Internet2 IP Network Backbone Circuit ATLA-HOUS Brief Outage
Affected:	Backbone Circuit ATLA-HOUS I2-ALBU-ATLA-ESNET-00075
Start Time:	Saturday, September 15, 2007, 6:54 PM (1854) UTC
End Time:	Saturday, September 15, 2007, 6:55 PM (1855) UTC
Description:	Internet2 Backbone Circuit ATLA-HOUS was unavailable to the community. Level(3) Communications technicians report a possible faulty amp in Jacksonville, FL. The replacement has been shipped; however, no ETA is currently available.

Scheduled Maintenances Summary

Ticket Number	Customer Impact	Network Impact	*Title*	Maintenance Type	*Start Time (UTC)*	*End Time (UTC)*

10781	3-Elevated	2-High	Internet2 IP Network Backbone Circuit NEWY-WASH Maintenance Completed	Circuit	09/11/2007 4:30 AM	09/11/2007 4:43 AM
					09/11/2007 4:44 AM	09/11/2007 5:35 AM
10905	3-Elevated	1-Critical	Internet2 IP Network Core Node NEWY Maintenance Completed	Hardware	09/14/2007 4:47 AM	09/14/2007 4:55 AM
10869	3-Elevated	2-High	Internet2 IP Network Backbone Circuit HSTN-ATLA Maintenance Completed	Circuit	09/15/2007 4:12 AM	09/15/2007 4:22 AM
10836	3-Elevated	2-High	Internet2 IP Network Backbone Circuit ATLA-HOUS Emergency Maintenance Completed	Circuit	09/02/2007 3:37 AM	09/02/2007 3:38 AM
					09/02/2007 6:54 AM	09/02/2007 6:56 AM
					09/02/2007 10:22 AM	09/02/2007 10:23 AM
					09/15/2007 4:12 AM	09/15/2007 4:23 AM

Scheduled Maintenances Detail

Ticket No.:	10781:45
Subject:	Internet2 IP Network Backbone Circuit NEWY-WASH Maintenance Completed
Affected:	Backbone circuit NEWY-WASH Peer ESNET
Start Time:	Tuesday, September 11, 2007, 4:30 AM (0430) UTC
End Time:	Tuesday, September 11, 2007, 4:43 AM (0443) UTC
Start Time:	Tuesday, September 11, 2007, 4:44 AM (0444) UTC
End Time:	Tuesday, September 11, 2007, 5:35 AM (0535) UTC
Description:	Backbone circuit NEWY-WASH was unavailable to the Internet2 IP Network Community while Level(3) Communications performed circuit maintenance in Newark, NJ. The maintenance has been completed.

Ticket No.:	10905:45
Subject:	Internet2 IP Network Core Node NEWY Maintenance Completed
Affected:	Backbone Circuit NEWY-WASH IXP MANLAN HDXc Connector NOX Peer Tenet, SURFnet
Start Time:	Friday, September 14, 2007, 4:47 AM (0447) UTC
End Time:	Friday, September 14, 2007, 4:55 AM (0455) UTC
Description:	Internet2 IP Network Engineers, with assistance from Juniper networks, replaced FPC0 in the New York Core Node. Only the connectors, peers, and participants listed above were affected by this maintenance.

Ticket No.:	10869:45
Subject:	Internet2 IP Network Backbone Circuit HSTN-ATLA Maintenance Completed
Affected:	Backbone Circuit HSTN-ATLA
Start Time:	Saturday, September 15, 2007, 4:12 AM (0412) UTC
End Time:	Saturday, September 15, 2007, 4:22 AM (0422) UTC
Description:	Internet2 IP Network circuit provider Qwest Communications performed maintenance to relocate cable. A brief outage was experienced. Maintenance has been completed. *Traffic re-routed during this maintenance

Ticket No.:	10836:45
Subject:	Internet2 IP Network Backbone Circuit ATLA-HOUS Emergency Maintenance Completed
Affected:	Backbone Circuit ATLA-HOUS
Start Time:	Sunday, September 2, 2007, 3:37 AM (0337) UTC
End Time:	Sunday, September 2, 2007, 3:38 AM (0338) UTC
Start Time:	Sunday, September 2, 2007, 6:54 AM (0654) UTC
End Time:	Sunday, September 2, 2007, 6:56 AM (0656) UTC
Start Time:	Sunday, September 2, 2007, 10:22 AM (1022) UTC
End Time:	Sunday, September 2, 2007, 10:23 AM (1023) UTC
Start Time:	Saturday, September 15, 2007, 4:12 AM (0412) UTC
End Time:	Saturday, September 15, 2007, 4:23 AM (0423) UTC
Description:	Internet2 IP Network Backbone Circuit ATLA-HOUS was unavailable to the community while Level(3) Communications technicians replaced a circuit pack. Maintenance has been completed. *Traffic re-routed

Downtime and Availability

Internet2 IP Core Nodes	Down Time	Reporting Period Availability	52 Week Availability
** CHIC T640	0 hr 0 min	100.00000%	100.00000%
DNVR T640	0 hr 0 min	100.00000%	99.99962%
HSTN T640	0 hr 0 min	100.00000%	99.99466%
LOSA T640	0 hr 0 min	100.00000%	98.95585%
** NEWY T640	0 hr 8 min	99.92063%	99.99790%
SNVA T640	0 hr 0 min	100.00000%	99.99695%
** SEAT T640	0 hr 0 min	100.00000%	99.99924%
** WASH T640	0 hr 0 min	100.00000%	100.00000%
** HOUS T640	0 hr 0 min	100.00000%	100.00000%
** LOSA T640	0 hr 0 min	100.00000%	100.00000%
ATLA M5	0 hr 0 min	100.00000%	99.97844%
** ATLA T640	0 hr 0 min	100.00000%	99.99676%
** SALT T640	0 hr 0 min	100.00000%	99.99962%
** KANS T640	0 hr 0 min	100.00000%	99.99943%

Aggregate Internet2 IP Core Nodes	0 hr 8 min	99.99433%	99.92275%

** Less than 52 weeks of data available

Internet2 IP Backbone Circuits	Down Time	Reporting Period Availability	37 Week Availability
DNVR-SNVA OC-192	0 hr 0 min	100.00000%	100.00000%
DENV-STTL OC-192	0 hr 0 min	100.00000%	99.96943%
HSTN-LOSA OC-192	0 hr 0 min	100.00000%	99.97909%
LOSA-SNVA OC-192	0 hr 0 min	100.00000%	100.00000%
ATLA-HSTN OC-192	0 hr 0 min	100.00000%	99.60291%
SNVA-STTL OC-192	0 hr 0 min	100.00000%	99.77183%
** I2-CHIC-ATLA	0 hr 0 min	100.00000%	99.05593%
** I2-CHIC-NEWY	0 hr 0 min	100.00000%	99.46858%
** I2-CHIC-KANS	0 hr 0 min	100.00000%	100.00000%
** I2-CHIC-WASH	0 hr 0 min	100.00000%	100.00000%
** I2-NEWY-WASH	1 hr 12 min	99.28571%	99.97667%
** I2-WASH-ATLA	0 hr 0 min	100.00000%	99.98177%
** I2-ATLA-HOUS	0 hr 22 min	99.78175%	98.07674%
** I2-KANS-ATLA	0 hr 0 min	100.00000%	99.76968%
** I2-KANS-SALT	0 hr 0 min	100.00000%	100.00000%
** I2-SALT-SEAT	0 hr 0 min	100.00000%	100.00000%
** I2-HOUS-LOSA	0 hr 1 min	99.99008%	99.96541%
** I2-LOSA-SALT	0 hr 0 min	100.00000%	100.00000%
** I2-LOSA-SEAT	0 hr 2 min	99.98016%	99.99946%

Aggregate All Internet2 IP Backbone Circuits	1 hr 37 min	99.94935%	99.76934%

Upcoming Scheduled Maintenances

Ticket No.:	10946:45
Subject:	Internet2 IP Network Core Node NEWY Maintenance
Affected:	Core Node NEWY and Its Connectors, Participants, and Peers
Start Time:	Friday, September 21, 2007, 3:00 AM (0300) UTC
End Time:	Friday, September 21, 2007, 3:30 AM (0330) UTC
Description:	Internet2 Engineers will be performing software updates on the Internet2 core nodes. The outage should be limited to five (5) minutes per node, while the route-engines change over, though the entire thirty (30) minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:	10947:45
Subject:	Internet2 IP Network Core Node SEAT Maintenance
Affected:	Core Node SEAT and Its Connectors, Participants, and Peers
Start Time:	Friday, September 21, 2007, 3:10 AM (0310) UTC
End Time:	Friday, September 21, 2007, 3:40 AM (0340) UTC
Description:	Internet2 Engineers will be performing software updates on the Internet2 core nodes. The outage should be limited to five (5) minutes per node, while the route-engines change over, though the entire thirty (30) minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:	10948:45
Subject:	Internet2 IP Network Core Node ATLA Maintenance
Affected:	Core Node ATLA and Its Connectors, Participants, and Peers
Start Time:	Friday, September 21, 2007, 3:20 AM (0320) UTC
End Time:	Friday, September 21, 2007, 3:50 AM (0350) UTC
Description:	Internet2 Engineers will be performing software updates on the Internet2 core nodes. The outage should be limited to five (5) minutes per node, while the route-engines change over, though the entire thirty (30) minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:	10949:45
Subject:	Internet2 IP Network Core Node LOSA (Qwest) Maintenance
Affected:	Core Node LOSA (Qwest) and Its Connectors, Participants, and Peers
Start Time:	Friday, September 21, 2007, 3:30 AM (0330) UTC
End Time:	Friday, September 21, 2007, 4:00 AM (0400) UTC
Description:	Internet2 Engineers will be performing software updates on the Internet2 core nodes. The outage should be limited to five (5) minutes per node, while the route-engines change over, though the entire thirty (30) minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:	10951:45
Subject:	Internet2 IP Network Core Node WASH Maintenance
Affected:	Core Node WASH and Its Connectors, Participants, and Peers
Start Time:	Friday, September 21, 2007, 3:50 AM (0350) UTC
End Time:	Friday, September 21, 2007, 4:20 AM (0420) UTC
Description:	Internet2 Engineers will be performing software updates on the Internet2 core nodes. The outage should be limited to five (5) minutes per node, while the route-engines change over, though the entire thirty (30) minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:	10953:45
Subject:	Internet2 IP Network Core Node HSTN (Qwest) Maintenance
Affected:	Core Node HSTN (Qwest) and Its Connectors, Participants, and Peers
Start Time:	Friday, September 21, 2007, 4:10 AM (0410) UTC
End Time:	Friday, September 21, 2007, 4:40 AM (0440) UTC
Description:	Internet2 Engineers will be performing software updates on the Internet2 core nodes. The outage should be limited to five (5) minutes per node, while the route-engines change over, though the entire thirty (30) minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:	10954:45
Subject:	Internet2 IP Network Core Node KANS Maintenance
Affected:	Core Node KANS and Its Connectors, Participants, and Peers
Start Time:	Friday, September 21, 2007, 4:20 AM (0420) UTC
End Time:	Friday, September 21, 2007, 4:50 AM (0450) UTC
Description:	Internet2 Engineers will be performing software updates on the Internet2 core nodes. The outage should be limited to five (5) minutes per node, while the route-engines change over, though the entire thirty (30) minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:	10955:45
Subject:	Internet2 IP Network Core Node SNVA Maintenance
Affected:	Core Node SNVA and Its Connectors, Participants, and Peers
Start Time:	Friday, September 21, 2007, 4:30 AM (0430) UTC
End Time:	Friday, September 21, 2007, 5:00 AM (0500) UTC
Description:	Internet2 Engineers will be performing software updates on the Internet2 core nodes. The outage should be limited to five (5) minutes per node, while the route-engines change over, though the entire thirty (30) minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:	10956:45
Subject:	Internet2 IP Network Core Node CHIC Maintenance
Affected:	Core Node CHIC and Its Connectors, Participants, and Peers
Start Time:	Friday, September 21, 2007, 4:40 AM (0440) UTC
End Time:	Friday, September 21, 2007, 5:10 AM (0510) UTC
Description:	Internet2 Engineers will be performing software updates on the Internet2 core nodes. The outage should be limited to five (5) minutes per node, while the route-engines change over, though the entire thirty (30) minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:	10957:45
Subject:	Internet2 IP Network Core Node SALT Maintenance
Affected:	Core Node SALT and Its Connectors, Participants, and Peers
Start Time:	Friday, September 21, 2007, 4:50 AM (0450) UTC
End Time:	Friday, September 21, 2007, 5:20 AM (0520) UTC
Description:	Internet2 Engineers will be performing software updates on the Internet2 core nodes. The outage should be limited to five (5) minutes per node, while the route-engines change over, though the entire thirty (30) minute window per node is reserved. All BGP sessions with the core node will reset. Backbone traffic will route around the router being upgraded.

Ticket No.:	10961:45
Subject:	Internet2 IP Network Backbone Circuit CHIC - ATLA Maintenance
Affected:	Backbone Circuit CHIC-ATLA Ciena Backbone Circuit I2-INDI-LOUI-I2-00030 Connector Indiana GigaPOP and its Participants
Start Time:	Thursday, September 20, 2007, 4:00 AM (0400) UTC
End Time:	Thursday, September 20, 2007, 10:00 AM (1000) UTC
Description:	Level(3) will be performing fiber splicing/relocation maintenance in Greensburg, IN. An outage of up to 2 hours is expected; however, the entire window is reserved.