Internet2 IP Network Operations Report
02/21/2011 - 02/27/2011

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None

New Services

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Start Time (UTC)

End Time (UTC)





169842-High
2-High

Internet2 IP Network Backbone Circuit ATLA-WASH Brief Outage
Circuit - Other
02/24/2011 10:39 PM
02/24/2011 10:46 PM


169902-High
1-Critical

Internet2 IP Network Backbone Circuit NEWY-WASH Brief Outage Update
Circuit - Other
02/25/2011 4:48 PM
02/25/2011 4:50 PM






Unscheduled Outages Detail






Ticket No.:16984:45



Subject:Internet2 IP Network Backbone Circuit ATLA-WASH Brief Outage



Affected:Backbone Circuit  ATLA-WASH



Start Time:Thursday, February 24, 2011, 10:39 PM (2239) UTC



End Time:Thursday, February 24, 2011, 10:46 PM (2246) UTC


Description:Backbone Circuit ATLA-WASH was briefly unavailable. Internet2
Engineers temporarily shut down the interface on the router in an
attempt to troubleshoot observed errors. Emergency maintenance will be
forthcoming to attempt to resolve the observed errors.







Ticket No.:16990:45



Subject:Internet2 IP Network Backbone Circuit NEWY-WASH Brief Outage Update



Affected:Backbone NEWY-WASH
Connector MAGPI
Connector MAX(NEWY)*



Start Time:Friday, February 25, 2011, 4:48 PM (1648) UTC



End Time:Friday, February 25, 2011, 4:50 PM (1650) UTC


Description:After initial investigation, Internet2 Engineering & Level(3)
Communications determined that the above listed were unavailable due
to a brief outage on the NEWY-PHIL fiber span, and was not due to Core
Node outage.  Level(3) Communications determined that a fiber issue in
Philadelphia, PA was the cause. Maintenance to resolve this issue is
being tracked in 17006:45.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Start Time (UTC)
End Time (UTC)





16898
3-Elevated
2-High

Internet2 IP Network Backbone Circuit ATLA-WASH Maintenance Completed
Circuit
02/22/2011 7:39 AM
02/22/2011 8:00 AM


16938
3-Elevated
1-Critical

Internet2 IP Network Core Node WASH Maintenance Completed
Hardware
02/23/2011 4:01 AM
02/23/2011 5:27 AM


16985
3-Elevated
2-High

Internet2 IP Network Backbone Circuit ATLA-WASH Emergency Maintenance Completed
Circuit
02/24/2011 11:37 PM
02/24/2011 11:43 PM




Scheduled Maintenances Detail





Ticket No.:16898:45



Subject:Internet2 IP Network Backbone Circuit ATLA-WASH Maintenance Completed



Affected:Backbone Circuit ATLA-WASH



Start Time:Tuesday, February 22, 2011, 7:39 AM (0739) UTC



End Time:Tuesday, February 22, 2011, 8:00 AM (0800) UTC


Description:   Backbone Circuit ATLA-WASH was unavailable while
Level(3) Communications performed a fiber move  in  Sandy Springs, GA.
This maintenance has been completed.



  







Ticket No.:16938:45



Subject:Internet2 IP Network Core Node WASH Maintenance Completed



Affected:Core Node WASH and its Connector(s) and Participants



Start Time:Wednesday, February 23, 2011, 4:01 AM (0401) UTC



End Time:Wednesday, February 23, 2011, 5:27 AM (0527) UTC


Description:   Core Node WASH was unavailable to the community while Internet2
Engineers swapped the MX 960 to a T1600. This maintenance has been
completed.



  







Ticket No.:16985:45



Subject:Internet2 IP Network Backbone Circuit ATLA-WASH Emergency Maintenance Completed



Affected:Backbone Circuit ATLA-WASH



Start Time:Thursday, February 24, 2011, 11:37 PM (2337) UTC



End Time:Thursday, February 24, 2011, 11:43 PM (2343) UTC


Description:   Backbone Circuit ATLA-WASH was briefly unavailable while Internet2
Engineers with the assistance of a Level(3) Communications Technician
performed emergency circuit maintenance in McLean, VA.  A brief outage
was observed. Maintenance has been completed.



  










Downtime and Availability







Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability


CHIC T16000 hr 0 min100.00000%99.89109%
NEWY MX9600 hr 0 min100.00000%99.99905%
SEAT MX9600 hr 0 min100.00000%99.96983%
WASH MX9601 hr 26 min99.14683%99.98235%
HOUS MX9600 hr 0 min100.00000%99.99962%
LOSA MX9600 hr 0 min100.00000%99.99943%
ATLA MX9600 hr 0 min100.00000%99.99886%
SALT MX9600 hr 0 min100.00000%99.99962%
KANS MX9600 hr 0 min100.00000%99.96015%
      
Aggregate Internet2 IP Core Nodes1 hr 26 min99.90520%99.97778%

** Less than 52 weeks of data available

Internet2 IP Backbone CircuitsDown TimeReporting Period Availability52 Week Availability


I2-HOUS-LOSA-10GE-055590 hr 0 min100.00000%99.97571%
I2-ATLA-CHIC-10GE-054190 hr 0 min100.00000%99.77971%
** I2-HOUS-KANS-10GE-055600 hr 0 min100.00000%99.80476%
I2-CHIC-NEWY32AOA-10GE-052390 hr 0 min100.00000%99.90134%
** I2-CHIC-NEWY32AOA-10GE-056670 hr 0 min100.00000%99.90228%
I2-NEWY32AOA-WASH-10GE-052420 hr 2 min99.98016%99.88331%
I2-CHIC-WASH-10GE-052500 hr 0 min100.00000%99.91196%
** I2-HOUS-KANS-10GE-055610 hr 0 min100.00000%99.79698%
** I2-NEWY32AOA-WASH-10GE-046430 hr 2 min99.98016%99.88369%
I2-ATLA-WASH-10GE-052510 hr 34 min99.66270%99.99051%
I2-ATLA-WASH-10GE-051330 hr 21 min99.79167%99.99298%
I2-ATLA-HOUS-10GE-054230 hr 0 min100.00000%99.91120%
** I2-ATLA-HOUS-10GE-055620 hr 0 min100.00000%99.92524%
** I2-KANS-SALT-10GE-055660 hr 0 min100.00000%99.97097%
I2-KANS-SALT-10GE-051380 hr 0 min100.00000%99.97097%
** I2-SALT-SEAT-10GE-055650 hr 0 min100.00000%99.95731%
** I2-SALT-SEAT-10GE-055730 hr 0 min100.00000%99.95731%
** I2-LOSA-SALT-10GE-055710 hr 0 min100.00000%99.88673%
** I2-LOSA-SALT-10GE-055630 hr 0 min100.00000%99.88673%
I2-ATLA-CHIC-10GE-056380 hr 0 min100.00000%99.71311%
I2-CHIC-KANS-10GE-055670 hr 0 min100.00000%99.91670%
I2-CHIC-KANS-10GE-055680 hr 0 min100.00000%99.91424%
I2-CHIC-KANS-10GE-059760 hr 0 min100.00000%99.98691%
I2-CHIC-WASH-10GE-056370 hr 0 min100.00000%99.97628%
I2-LOSA-SEAT-10GE-055640 hr 0 min100.00000%99.98463%
I2-LOSA-SEAT-10GE-055720 hr 0 min100.00000%99.98463%
I2-HOUS-LOSA-10GE-055810 hr 0 min100.00000%99.98406%
      
Aggregate All Internet2 IP Backbone Circuits0 hr 59 min99.97832%99.91668%






Upcoming Scheduled Maintenances





Ticket No.:16993:45



Subject:Internet2 IP Network Core Node WASH Maintenance



Affected:Core Node WASH and its Peers, Connectors, and Participants



Start Time:Tuesday, March 1, 2011, 4:30 AM (0430) UTC



End Time:Tuesday, March 1, 2011, 5:30 AM (0530) UTC



Description:   Core Node WASH will be briefly unavailable while Internet2 Engineers
perform software maintenance. A brief outage is expected; however, the
entire window is reserved.



  







Ticket No.:16996:45



Subject:Internet2 IP Network Core Node ATLA Maintenance



Affected:Core Node ATLA and its Connector(s) and Participants



Start Time:Tuesday, March 1, 2011, 4:00 AM (0400) UTC



End Time:Tuesday, March 1, 2011, 4:30 AM (0430) UTC



Description:   Core Node ATLA will be unavailable to the community while Internet2
Engineers perform software maintenance. A brief outage is expected;
however, the entire window is reserved.



  







Ticket No.:17009:45



Subject:Internet2 IP Network Core Node NEWY Maintenance Updated



Affected:Core Node NEWY and its Connector(s) and Participants



Start Time:Wednesday, March 2, 2011, 7:00 AM (0700) UTC



End Time:Wednesday, March 2, 2011, 10:00 AM (1000) UTC



Description:   **Please note the updated maintenance window**
Core Node NEWY should remain available while Internet2 Engineers with
the assistance of a Level(3) Communications Technician perform
hardware maintenance. No outages are expected during this maintenance,
however the entire maintenance window has been reserved.



  







Ticket No.:17011:45



Subject:Internet2 IP Network Core Node SALT Maintenance



Affected:Core Node SALT and its Connector(s) and Participants



Start Time:Wednesday, March 9, 2011, 6:00 AM (0600) UTC



End Time:Wednesday, March 9, 2011, 10:00 AM (1000) UTC



Description:   Core Node SALT will be unavailable to the community while Internet2
Engineers swap the MX 960 to a T1600. An extended outage is expected
and the entire maintenance window has been reserved. All connections
to the Core Node will be affected.



  







Ticket No.:17014:45



Subject:Internet2 lan.salt.net.internet2.edu Maintenance



Affected:



Start Time:Tuesday, March 1, 2011, 4:00 AM (0400) UTC



End Time:Tuesday, March 1, 2011, 6:00 AM (0600) UTC



Description:   Services via lan.salt.net.internet2.edu will be briefly unavailable
while Internet2 Engineers perform emergency software updates to the
racklan switch. Two brief outages are expected.



  







Ticket No.:17006:45



Subject:Internet2 IP Network Backbone Circuit NEWY-WASH Maintenance



Affected:Backbone Circuit NEWY-WASH
Connector MAGPI
Connector MAX GigaPOP



Start Time:Tuesday, March 1, 2011, 5:01 AM (0501) UTC



End Time:Tuesday, March 1, 2011, 7:01 AM (0701) UTC



Description:   Backbone Circuit NEWY-WASH will be unavailable while
Level(3) Communications clean fibers in Philadelphia, PA.   A brief
outage is expected; however the entire window is reserved.