Internet2 IP Network Operations Report
08/29/2011 - 09/04/2011

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Start Time (UTC) End Time (UTC)

177812-High 2-High Internet2 IP Network Backbone Circuit CHIC-NEWY Stability Circuit - Damaged Fiber 08/29/2011 6:53 AM 08/29/2011 6:56 AM
08/29/2011 7:35 AM 08/29/2011 7:36 AM
177822-High 2-High Internet2 IP Network Backbone Circuits CHIC-NEWY and CHIC-WASH Brief Outage Resolved Circuit - Bumped Fiber 08/29/2011 2:57 PM 08/29/2011 2:58 PM
178102-High 2-High Internet2 IP Network Backbone Circuits HOUS-LOSA Outage Resolved Unannounced Maintenance 09/02/2011 6:01 AM 09/02/2011 7:21 AM

Unscheduled Outages Detail


Ticket No.:17781:45
Subject:Internet2 IP Network Backbone Circuit CHIC-NEWY Stability
Affected:Backbone Circuit CHIC-NEWY
Connector NOX (CHIC)
Start Time:Monday, August 29, 2011, 6:53 AM (0653) UTC
End Time:Monday, August 29, 2011, 6:56 AM (0656) UTC
Start Time:Monday, August 29, 2011, 7:35 AM (0735) UTC
End Time:Monday, August 29, 2011, 7:36 AM (0736) UTC
Description:Backbone Circuit CHIC-NEWY is currently stable to the community. Level(3) Communications technicians repaired fiber damage in Albany, NY in an emergency maintenance tracked in ticket 17800:45. NOX is multihomed and remained reachable.

Ticket No.:17782:45
Subject:Internet2 IP Network Backbone Circuits CHIC-NEWY and CHIC-WASH Brief Outage Resolved
Affected:Backbone Circuits CHIC-NEWY and CHIC-WASH
Connectors via Core Node CHIC: Merit, NOX, Nysernet
Start Time:Monday, August 29, 2011, 2:57 PM (1457) UTC
End Time:Monday, August 29, 2011, 2:58 PM (1458) UTC
Description:The above listed were briefly unavailable. Level(3) Communications technicians believe the outage was due to a fiber bump in Chicago, IL. All connectors listed are multihomed and therefore should have remained reachable.

Ticket No.:17810:45
Subject:Internet2 IP Network Backbone Circuits HOUS-LOSA Outage Resolved
Affected:Backbone Circuits HOUS-LOSA
Start Time:Friday, September 2, 2011, 6:01 AM (0601) UTC
End Time:Friday, September 2, 2011, 7:21 AM (0721) UTC
Description:Backbone Circuits HOUS-LOSA are available. Internet2's fiber provider has been contacted and reports the outage was due to vendor fiber maintenance in Santa Terasa, NM. No further outages are expected.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Start Time (UTC) End Time (UTC)

17800 3-Elevated 2-High Internet2 IP Network Backbone Circuits CHIC-NEWY Emergency Maintenance Completed Circuit 09/01/2011 5:10 AM 09/01/2011 8:43 AM
17808 3-Elevated 2-High Internet2 IP Network Backbone Circuit CHIC-WASH Maintenance Completed Circuit 09/03/2011 5:15 AM 09/03/2011 5:51 AM
17794 3-Elevated 1-Critical Internet2 IP Network Core Node NEWY Maintenance Completed Software 09/04/2011 4:01 AM 09/04/2011 4:03 AM

Scheduled Maintenances Detail

Ticket No.:17800:45
Subject:Internet2 IP Network Backbone Circuits CHIC-NEWY Emergency Maintenance Completed
Affected:Backbone Circuit CHIC-NEWY
Connector NOX (CHIC)
Start Time:Thursday, September 1, 2011, 5:10 AM (0510) UTC
End Time:Thursday, September 1, 2011, 8:43 AM (0843) UTC
Description: The above listed were unavailable to the community while Level (3) Communications technicians performed emergency fiber maintenance in Albany, NY. Maintenance has been completed. Connector NOX is multihomed and therefore should have remained reachable.

Ticket No.:17808:45
Subject:Internet2 IP Network Backbone Circuit CHIC-WASH Maintenance Completed
Affected:Backbone Circuit CHIC-WASH
Start Time:Saturday, September 3, 2011, 5:15 AM (0515) UTC
End Time:Saturday, September 3, 2011, 5:51 AM (0551) UTC
Description: Backbone Circuit CHIC-WASH was unavailable while Internet2 Engineers performed maintenance. IP traffic should have re-routed during this maintenance. This maintenance has been completed.

Ticket No.:17794:45
Subject:Internet2 IP Network Core Node NEWY Maintenance Completed
Affected:Core Node NEWY and its Connector(s) and Participants
Start Time:Sunday, September 4, 2011, 4:01 AM (0401) UTC
End Time:Sunday, September 4, 2011, 4:03 AM (0403) UTC
Description: Core Node NEWY was briefly unavailable while Internet2 Engineers performed a software maintenance. Maintenance has been completed.


Downtime and Availability



Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability
CHIC T16000 hr 0 min100.00000%99.89925%
NEWY T16000 hr 2 min99.98016%99.97628%
SEAT MX9600 hr 0 min100.00000%99.99981%
WASH T16000 hr 0 min100.00000%99.95105%
HOUS MX9600 hr 0 min100.00000%99.99943%
LOSA T16000 hr 0 min100.00000%99.97533%
ATLA T16000 hr 0 min100.00000%99.98691%
SALT T16000 hr 0 min100.00000%99.97476%
KANS T16000 hr 0 min100.00000%99.96015%

Aggregate Internet2 IP Core Nodes0 hr 2 min99.99780%99.96922%

** Less than 52 weeks of data available

Internet2 IP Backbone CircuitsDown TimeReporting Period Availability52 Week Availability
I2-HOUS-LOSA-10GE-055591 hr 20 min99.20635%99.95959%
I2-ATLA-CHIC-10GE-054190 hr 0 min100.00000%99.89052%
** I2-HOUS-KANS-10GE-055600 hr 0 min100.00000%99.80495%
I2-CHIC-NEWY32AOA-10GE-052393 hr 38 min97.83730%99.84498%
** I2-CHIC-NEWY32AOA-10GE-056673 hr 38 min97.83730%99.84498%
I2-NEWY32AOA-WASH-10GE-052420 hr 0 min100.00000%99.91329%
I2-CHIC-WASH-10GE-052500 hr 1 min99.99008%99.91765%
** I2-HOUS-KANS-10GE-055610 hr 0 min100.00000%99.80552%
** I2-NEWY32AOA-WASH-10GE-046430 hr 0 min100.00000%99.91367%
I2-ATLA-WASH-10GE-052510 hr 0 min100.00000%99.87250%
I2-ATLA-WASH-10GE-051330 hr 0 min100.00000%99.87496%
I2-ATLA-HOUS-10GE-054230 hr 0 min100.00000%99.91746%
** I2-ATLA-HOUS-10GE-055620 hr 0 min100.00000%99.91746%
** I2-KANS-SALT-10GE-055660 hr 0 min100.00000%99.95845%
I2-KANS-SALT-10GE-051380 hr 0 min100.00000%99.95845%
** I2-SALT-SEAT-10GE-055650 hr 0 min100.00000%99.95712%
** I2-SALT-SEAT-10GE-055730 hr 0 min100.00000%99.95712%
** I2-LOSA-SALT-10GE-055710 hr 0 min100.00000%99.94403%
** I2-LOSA-SALT-10GE-055630 hr 0 min100.00000%99.94403%
I2-ATLA-CHIC-10GE-056380 hr 0 min100.00000%99.89185%
I2-CHIC-KANS-10GE-055670 hr 0 min100.00000%99.82278%
I2-CHIC-KANS-10GE-055680 hr 0 min100.00000%99.82032%
I2-CHIC-KANS-10GE-059760 hr 0 min100.00000%99.89223%
I2-CHIC-WASH-10GE-056370 hr 37 min99.63294%99.97439%
I2-LOSA-SEAT-10GE-055640 hr 0 min100.00000%99.99639%
I2-LOSA-SEAT-10GE-055720 hr 0 min100.00000%99.99639%
I2-HOUS-LOSA-10GE-055811 hr 20 min99.20635%99.95959%

Aggregate All Internet2 IP Backbone Circuits10 hr 34 min99.76705%99.90928%





Upcoming Scheduled Maintenances

Ticket No.:17803:45
Subject:Internet2 IP Network Core Node ATLA Maintenance
Affected:Core Node ATLA and all connections
Start Time:Tuesday, September 6, 2011, 4:00 AM (0400) UTC
End Time:Tuesday, September 6, 2011, 7:00 AM (0700) UTC
Description: Core Node ATLA will be unavailable while Internet2 Engineers perform software maintenance. An outage of 15 minutes is expected; however, the entire window is reserved. All connections to the Core Node will be affected.

Ticket No.:17812:45
Subject:Internet2 IP Network Core Node WASH Maintenance
Affected:Core Node WASH and all connections
Start Time:Wednesday, September 7, 2011, 4:01 AM (0401) UTC
End Time:Wednesday, September 7, 2011, 4:31 AM (0431) UTC
Description: Core Node WASH will be unavailable while Internet2 Engineers perform maintenance to upgrade code on the router. An outage of less than 5 minutes is expected; however, the entire window is reserved.

Ticket No.:17813:45
Subject:Internet2 IP Network Core Node KANS Maintenance
Affected:Core Node KANS and all connections
Start Time:Wednesday, September 7, 2011, 5:05 AM (0505) UTC
End Time:Wednesday, September 7, 2011, 5:30 AM (0530) UTC
Description: Core Node KANS will be unavailable while Internet2 Engineers perform maintenance to upgrade code on the router. An outage of less than 5 minutes is expected; however, the entire window is reserved.

Ticket No.:17814:45
Subject:Internet IP Network Core Node LOSA Maintenance
Affected:Core Node LOSA and all connections
Start Time:Tuesday, September 6, 2011, 7:01 AM (0701) UTC
End Time:Tuesday, September 6, 2011, 7:30 AM (0730) UTC
Description: Core Node LOSA will be unavailable while Internet2 Engineers perform maintenance to upgrade code on the router. An outage of less than 5 minutes is expected; however, the entire window is reserved.

Ticket No.:17815:45
Subject:Internet2 IP Network Core Node HOUS Maintenance
Affected:Core Node HOUS and its Peers, Connectors and Participants
Start Time:Tuesday, September 6, 2011, 5:00 AM (0500) UTC
End Time:Tuesday, September 6, 2011, 6:00 AM (0600) UTC
Description: Core Node HOUS will be briefly unavailable while Internet2 Engineers perform maintenance to upgrade code. An outage of less than 5 minutes is expected; however, the entire window is reserved. All connections to the Core Node will be affected.

Ticket No.:17817:45
Subject:Internet2 IP Network Core Node CHIC Maintenance
Affected:Core Node CHIC and its Peers, Connectors and Participants
Start Time:Thursday, September 8, 2011, 5:01 AM (0501) UTC
End Time:Thursday, September 8, 2011, 5:30 AM (0530) UTC
Description: Core Node CHIC will be briefly unavailable while Internet2 Engineers perform maintenance to upgrade code. An outage of less than 5 minutes is expected; however, the entire window is reserved. All connections to the Core Node will be affected.

Ticket No.:17818:45
Subject:Internet2 IP Network Core Node SEAT Maintenance
Affected:Core Node SEAT and all connections
Start Time:Thursday, September 8, 2011, 7:01 AM (0701) UTC
End Time:Thursday, September 8, 2011, 7:30 AM (0730) UTC
Description: Core Node SEAT will be unavailable while Internet2 Engineers perform maintenance to upgrade code on the router. An outage of less than 5 minutes is expected; however, the entire window is reserved.

Ticket No.:17696:45
Subject:Internet2 IP Network Backbone Circuit HOUS-KANS Maintenance
Affected:Backbone Circuit HOUS-KANS
ION Backbone Circuit HOUS-KANS
LEARN (KANS)
Start Time:Friday, September 9, 2011, 5:00 AM (0500) UTC
End Time:Friday, September 9, 2011, 11:00 AM (1100) UTC
Description: The above affected will be unavailable while Level(3) Communications restores fiber to its original path due to previous damage. Outages are expected; however, the entire window is reserved. IP traffic will re-route during this maintenance. Connector LEARN is multihomed and should remain reachable.

Ticket No.:17711:45
Subject:Internet2 IP Network Backbone Circuits LOSA-SALT and LOSA-SEAT Maintenance
Affected:Backbone Circuit LOSA-SALT
Backbone Circuit LOSA-SEAT
IXP PacWave
Connector Oregon Gigapop (LOSA) and its Participants
Start Time:Tuesday, September 20, 2011, 7:00 AM (0700) UTC
End Time:Tuesday, September 20, 2011, 1:00 PM (1300) UTC
Description: The above listed will be unavailable while Level(3) Communications performs maintenance to relocate fiber due to UPRR bridge project at Hollister and UPRR, Goleta, CA. An outage of up to 3 hours is anticipated; however, the entire window has been reserved. Alternate night is reserved for 9/21/2011 for the same time, if required.

Ticket No.:17723:45
Subject:Internet2 IP Network Backbone Circuit ATLA-CHIC Maintenance
Affected:Backbone Circuit ATLA-CHIC
Connectors University of Memphis and Indiana GigaPOP (ATLA)*
Start Time:Thursday, September 8, 2011, 5:00 AM (0500) UTC
End Time:Thursday, September 8, 2011, 11:00 AM (1100) UTC
Description: Backbone Circuit ATLA-CHIC will be unavailable while Level(3) Communications relocates fiber due to road construction. An outage of three hours is expected; however the entire window is reserved. IP traffic will re-route during this maintenance. *Denotes multihomed status and therefore should remain reachable.

Ticket No.:17771:45
Subject:Internet2 IP Network Backbone Circuits LOSA-SALT and LOSA-SEAT Maintenance Alternate Window
Affected:Backbone Circuit LOSA-SALT
Backbone Circuit LOSA-SEAT
IXP PacWave
Connector Oregon Gigagpop (LOSA) and its Participants
Start Time:Tuesday, September 20, 2011, 7:00 AM (0700) UTC
End Time:Tuesday, September 20, 2011, 1:00 PM (1300) UTC
Description: The above listed will be unavailable while Level(3) Communications performs maintenance to relocate fiber due to UPRR bridge project at Hollister and UPRR, Goleta, CA. An outage of up to 3 hours is anticipated; however, the entire window has been reserved. This is the Alternate Window for previously scheduled ticket 17711:45