Internet2 IP Network Operations Report
10/22/2007 - 10/28/2007

Internet2 IP Network Operations Center
at Indiana University

New Customers

None


Upgrades

None

New Services

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Start Time (UTC)

End Time (UTC)





111842-High
2-High

Internet2 IP Network Backbone Circuit ATLA-HOUS Stable
Circuit - Other
10/24/2007 5:26 AM
10/24/2007 5:27 AM


10/24/2007 8:36 AM
10/24/2007 8:46 AM


10/24/2007 9:05 AM
10/24/2007 9:42 PM


112162-High
2-High

Internet2 IP Network Backbone Circuit CHIC-NEWY Outage Resolved
Circuit - Other
10/28/2007 3:40 AM
10/28/2007 1:30 PM


112172-High
2-High

Internet2 IP Network Backbone Circuit CHIC-WASH Outage Resolved
Circuit - Other
10/28/2007 4:13 AM
10/28/2007 1:30 PM






Unscheduled Outages Detail






Ticket No.:11184:45



Subject:Internet2 IP Network Backbone Circuit ATLA-HOUS Stable



Affected:I2-ATLA-BATO-I2-00100
I2-BATO-JACK-I2-00047
I2-ATLA-HOUS-I2-00042
I2-ALBU-ATLA-ESNET-00075
Connector LONI and its participants



Start Time:Wednesday, October 24, 2007, 5:26 AM (0526) UTC



End Time:Wednesday, October 24, 2007, 5:27 AM (0527) UTC


Start Time:Wednesday, October 24, 2007, 8:36 AM (0836) UTC



End Time:Wednesday, October 24, 2007, 8:46 AM (0846) UTC


Start Time:Wednesday, October 24, 2007, 9:05 AM (0905) UTC



End Time:Wednesday, October 24, 2007, 9:42 PM (2142) UTC


Description:Internet2 IP Network Backbone Circuit ATLA-HOUS
was unstable to the Internet2 community. Circuit
provider Level(3) Communications was contacted and
traced the problem to a faulty AMP in Lake City, FL.
Level(3) technicians replaced the AMP card, and
Internet2 engineers re-enabled the circuit.







Ticket No.:11216:45



Subject:Internet2 IP Network Backbone Circuit CHIC-NEWY Outage Resolved



Affected:Backbone Circuit CHIC-NEWY



Start Time:Sunday, October 28, 2007, 3:40 AM (0340) UTC



End Time:Sunday, October 28, 2007, 1:30 PM (1330) UTC


Description:Internet2 IP Network Backbone Circuit CHIC-NEWY is
available to the community. Internet2 circuit provider
Level(3) Communications, along with vendor Infinera,
have found the cause to be a failing card in
Cleveland,OH.  Service  has been restored, however
there will be an emergency maintenance later in the day
to replace the failing card.







Ticket No.:11217:45



Subject:Internet2 IP Network Backbone Circuit CHIC-WASH Outage Resolved



Affected:Backbone Circuit CHIC-WASH
Connector Nysernet and its participants*



Start Time:Sunday, October 28, 2007, 4:13 AM (0413) UTC



End Time:Sunday, October 28, 2007, 1:30 PM (1330) UTC


Description:Internet2 IP Network Backbone Circuit CHIC-NEWY is
available to the community. Internet2 circuit provider
Level(3) Communications, along with vendor Infinera,
have found the cause to be a failing card in
Cleveland,OH.  Service  has been restored, however
there will be an emergency maintenance later in the day
to replace the failing card.
*Denotes multi-homed status.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Start Time (UTC)
End Time (UTC)





11141
3-Elevated
2-High

Internet2 IP Network Backbone Circuit LOSA-SALT Maintenance Completed
Circuit
10/23/2007 4:22 AM
10/23/2007 4:23 AM


11115
3-Elevated
2-High

Internet2 IP Network Backbone Circuit HOUS-LOSA Maintenance Completed
Circuit
10/25/2007 5:52 AM
10/25/2007 6:03 AM




Scheduled Maintenances Detail





Ticket No.:11141:45



Subject:Internet2 IP Network Backbone Circuit LOSA-SALT Maintenance Completed



Affected:Backbone Circuit LOSA-SALT
I2-SALT-SUNN-I2-00065
I2-RENO-SALT-I2-00115
I2-DENV-SUNN-ESNET-00079



Start Time:Tuesday, October 23, 2007, 4:22 AM (0422) UTC



End Time:Tuesday, October 23, 2007, 4:23 AM (0423) UTC


Description:   Internet2 IP Network Backbone Circuit LOSA-SALT was
briefly unavailable while fiber provider Level(3)
Communications performed maintenance. Maintenance has
been completed.



  







Ticket No.:11115:45



Subject:Internet2 IP Network Backbone Circuit HOUS-LOSA Maintenance Completed



Affected:Internet2 IP Network Backbone HOUS-LOSA
ESNET IP Backbone ALBU-ATLA



Start Time:Thursday, October 25, 2007, 5:52 AM (0552) UTC



End Time:Thursday, October 25, 2007, 6:03 AM (0603) UTC


Description:   During the above time frame Level(3) Communications
relocated fiber connections between El Paso
and Houston, TX. Maintenance has been completed.



  










Downtime and Availability







Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability


** CHIC T6400 hr 0 min100.00000%100.00000%
DNVR T6400 hr 0 min100.00000%100.00000%
HSTN T6400 hr 0 min100.00000%99.99580%
LOSA T6400 hr 0 min100.00000%99.98779%
** NEWY T6400 hr 0 min100.00000%99.99657%
SNVA T6400 hr 0 min100.00000%99.99695%
** SEAT T6400 hr 0 min100.00000%99.99886%
** WASH T6400 hr 0 min100.00000%100.00000%
** HOUS T6400 hr 0 min100.00000%99.99924%
** LOSA T6400 hr 0 min100.00000%99.99962%
ATLA M50 hr 0 min100.00000%99.97844%
** ATLA T6400 hr 0 min100.00000%99.99618%
** SALT T6400 hr 0 min100.00000%99.99866%
** KANS T6400 hr 0 min100.00000%99.99847%
      
Aggregate Internet2 IP Core Nodes0 hr 0 min100.00000%99.99618%

** Less than 52 weeks of data available

Internet2 IP Backbone CircuitsDown TimeReporting Period Availability43 Week Availability




DNVR-SNVA OC-1920 hr 0 min100.00000%100.00000%
DENV-STTL OC-1920 hr 0 min100.00000%99.97370%
HSTN-LOSA OC-1920 hr 0 min100.00000%99.98200%
LOSA-SNVA OC-1920 hr 0 min100.00000%100.00000%
ATLA-HSTN OC-1920 hr 0 min100.00000%99.66339%
SNVA-STTL OC-1920 hr 0 min100.00000%99.80366%
** I2-CHIC-ATLA0 hr 0 min100.00000%99.17751%
** I2-CHIC-NEWY9 hr 50 min94.14683%99.39530%
** I2-CHIC-KANS0 hr 0 min100.00000%100.00000%
** I2-CHIC-WASH9 hr 17 min94.47421%99.86203%
** I2-NEWY-WASH0 hr 0 min100.00000%99.97808%
** I2-WASH-ATLA0 hr 0 min100.00000%99.98247%
** I2-ATLA-HOUS12 hr 59 min92.27183%99.50005%
** I2-KANS-ATLA0 hr 0 min100.00000%99.80182%
** I2-KANS-SALT0 hr 0 min100.00000%100.00000%
** I2-SALT-SEAT0 hr 0 min100.00000%100.00000%
** I2-HOUS-LOSA0 hr 0 min100.00000%99.95801%
** I2-LOSA-SALT0 hr 1 min99.99008%99.92802%
** I2-LOSA-SEAT0 hr 0 min100.00000%99.99954%
      
Aggregate All Internet2 IP Backbone Circuits32 hr 7 min98.99384%99.84240%






Upcoming Scheduled Maintenances





Ticket No.:11125:45



Subject:Internet2 IP Network Backbone Circuit CHIC-KANS Maintenance



Affected:Internet2 IP Backbone CHIC-KANS
Internet2 Ciena Backbone CHIC-KANS
ESNET SDN Backbone CHIC-SEAT
ESNET IP Backbone CHIC-DENV



Start Time:Tuesday, October 30, 2007, 5:00 AM (0500) UTC



End Time:Tuesday, October 30, 2007, 11:00 AM (1100) UTC



Description:   Level3 technicians will be performing a hot cut on long
haul fiber in St. Louis, MO.  An outage of up to an
hour is expected, however the entire maintenance window
is reserved.



  







Ticket No.:11226:45



Subject:Internet2 IP Network Backbone Circuit CHIC-WASH Maintenance



Affected:Backbone Circuit CHIC-WASH
I2-CLEV-PITT-I2-00004
I2-CLEV-WASH-OARNET-00022
I2-CHIC-WASH-ESNET-00070



Start Time:Tuesday, November 6, 2007, 5:00 AM (0500) UTC



End Time:Tuesday, November 6, 2007, 11:00 AM (1100) UTC



Description:   The above circuits will be unavailable while Internet2
circuit provider, Level(3) Communications, performs
circuit maintenance in Beaver Falls, PA.  An outage of
up to 2 hours is expected, however the entire
maintenance window is reserved.