Internet2 IP Network Operations Report
06/09/2014 - 06/15/2014

Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

232582-High 2-High Outage Resolved - I2 IP Backbone HOUS-LOSA Cut or Damaged FiberVendor 06/10/2014 1:45 PM 06/10/2014 11:42 PM
232973-Elevated 3-Elevated Brief Outage - I2 IP Backbone ATLA-CHIC InvestigatingUndetermined 06/11/2014 6:16 PM 06/11/2014 6:17 PM
232992-High 2-High Outage Resolved - I2 IP Backbone CHIC-CLEV Cut or Damaged FiberVendor 06/12/2014 10:00 AM 06/12/2014 12:16 PM
232702-High 2-High Outage Resolved - I2 IP ION Backbone ATLA-HOUS Cut or Damaged FiberVendor 06/12/2014 1:07 PM 06/13/2014 3:17 AM

Unscheduled Outages Detail


Ticket No.:23258:45
Subject:Outage Resolved - I2 IP Backbone HOUS-LOSA
Source Of Impact:Vendor
Affected:Backbone HOUS-LOSA
Start Time:Tuesday, June 10, 2014, 1:45 PM (1345) UTC
End Time:Tuesday, June 10, 2014, 11:42 PM (2342) UTC
Description:Backbone HOUS-LOSA is currently unavailable to the community. Backbone traffic has re-routed. Internet2's Optical Vendor technicians have narrowed down the fiber cut to be between GIDDINGS, TX and BRENHAM, TX. Technicians have identified two cables that had been cut by a construction crew working in the area. Field service technicians have completed splicing repair work. No more outages are expected.

Ticket No.:23297:45
Subject:Brief Outage - I2 IP Backbone ATLA-CHIC
Source Of Impact:Undetermined
Affected:
Start Time:Wednesday, June 11, 2014, 6:16 PM (1816) UTC
End Time:Wednesday, June 11, 2014, 6:17 PM (1817) UTC
Description:Backbone ATLA-CHIC was briefly unavailable. Internet2 Optical Vendor Engineers have been contacted, however the reason for the outage is pending.

Ticket No.:23299:45
Subject:Outage Resolved - I2 IP Backbone CHIC-CLEV
Source Of Impact:Vendor
Affected:Backbone CHIC-CELV
Start Time:Thursday, June 12, 2014, 10:00 AM (1000) UTC
End Time:Thursday, June 12, 2014, 12:16 PM (1216) UTC
Description:Backbone CHIC-CLEV is available. Internet2 Optical Vendor Engineers reported the outage was due to damaged fiber. No further outages are expected. Workgroup administrators receives notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:23270:45
Subject:Outage Resolved - I2 IP ION Backbone ATLA-HOUS
Source Of Impact:Vendor
Affected:ION Backbone ATLA-HOUS
Start Time:Thursday, June 12, 2014, 1:07 PM (1307) UTC
End Time:Friday, June 13, 2014, 3:17 AM (0317) UTC
Description:ION Backbone ATLA-HOUS is now available. Level (3) Communications Engineers have indicated that the reason for the outage was a fiber cut caused by a construction company installing a new water pipe. Splicing has been completed and all services have restored. No further outages are expected.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

23213 3-Elevated 2-High Maintenance Completed - I2 IP Backbone ATLA-CHIC Circuit Vendor06/10/2014 5:25 AM 06/10/2014 5:26 AM
23220 3-Elevated 2-High Maintenance Completed - I2 IP Backbone CHIC-CLEV CircuitVendor 06/11/2014 8:09 AM 06/11/2014 8:30 AM
23238 3-Elevated 2-High Maintenance Completed - I2 IP Backbone CHIC-KANS Hardware Vendor06/12/2014 2:04 AM 06/12/2014 3:14 AM

Scheduled Maintenances Detail

Ticket No.:23213:45
Subject:Maintenance Completed - I2 IP Backbone ATLA-CHIC
Source Of Impact:Vendor
Affected:Backbone ATLA-CHIC
Start Time:Tuesday, June 10, 2014, 5:25 AM (0525) UTC
End Time:Tuesday, June 10, 2014, 5:26 AM (0526) UTC
Description: Backbone ATLA-CHIC was briefly unavailable while Internet2 Engineers performed maintenance. The maintenance has been completed. IP traffic was re-routed during this maintenance.

Ticket No.:23220:45
Subject:Maintenance Completed - I2 IP Backbone CHIC-CLEV
Source Of Impact:Vendor
Affected:Backbone CHIC-CLEV
Start Time:Wednesday, June 11, 2014, 8:09 AM (0809) UTC
End Time:Wednesday, June 11, 2014, 8:30 AM (0830) UTC
Description: Backbone CHIC-CLEV was unavailable while Internet2 Engineers performed maintenance to create an additional AL2S backbone. The maintenance has been completed. IP traffic was re-routed during this maintenance.

Ticket No.:23238:45
Subject:Maintenance Completed - I2 IP Backbone CHIC-KANS
Source Of Impact:Vendor
Affected:Backbone CHIC-KANS
Start Time:Thursday, June 12, 2014, 2:04 AM (0204) UTC
End Time:Thursday, June 12, 2014, 3:14 AM (0314) UTC
Description: Backbone CHIC-KANS was unavailable while Level(3) Communications performed maintenance to replace a card in Plainfield, IN. Maintenance has been completed. IP traffic will re-route during this maintenance.


Downtime and Availability



Internet2 IP Core Nodes Down TimeReporting Period Availability52 Week Availability
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99355% 99.99867%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98501% 99.99905%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99089% 99.99924%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97571% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99639% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99184% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99943% 100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99336% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99639% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98843% 100.00000%
rtsw0.sing1.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw.sing2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%

Aggregate Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%99.99258%99.99975%

** Less than 52 weeks of data available

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 2 min0 hr 1 min 99.98016%99.99008% 99.87269%99.95617%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.72279%99.89545%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78749%99.84138%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 2 hr 36 min2 hr 15 min 98.45238%98.66071% 99.75979%99.82848%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 1 hr 10 min0 hr 0 min 99.30556%100.00000% 99.92126%99.97723%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98216%99.99924%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95105%99.98179%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.72848%99.77326%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 9 hr 57 min9 hr 57 min 94.07738%94.07738% 99.58428%99.68333%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93568%99.97002%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94592%100.00000%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96205%99.99905%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96205%99.99905%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94953%99.95598%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98710%99.99924%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98729%99.99943%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89564%99.96774%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05638 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74480%99.81823%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 14 hr 10 min14 hr 10 min 91.56746%91.56746% 99.38202%99.73399%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05562 14 hr 10 min14 hr 10 min 91.56746%91.56746% 99.38088%99.73418%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05133 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.59244%99.59699%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84707%99.85030%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84707%99.85030%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-6366 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96604%99.98786%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08892 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95769%99.98786%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 1 hr 10 min0 hr 0 min 99.30556%100.00000% 99.95048%99.98710%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 1 hr 10 min0 hr 0 min 99.30556%100.00000% 99.95048%99.98710%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95845%99.99905%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96053%99.99981%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.82620%99.83626%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08890 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.80039%99.83626%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.67858%99.75030%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05561 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.67858%99.75030%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.50269%99.60667%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05581 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.49890%99.60667%
Legacy 10G Backbone: I2-KANS-CHIC-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05138 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81500%99.90930%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81500%99.90930%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.81481%99.90912%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74992%99.80666%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05571 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75315%99.80666%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95978%99.99772%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.95655%99.99772%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78825%99.91177%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07613 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.78825%99.91177%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956%99.99943%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05573 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98937%99.99943%

Aggregate All Internet2 IP Backbone Circuits 44 hr 25 min3 hr 52 min 99.47123%99.51726% 99.83756%99.89810%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

* Internet2 IP 100G Backbone Circuits Ride over AL2S for connectivity.



Upcoming Scheduled Maintenances

Ticket No.:23219:45
Subject:Maintenance - I2 IP Various Backbones
Affected:Backbone ATLA-CHIC
Backbone CHIC-CLEV
Backbone HOUS-KANS
Backbone CLEV-WASH
ION Backbone CLEV-WASH
ION Backbone HOUS-KANS
ION Backbone ATLA-CHIC
ION Backbone CHIC-CLEV
Start Time:Thursday, June 26, 2014, 4:00 AM (0400) UTC
End Time:Thursday, June 26, 2014, 11:00 AM (1100) UTC
Description: The backbone listed above will be unavailable while Internet2 fiber provider Engineers perform maintenance. Outages are expected; however, the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:23221:45
Subject:Maintenance - I2 IP Various Backbones
Affected:Backbone CLEV-NEWY32AOA
Backbone LOSA-SEAT
Backbone NEWY32AOA-WASH
ION Backbone CLEV-NEWY32AOA
ION Backbone NEWY32AOA-WASH
Start Time:Friday, June 27, 2014, 4:00 AM (0400) UTC
End Time:Friday, June 27, 2014, 11:00 AM (1100) UTC
Description: The backbones listed above will be unavailable while Internet2's fiber provider Engineers perform maintenance. Outages are expected and the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:23222:45
Subject:Maintenance - I2 IP Various Backbones
Affected:ION Backbone ATLA-CHIC
Backbone ATLA-CHIC
ION Backbone ATLA-WASH
Backbone ATLA-WASH
ION Backbone CHIC-KANS
Backbone CHIC-KANS
ION Backbone HOUS-KANS
Backbone HOUS-KANS
Start Time:Thursday, July 3, 2014, 4:00 AM (0400) UTC
End Time:Thursday, July 3, 2014, 11:00 AM (1100) UTC
Description: The above listed backbones will be unavailable while Vendor Engineers perform maintenance. Outages are anticipated; however, the entire window is reserved. IP traffic will re-route during this maintenance.

Ticket No.:23283:45
Subject:Maintenance - I2 IP Backbone CHIC-KANS
Affected:Backbone CHIC-KANS
Start Time:Sunday, July 6, 2014, 5:00 AM (0500) UTC
End Time:Sunday, July 6, 2014, 7:00 AM (0700) UTC
Description: Backbone CHIC-KANS will be unavailable while Level(3) Communications performs maintenance to replace a card in Plainfield, IN. An outage is expected, and the entire window is reserved. IP traffic will re-route during this maintenance.