Unified - Internet2 IP Network Operations Report
05/11/2015 - 05/17/2015

Unified - Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

38534-Normal Brief Outage Resolved - I2 AL2S Backbone KANS-TULS HardwareVendor 05/17/2015 4:34 AM 05/17/2015 4:35 AM

Unscheduled Outages Detail


Ticket No.:3853:144
Subject:Brief Outage Resolved - I2 AL2S Backbone KANS-TULS
Source Of Impact:Vendor
Affected:AL2S Backbone KANS-TULS
IP Backbone HOUS-KANS
Start Time:Sunday, May 17, 2015, 4:34 AM (0434) UTC
End Time:Sunday, May 17, 2015, 4:35 AM (0435) UTC
Description:The above listed asset is now available after a brief outage. Level(3) reports the outage was caused by severe weather in Oklahoma. Workgroup administrators received notifications from OESS regarding circuits re-routed on the backbone.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

3733 3-Elevated Maintenance Completed - I2 IP Backbone CHIC-KANS Circuit Internal05/13/2015 5:03 AM 05/13/2015 5:05 AM
3684 3-Elevated 1-Critical Maintenance 1 of 2 Completed - I2 Optical DWDM System DALL-HOUS CircuitVendor 05/14/2015 5:04 AM 05/14/2015 8:54 AM
3792 3-Elevated Maintenance Completed - I2 AL2S Backbone RALE-WASH Hardware Vendor05/15/2015 6:29 AM 05/15/2015 7:11 AM
3797 3-Elevated 1-Critical Maintenance Completed - I2 Optical DWDM System ALBA-BUFF CircuitVendor 05/16/2015 4:40 AM 05/16/2015 4:43 AM

Scheduled Maintenances Detail

Ticket No.:3733:144
Subject:Maintenance Completed - I2 IP Backbone CHIC-KANS
Source Of Impact:Internal
Affected:IP Backbone CHIC-KANS
Start Time:Wednesday, May 13, 2015, 5:03 AM (0503) UTC
End Time:Wednesday, May 13, 2015, 5:05 AM (0505) UTC
Description: The above assets were unavailable while Internet2 Engineers performed maintenance to clean fiber. A brief outage was observed. IP traffic re-routed during this maintenance. Maintenance has been completed. No further outages are expected.

Ticket No.:3684:144
Subject:Maintenance 1 of 2 Completed - I2 Optical DWDM System DALL-HOUS
Source Of Impact:Vendor
Affected:DWDM System DALL-HOUS
AL2S Backbone DALL-HOUS
IP Backbone HOUS-KANS
Start Time:Thursday, May 14, 2015, 5:04 AM (0504) UTC
End Time:Thursday, May 14, 2015, 8:54 AM (0854) UTC
Description: DWDM System DALL-HOUS was unavailable while Level(3) Communications performed cable relocation in Montgomery, TX. An outage was expected. Layer 2 and 3 backbone traffic re-routed during this maintenance. The maintenance has been completed. No further outages are expected.

Ticket No.:3792:144
Subject:Maintenance Completed - I2 AL2S Backbone RALE-WASH
Source Of Impact:Vendor
Affected:AL2S Backbone RALE-WASH
IP Backbone ATLA-CLEV
IP Backbone ATLA-NEWY32AOA
IP Backbone ATLA-WASH
Start Time:Friday, May 15, 2015, 6:29 AM (0629) UTC
End Time:Friday, May 15, 2015, 7:11 AM (0711) UTC
Description: The above listed assets are now available after Level(3) Engineers performed hardware maintenance. An outage was experienced but no further impact is expected. Backbone traffic re-routed during this maintenance.

Ticket No.:3797:144
Subject:Maintenance Completed - I2 Optical DWDM System ALBA-BUFF
Source Of Impact:Vendor
Affected:DWDM System ALBA-BUFF
AL2S Backbone(s) ALBA-CLEV
IP Backbone(s) CLEV-NEWY32AOA
Start Time:Saturday, May 16, 2015, 4:40 AM (0440) UTC
End Time:Saturday, May 16, 2015, 4:43 AM (0443) UTC
Description: DWDM System ALBA-BUFF is now available afterLevel(3) Communications replaced a line interface module in Utica, NY. No further impact is expected.


Downtime and Availability



Unified - Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw0.sing1.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw.sing2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%

Aggregate Unified - Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%100.00000%100.00000%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Unified - Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
I2-ATLA-CLEV-VLAN-14832 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-CLEV-VLAN-14837 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14833 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14838 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14831 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14834 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.53134%99.86908%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.60876%99.99602%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 42 min0 hr 0 min 99.58333%100.00000% 99.88692%99.96812%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92240%99.99924%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 2 min0 hr 0 min 99.98016%100.00000% 99.94896%99.99848%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 3 min0 hr 0 min 99.97024%100.00000% 99.94156%99.99469%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.91462%99.94782%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 3 hr 51 min0 hr 1 min 97.70833%99.99008% 99.84954%99.98672%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.62583%99.75106%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89375%99.98975%
R&E 10G Backbone: I2-LOSA-PAIX-VLAN-23105 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Commodity 10G Backbone: I2-LOSA-PAIX-VLAN-23106 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98330%99.99905%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97647%99.99924%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97647%99.99924%
R&E 100G Backbone: I2-LOSA-WILC-VLAN-23103 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Commodity 100G Backbone: I2-LOSA-WILC-VLAN-23104 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94213%99.95997%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99658%99.99962%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99658%99.99962%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09318 0 hr 42 min0 hr 0 min 99.58333%100.00000% 99.88692%99.96812%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.71634%99.97287%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.20993%99.56208%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93871%100.00000%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93739%99.99867%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.94023%99.99981%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97989%99.99962%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96376%99.99962%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99867%99.99867%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 3 hr 50 min0 hr 0 min 97.71825%100.00000% 99.89982%99.99753%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.75789%99.82772%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92505%99.99924%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.92505%99.99924%
Legacy 10G Backbone: I2-LOSA-PAIX-10GE-05853 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99621%100.00000%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99013%100.00000%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97818%99.99905%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99412%99.99981%
Legacy 100G Backbone: I2-LOSA-WILC-100GE-23893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99696%99.99810%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981%99.99981%

Aggregate All Unified - Internet2 IP Backbone Circuits 9 hr 10 min9 hr 9 min 99.88865%99.99980% 99.91899%99.97505%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:3773:144
Subject:Maintenance - I2 Optical Member ESnet
Affected:I2 Optical Member ESnet
Start Time:Friday, May 22, 2015, 4:00 AM (0400) UTC
End Time:Friday, May 22, 2015, 9:00 AM (0900) UTC
Description: Member ESnet's Optical circuit ESNET-CHAT-ORNL-100GE-06347 may be unavailable while ESnet Engineers perform maintenance. An outage of up to 4 hours and 30 minutes is expected; however the entire maintenance window has been reserved.

Ticket No.:3831:144
Subject:Maintenance - I2 AL2S Core Node EQCH
Affected:AL2S Core Node EQCH
AL2S Backbone EQCH-MINN
AL2S Backbone EQCH-STAR
AL2S Backbone CLEV-EQCH
IP Backbone CHIC-CLEV
Net+ Provider Code42 (CHIC)
Start Time:Friday, May 22, 2015, 5:00 AM (0500) UTC
End Time:Friday, May 22, 2015, 7:00 AM (0700) UTC
Description: The above listed assets will be unavailable while Internet2 Engineers perform hardware maintenance. Outages are expected. All AL2S connections to the node will be affected. AL2S workgroup administrators receive notifications from OESS regarding circuits re-routed on the backbone. IP Backbones will re-route during the event.

Ticket No.:3890:144
Subject:Maintenance *Tracking* - I2 Optical Member ESnet (KANS)
Affected:KSCYMO11KAC1CD6I2373 2-33
Start Time:Tuesday, May 26, 2015, 5:00 AM (0500) UTC
End Time:Tuesday, May 26, 2015, 7:00 AM (0700) UTC
Description: Vendor Level(3)'s above listed optical devices may be unavailable while Level(3) Engineers perform maintenance. An outage is not expected; however some nodes may become briefly unavailable. The entire window is reserved.

Ticket No.:3925:144
Subject:Maintenance - I2 AL2S Backbone SEAT-SEAT
Affected:AL2S Backbone SEAT-SEAT
IP Backbone SALT-SEAT, LOSA-SEAT
NET+ Provider Code42
Participant UW Science DMZ
Participant UMontana
Connector PNWGP
Participant U of Hawaii
Start Time:Friday, May 29, 2015, 10:00 AM (1000) UTC
End Time:Friday, May 29, 2015, 1:00 PM (1300) UTC
Description: The above listed asset will be unavailable while Internet2 Engineers perform maintenance. An outage is expected and the entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:3827:144
Subject:Maintenance - I2 Various Optical Circuits (Northern Tier)
Affected:Optical Member CA*Net/CANARIE
AL2S Backbone MINN-MISS2
Net+ Provider Code42 (CHIC)
Start Time:Sunday, May 31, 2015, 1:00 PM (1300) UTC
End Time:Sunday, May 31, 2015, 7:00 PM (1900) UTC
Description: The above listed optical circuits will be unavailable while Zayo Engineers perform maintenance. An outage of 3+ hours is expected, however the entire maintenance window has been reserved.