Unified - Internet2 IP Network Operations Report
09/21/2015 - 09/27/2015

Unified - Internet2 IP Network Operations Center
at Indiana University

New Connections

None


Upgrades

None


New Services

None


Unscheduled Outages Summary

Ticket Number Customer Impact Network Impact Title Outage Type Source Of Impact Start Time (UTC) End Time (UTC)

56644-Normal Brief Outage - I2 AL2S Core Node TUCS SoftwareVendor 09/21/2015 4:06 PM 09/21/2015 4:10 PM
56773-Elevated 1-Critical Outage Resolved - I2 Optical DWDM System LASV-LOSA Unannounced MaintenanceVendor 09/22/2015 10:07 AM 09/22/2015 10:37 AM
56953-Elevated 1-Critical Brief Outage - I2 Optical DWDM System BATO-JACK InvestigatingVendor 09/22/2015 8:14 PM 09/22/2015 8:15 PM

Unscheduled Outages Detail


Ticket No.:5664:144
Subject:Brief Outage - I2 AL2S Core Node TUCS
Source Of Impact:Vendor
Affected:AL2S Core Node TUCS
AL2S Backbone PHOE-TUCS and ELPA-TUCS
IP Backbone HOUS-LOSA and PHOE-TUCS
AL2S Connector Sun Corridor
Start Time:Monday, September 21, 2015, 4:06 PM (1606) UTC
End Time:Monday, September 21, 2015, 4:10 PM (1610) UTC
Description:The above listed assets are available after a brief outage. Internet2 Engineers are investigating the cause. The reason for the outage is pending. All connections to the Core Node were affected.

Ticket No.:5677:144
Subject:Outage Resolved - I2 Optical DWDM System LASV-LOSA
Source Of Impact:Vendor
Affected:DWDM System LASV-LOSA
AL2S Backbone(s) LASV-LOSA
IP Backbone(s) LOSA-SALT
All Connectors and Peers
Start Time:Tuesday, September 22, 2015, 10:07 AM (1007) UTC
End Time:Tuesday, September 22, 2015, 10:37 AM (1037) UTC
Description:The above listed assets are currently available to the community. Level (3) Communications Engineers have stated the outage is due to a planned maintenance to relocate cable. This maintenance is scheduled to be completed at 1300 UTC. No further outages are expected.

Ticket No.:5695:144
Subject:Brief Outage - I2 Optical DWDM System BATO-JACK
Source Of Impact:Vendor
Affected:DWDM System BATO-JACK
Optical Member NOAA N-Wave
AL2S Backbone BATO-JACK
IP Backbone ATLA-HOUS
Start Time:Tuesday, September 22, 2015, 8:14 PM (2014) UTC
End Time:Tuesday, September 22, 2015, 8:15 PM (2015) UTC
Description:The above listed assets were briefly unavailable to the community. Level (3) Communications Engineers are currently investigating the reason for the outage. Updates will be provided as they are received.

Scheduled Maintenances Summary

Ticket Number Customer Impact Network Impact Title Maintenance Type Source Of Impact Start Time (UTC) End Time (UTC)

5681 3-Elevated 1-Critical Emergency Maintenance 1 of 2 *Completed* - I2 Optical DWDM System LASV-LOSA Circuit Vendor09/22/2015 10:07 AM 09/22/2015 10:37 AM
5682 3-Elevated Emergency Maintenance 2 of 2 *Cancelled* - I2 Optical DWDM System LASV-LOSA CircuitVendor 09/22/2015 10:07 AM 09/22/2015 10:37 AM
5571 4-Normal 3-Elevated Maintenance Completed - I2 Optical Various Circuits Circuit Internal09/25/2015 9:01 AM 09/25/2015 9:18 AM

Scheduled Maintenances Detail

Ticket No.:5681:144
Subject:Emergency Maintenance 1 of 2 *Completed* - I2 Optical DWDM System LASV-LOSA
Source Of Impact:Vendor
Affected:DWDM System LASV-LOSA
AL2S Backbone(s) LASV-LOSA
IP Backbone(s) LOSA-SALT
Start Time:Tuesday, September 22, 2015, 10:07 AM (1007) UTC
End Time:Tuesday, September 22, 2015, 10:37 AM (1037) UTC
Description: The above listed assets are available after Level(3) Communications performed dwdm circuit maintenance in Los Angeles, California. No further outages are expected.

Ticket No.:5682:144
Subject:Emergency Maintenance 2 of 2 *Cancelled* - I2 Optical DWDM System LASV-LOSA
Source Of Impact:Vendor
Affected:DWDM System LASV-LOSA
AL2S Backbone(s) LASV-LOSA
IP Backbone(s) LOSA-SALT
Start Time:Tuesday, September 22, 2015, 10:07 AM (1007) UTC
End Time:Tuesday, September 22, 2015, 10:37 AM (1037) UTC
Description: *Please note that this alternate window is not needed and this event has been cancelled* The above listed assets will be unavailable while Level(3) Communications performs dwdm circuit maintenance in Los Angeles, California. An outage of 2 hours is expected, however the entire window is reserved.

Ticket No.:5571:144
Subject:Maintenance Completed - I2 Optical Various Circuits
Source Of Impact:Internal
Affected:AL2S Backbone HART2-NEWY32AOA
IP Backbone LOSA-SEAT
IP Backbone CHIC-NEWY32AOA
IP Backbone CLEV-NEWY32AOA
IP Connector University of Oregon
Start Time:Friday, September 25, 2015, 9:01 AM (0901) UTC
End Time:Friday, September 25, 2015, 9:18 AM (0918) UTC
Description: The above listed circuits were briefly unavailable while Internet2 Engineers performed circuit maintenance. Maintenance has completed. No further outages are expected.


Downtime and Availability



Unified - Internet2 IP Core NodesDown TimeReporting Period Availability52 Week Availability
ATLA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CHIC MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
CLEV MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
HOUS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
KANS MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
LOSA MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
NEWY MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SALT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
SEAT MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
WASH MX960 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw0.sing1.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%
rtsw.sing2.net.internet2.edu 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000% 100.00000%

Aggregate Unified - Internet2 IP Core Nodes0 hr 0 min0 hr 0 min100.00000%100.00000%100.00000%100.00000%

NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.

Unified - Internet2 IP Backbone CircuitsDown Time Reporting Period Availability52 Week Availability
I2-ATLA-CLEV-VLAN-14832 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-CLEV-VLAN-14837 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14833 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-ATLA-NEWY32AOA-VLAN-14838 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14831 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
I2-CHIC-NEWY32AOA-VLAN-14834 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-CHIC-VLAN-09181 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.44919%99.79831%
R&E 100G Backbone: I2-ATLA-HOUS-VLAN-09182 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.52167%99.96300%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.72697%99.84271%
R&E 100G Backbone: I2-CHIC-CLEV-VLAN-09180 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.84612%99.98008%
R&E 100G Backbone: I2-CHIC-KANS-VLAN-09183 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.90817%99.99564%
R&E 100G Backbone: I2-CLEV-NEWY32AOA-VLAN-09177 0 hr 17 min0 hr 0 min 99.83135%100.00000% 99.86396%99.89545%
R&E 100G Backbone: I2-CLEV-WASH-VLAN-09178 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.85523%99.88654%
R&E 100G Backbone: I2-HOUS-KANS-VLAN-09184 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.59244%99.78199%
R&E 100G Backbone: I2-HOUS-LOSA-VLAN-09189 0 hr 4 min0 hr 4 min 99.96032%99.96032% 99.28165%99.41636%
R&E 100G Backbone: I2-KANS-SALT-VLAN-09185 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.86339%99.98027%
R&E 10G Backbone: I2-LOSA-PAIX-VLAN-23105 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956%100.00000%
Commodity 10G Backbone: I2-LOSA-PAIX-VLAN-23106 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98956%100.00000%
R&E 100G Backbone: I2-LOSA-SALT-VLAN-09188 1 hr 30 min0 hr 30 min 99.10714%99.70238% 99.94251%99.99336%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09187 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79850%99.88521%
R&E 100G Backbone: I2-LOSA-SEAT-VLAN-09328 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.79850%99.88521%
R&E 100G Backbone: I2-LOSA-WILC-VLAN-23103 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98918%99.99602%
Commodity 100G Backbone: I2-LOSA-WILC-VLAN-23104 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98918%99.99602%
R&E 100G Backbone: I2-NEWY32AOA-WASH-VLAN-09176 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.89697%99.95997%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09186 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96471%99.99962%
R&E 100G Backbone: I2-SALT-SEAT-VLAN-09327 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.96471%99.99962%
R&E 100G Backbone: I2-WASH-ATLA-VLAN-09179 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
R&E 100G Backbone: I2-ATLA-WASH-VLAN-09318 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.72697%99.84271%
Legacy 10G Backbone: I2-ATLA-CHIC-10GE-05419 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.65752%99.90912%
Legacy 10G Backbone: I2-ATLA-HOUS-10GE-05423 0 hr 1 min0 hr 1 min 99.99008%99.99008% 99.36760%99.72279%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-05251 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93871%100.00000%
Legacy 10G Backbone: I2-ATLA-WASH-10GE-09142 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93245%99.99829%
Legacy 10G Backbone: I2-CHIC-CLEV-10GE-08891 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93188%99.98065%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05781 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CHIC-KANS-10GE-05976 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.97647%99.99962%
Legacy 10G Backbone: I2-CLEV-NEWY32AOA-10GE-08894 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-CLEV-WASH-10GE-08889 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93378%99.93815%
Legacy 10G Backbone: I2-HOUS-KANS-10GE-05560 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.74177%99.84271%
Legacy 10G Backbone: I2-HOUS-KANS-LAG-08934 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-HOUS-LOSA-10GE-05559 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.76985%99.82734%
Legacy 10G Backbone: I2-KANS-SALT-10GE-05566 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93321%99.99981%
Legacy 10G Backbone: I2-KANS-SALT-LAG-08935 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.93796%100.00000%
Legacy 10G Backbone: I2-LOSA-PAIX-10GE-05853 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.98577%100.00000%
Legacy 10G Backbone: I2-LOSA-SALT-10GE-05563 1 hr 30 min0 hr 30 min 99.10714%99.70238% 99.96395%99.99431%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05564 0 hr 17 min0 hr 0 min 99.83135%100.00000% 99.83455%99.85732%
Legacy 10G Backbone: I2-LOSA-SEAT-10GE-05572 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99981%99.99981%
Legacy 100G Backbone: I2-LOSA-WILC-100GE-23893 0 hr 0 min0 hr 0 min 100.00000%100.00000% 100.00000%100.00000%
Legacy 10G Backbone: I2-NEWY32AOA-WASH-10GE-07612 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99298%99.99791%
Legacy 10G Backbone: I2-SALT-SEAT-10GE-05565 0 hr 0 min0 hr 0 min 100.00000%100.00000% 99.99658%99.99981%

Aggregate All Unified - Internet2 IP Backbone Circuits 3 hr 40 min2 hr 34 min 99.95546%99.98664% 99.87457%99.94216%


NOTE: Numbers in italics represent downtime with scheduled maintenance excluded. Internet2's definition of scheduled maintenance is any anticipated outage announced at least 72 hours in advance of the outage start time.



Upcoming Scheduled Maintenances

Ticket No.:5658:144
Subject:Maintenance 1 of 3 - I2 Optical Member WIX Circuit I2-ASHB-WASH-100GE-13466
Affected:Optical Member WIX
IP Peer GEANT (WASH) *
IP Peer QNREN (WASH) *
Start Time:Saturday, October 3, 2015, 11:00 AM (1100) UTC
End Time:Saturday, October 3, 2015, 9:00 PM (2100) UTC
Description: The above will be unavailable while TATA Communication's dark fiber provider performs work to roll fibers to new cable. An outage of up to ten hours anticipated, however, the entire window is reserved. *Denotes peer is multihomed and therefore should remain reachable to the community. This is maintenance window 1 of 3.

Ticket No.:5804:144
Subject:Maintenance - I2 Optical DWDM System BATO-JACK
Affected:DWDM System BATO-JACK
AL2S Backbone(s) BATO-JACK
IP Backbone(s) ATLA-HOUS
Optical Member NOAA N-WAVE
Start Time:Tuesday, October 6, 2015, 4:00 AM (0400) UTC
End Time:Tuesday, October 6, 2015, 10:00 AM (1000) UTC
Description: The above listed assets will be unavailable while Level(3) Communications perform a hot cut to relocate long haul cable between Ponce De Leon, FL and Defuniak Spring, FL. An outage of up to 6 hours is expected. The entire window is reserved.

Ticket No.:5380:144
Subject:Maintenance 3 of 4 Rescheduled - I2 Optical DWDM System JCSN-MEMP
Affected:DWDM System JCSN-MEMP
Optical Member ESnet
Optical Member MissiON
Optical Member NOAA N-Wave
AL2S Backbone ATLA-JCSN
Start Time:Tuesday, October 6, 2015, 5:00 AM (0500) UTC
End Time:Tuesday, October 6, 2015, 10:00 AM (1000) UTC
Description: *Please note this maintenance has been rescheduled* The above listed assets will be unavailable while Zayo Engineers perform maintenance to replace a splice case in Memphis, TN. An outage of up to 30 minutes is expected. The entire window is reserved. This is maintenance window 3 of 4.

Ticket No.:5381:144
Subject:Maintenance 4 of 4 Rescheduled - I2 Optical DWDM System JCSN-MEMP
Affected:DWDM System JCSN-MEMP
Optical Member ESnet
Optical Member MissiON
Optical Member NOAA N-Wave
AL2S Backbone ATLA-JCSN
Start Time:Wednesday, October 7, 2015, 5:00 AM (0500) UTC
End Time:Wednesday, October 7, 2015, 10:00 AM (1000) UTC
Description: *Please note this maintenance has been rescheduled* The above listed assets will be unavailable while Zayo Engineers perform maintenance to replace a splice case in Memphis, TN. An outage of up to 30 minutes is expected. The entire window is reserved. This is maintenance window 4 of 4.

Ticket No.:5817:144
Subject:Maintenance - I2 Optical DWDM System BATO-JACK
Affected:DWDM System BATO-JACK
AL2S Backbones ATLA-HOUH, BATO-JACK
IP Backbone ATLA-HOUS
Start Time:Wednesday, October 7, 2015, 5:00 AM (0500) UTC
End Time:Wednesday, October 7, 2015, 11:00 AM (1100) UTC
Description: The above listed assets will be unavailable while Level(3) Communications repairs damaged long haul cable in Christian, MS. An outage of 4 hours is expected. The entire window is reserved.

Ticket No.:5821:144
Subject:Maintenance - I2 AL2S Backbone ATLA-JCSN and AL2S/IP Interconnect (ATLA)
Affected:AL2S Backbone ATLA-JCSN
AL2S/IP Interconnect (ATLA)
IP Backbone ATLA-NEWY32AOA
IP Backbone ATLA-HOUS
IP Backbone ATLA-CLEV
IP Peer RedClara*
IP Peer MCNC*
Start Time:Friday, October 9, 2015, 4:00 AM (0400) UTC
End Time:Friday, October 9, 2015, 6:00 AM (0600) UTC
Description: The above listed asset will be unavailable while Internet2 Engineers perform maintenance. An outage of is expected and the entire window is reserved. Backbone traffic will re-route during this maintenance.Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone. *Denotes that peer is multi-homed and therefore should remain reachable to the community.*

Ticket No.:5800:144
Subject:Maintenance - I2 AL2S Backbone PHIL-WASH
Affected:AL2S Backbone PHIL-WASH
IP Backbone(s) ATLA-NEWY and NEWY-WASH
Start Time:Friday, October 9, 2015, 8:00 AM (0800) UTC
End Time:Friday, October 9, 2015, 10:00 AM (1000) UTC
Description: The above listed assets will be unavailable while Internet2 Engineers perform maintenance. An outage of is expected and entire window is reserved. Backbone traffic will re-route during this maintenance. Workgroup administrators will receive notifications from OESS regarding circuits re-routed on the backbone.

Ticket No.:5659:144
Subject:Maintenance 2 of 3 - I2 Optical Member WIX Circuit I2-ASHB-WASH-100GE-13466
Affected:Optical Member WIX
IP Peer GEANT (WASH) *
IP Peer QNREN (WASH) *
Start Time:Saturday, October 10, 2015, 11:00 AM (1100) UTC
End Time:Saturday, October 10, 2015, 9:00 PM (2100) UTC
Description: The above will be unavailable while TATA Communication's dark fiber provider performs work to roll fibers to new cable. An outage of up to ten hours anticipated, however, the entire window is reserved. *Denotes peer is multihomed and therefore should remain reachable to the community. This is maintenance window 2 of 3.

Ticket No.:5786:144
Subject:Maintenance - I2 Optical DWDM System HOUS-SANA
Affected:DWDM System HOUS-SANA
AL2S Backbone ELPA-HOUH
IP Backbone HOUS-LOSA
Optical Member NOAA N-Wave
Optical Member ESnet
Start Time:Friday, October 16, 2015, 5:00 AM (0500) UTC
End Time:Friday, October 16, 2015, 11:00 AM (1100) UTC
Description: The above listed assets will be unavailable while Level(3) Communications perform maintenance in Houston, TX. An outage is expected. The entire window is reserved.

Ticket No.:5660:144
Subject:Maintenance 3 of 3 - I2 Optical Member WIX Circuit I2-ASHB-WASH-100GE-13466
Affected:Optical Member WIX
IP Peer GEANT (WASH) *
IP Peer QNREN (WASH) *
Start Time:Saturday, October 17, 2015, 11:00 AM (1100) UTC
End Time:Saturday, October 17, 2015, 9:00 PM (2100) UTC
Description: The above will be unavailable while TATA Communication's dark fiber provider performs work to roll fibers to new cable. An outage of up to ten hours anticipated, however, the entire window is reserved. *Denotes peer is multihomed and therefore should remain reachable to the community. This is maintenance window 3 of 3.

Ticket No.:5741:144
Subject:Maintenance - I2 Optical Various Circuits
Affected:CA*Net/CANARIE
Net+ Provider Code42
AL2S Backbone MINN-MISS
Start Time:Sunday, October 18, 2015, 2:00 PM (1400) UTC
End Time:Monday, October 19, 2015, 2:00 AM (0200) UTC
Description: Member Zayo's above circuits will be unavailable while Zayo Engineers perform maintenance. A brief outage is expected, however the entire maintenance window has been reserved.