Ongoing Cloudpager outage in the US due to Azure outage (07/18/24)
Posted
about 2 months ago
by Kyle Goebel
Pinned Topic
Topic is Locked
Kyle GoebelAdmin
Cloudpager Service in the US is down due to an outage with Azure: https://azure.status.microsoft/en-us/status. We are closely monitoring the situation and we will provide updates as they become available.
From Azure: Impact Statement: Starting at approximately 21:56 UTC on 18 Jul 2024, a subset of customers may experience issues with multiple Azure services in the Central US region including failures with service management operations and connectivity or availability of services.
Current Status: We are aware of this issue and are actively investigating. The next update will be provided in 60 minutes, or as events warrant.
1 Votes
2 Comments
Sorted by
Kyle Goebelposted
about 2 months ago
Admin
Cloudpager Services are back up, however Azure Services are still recovering. Azure: https://azure.status.microsoft/en-us/status We are closely monitoring the situation and we will provide an update if the situation should change.
Per Azure:
Impact Statement: Starting at approximately 21:56 UTC on 18 Jul 2024, a subset of customers may experience issues with multiple Azure services in the Central US region including failures with service management operations and connectivity or availability of services.
Current Status: We are aware of this issue and have engaged multiple teams. We’ve determined the underlying cause. A backend cluster management workflow deployed a configuration change causing backend access to be blocked between a subset of Azure Storage clusters and compute resources in the Central US region. This resulted in the compute resources automatically restarting when connectivity was lost to virtual disks. Mitigation has been confirmed for all Azure Storage clusters, the majority of services are now recovered. A small subset of services is still experiencing residual impact. Impacted customers will be continuing to communicate throuhg Azure service health portal. The next update will be provided in 60 minutes, or as events warrant.
0 Votes
Kyle Goebelposted
about 2 months ago
Admin
Cloudpager Services are coming back up as Azure Services are slowly returning online. Azure: https://azure.status.microsoft/en-us/status We are closely monitoring the situation and we will provide an update once all services have become available.
Per Azure:
Impact Statement: Starting at approximately 21:56 UTC on 18 Jul 2024, a subset of customers may experience issues with multiple Azure services in the Central US region including failures with service management operations and connectivity or availability of services.
Current Status: We are aware of this issue and have engaged multiple teams. As part of the investigation, we have reviewed previous deployments, and are running other mitigation workstreams. We’ve determined the underlying cause and are currently applying mitigation .Customers should see signs of recovery at this time as mitigation applies across resources in the region. The next update will be provided in 60 minutes, or as events warrant.
0 Votes
People who like this
Delete Comment
This post will be deleted permanently. Are you sure?
Cloudpager Service in the US is down due to an outage with Azure: https://azure.status.microsoft/en-us/status. We are closely monitoring the situation and we will provide updates as they become available.
From Azure:
Impact Statement: Starting at approximately 21:56 UTC on 18 Jul 2024, a subset of customers may experience issues with multiple Azure services in the Central US region including failures with service management operations and connectivity or availability of services.
Current Status: We are aware of this issue and are actively investigating. The next update will be provided in 60 minutes, or as events warrant.
1 Votes
2 Comments
Kyle Goebel posted about 2 months ago Admin
Cloudpager Services are back up, however Azure Services are still recovering. Azure: https://azure.status.microsoft/en-us/status We are closely monitoring the situation and we will provide an update if the situation should change.
Per Azure:
Impact Statement: Starting at approximately 21:56 UTC on 18 Jul 2024, a subset of customers may experience issues with multiple Azure services in the Central US region including failures with service management operations and connectivity or availability of services.
Current Status: We are aware of this issue and have engaged multiple teams. We’ve determined the underlying cause. A backend cluster management workflow deployed a configuration change causing backend access to be blocked between a subset of Azure Storage clusters and compute resources in the Central US region. This resulted in the compute resources automatically restarting when connectivity was lost to virtual disks. Mitigation has been confirmed for all Azure Storage clusters, the majority of services are now recovered. A small subset of services is still experiencing residual impact. Impacted customers will be continuing to communicate throuhg Azure service health portal. The next update will be provided in 60 minutes, or as events warrant.
0 Votes
Kyle Goebel posted about 2 months ago Admin
Cloudpager Services are coming back up as Azure Services are slowly returning online. Azure: https://azure.status.microsoft/en-us/status We are closely monitoring the situation and we will provide an update once all services have become available.
Per Azure:
Impact Statement: Starting at approximately 21:56 UTC on 18 Jul 2024, a subset of customers may experience issues with multiple Azure services in the Central US region including failures with service management operations and connectivity or availability of services.
Current Status: We are aware of this issue and have engaged multiple teams. As part of the investigation, we have reviewed previous deployments, and are running other mitigation workstreams. We’ve determined the underlying cause and are currently applying mitigation .Customers should see signs of recovery at this time as mitigation applies across resources in the region. The next update will be provided in 60 minutes, or as events warrant.
0 Votes