Own from Salesforce - [Hipaa4] [Archive] Upstream Azure Outage Causing Service Degradation – Incident details

All systems operational

[Hipaa4] [Archive] Upstream Azure Outage Causing Service Degradation

Resolved
Degraded performance
Started about 2 months agoLasted 5 days

Affected

HIPAA4

Degraded performance from 5:04 AM to 7:04 PM

Archive

Degraded performance from 5:04 AM to 7:04 PM

Updates
  • Resolved
    UTC
    Resolved

    The Archive search service is fully restored. The upstream Microsoft Azure outage has been resolved, our Elastic Cloud cluster is healthy, and rebalancing is complete. No customer action is required. Thank you for your patience.

  • Monitoring
    UTC
    Monitoring

    The search service has been restored to full capacity. Working with Elastic support, we completed the recovery actions and the cluster is healthy. Background rebalancing across the cluster is still in progress. We are monitoring until it completes.

  • Update
    UTC
    Update

    Microsoft Azure has confirmed a datacenter power outage as the source. Elastic Cloud (hosted on Azure) is degraded, which is impacting our cluster performance. Customer-facing services are not affected at this time. We are waiting on Elastic Cloud to confirm recovery

  • Identified
    UTC
    Identified

    Root cause identified: an active Microsoft Azure incident is impacting upstream dependencies for our services. We are assessing scope and affected components.

  • Investigating
    UTC
    Investigating

    We are investigating reports of degraded service. Upstream provider (Microsoft Azure) is reporting an active incident, and we are assessing impact on our services.