sevanalysis

Harness

Apps and SaaS. Source: Harness status page.

Incidents, last 90 days
41
Median to mitigation
1h 21m
Median to resolution
2h 53m
p95 to resolution
44h 54m
Naming an upstream provider
4%
With a postmortem on the status page
82%

What failed, last 90 days

The text does not say enough to tell8
Login, tokens, certificates or credentials failed8
Exhausted memory, disk, CPU, queues, connection pools or quotas8
A code release introduced the failure7
A provider or third-party service this vendor depends on failed3
Network, DNS, routing or connectivity failure3
Traffic surge or denial-of-service attack1
A configuration change caused the failure1
CDN or edge layer failed or served bad content1
Data delayed, stale, lost or corrupted, or needing replay after recovery1

Tagged by deepseek/deepseek-v4.1-flash from each incident's updates. See the methodology.

Incidents per month

All recorded incidents

Degraded performance on prod4 minor 2026-10-19 07:46 UTC 35m

Affected: Continuous Delivery - Next Generation (CDNG), Continuous Integration Enterprise(CIE) - Self Hosted Runners, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Security Testing Orchestration (STO), Infrastructure as Code Management (IaCM), Platform

Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. monitoring

    A fix has been implemented and we are monitoring the results.

  3. identified

    The issue has been identified and a fix is being implemented.

  4. monitoring

    A fix has been implemented and we are monitoring the results.

  5. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Degraded performance in UI execution graph in prod3 minor 2026-10-15 10:10 UTC 17m

Affected: Continuous Delivery - Next Generation (CDNG)

Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by deepseek/deepseek-v4.1-flash with low confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Degraded performance in UI execution graph in prod3 minor 2026-10-15 08:04 UTC 12m

Affected: Continuous Delivery - Next Generation (CDNG)

Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by deepseek/deepseek-v4.1-flash with low confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod1: Intermittent issue with IACM stages in some pipelines minor 2026-10-13 01:06 UTC 3h 23m

Affected: Infrastructure as Code Management (IaCM)

Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by deepseek/deepseek-v4.1-flash with low confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Harness CI Cloud build issues when accessing Maven Central minor 2026-10-12 15:25 UTC 1h 6m

Affected: Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds

Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently experiencing HTTP 429 (rate-limiting) errors when Harness Cloud builds access Maven Central, which may impact build execution. Our team is actively working with Sonatype to resolve the issue as quickly as possible. We will provide further updates as we make...

  2. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod1: IACM Stages are failing and pipelines are intermittently failing to start. major 2026-10-06 21:46 UTC 58m

Affected: Infrastructure as Code Management (IaCM)

Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by deepseek/deepseek-v4.1-flash with low confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. investigating

    We are continuing to investigate this issue.

  3. identified

    The issue has been identified and a fix is being implemented.

  4. monitoring

    A fix has been implemented and we are monitoring the results.

  5. monitoring

    A fix has been implemented and we are monitoring the results. we have confirmation of this fixing the issue.

  6. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Intermittent failures in Policy step evaluations on Prod 7 minor 2026-10-06 20:00 UTC 0m

Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by deepseek/deepseek-v4.1-flash with low confidence (taxonomy v0.3).

  1. resolved

    On October 7, 2026, from 08:00 UTC to 11:00 UTC (1:30 PM to 4:30 PM IST), some pipeline executions on the Prod 7 cluster saw intermittent failures in Policy (OPA) step evaluations.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod2 Pipelines with verify step failing intermittently none 2026-10-06 12:54 UTC 2h 41m

Affected: Continuous Delivery - Next Generation (CDNG)

Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. monitoring

    A fix has been implemented and we are monitoring the results.

  2. resolved

    This incident has been resolved.

  3. postmortem

    ### Summary Customers on Prod 2 experienced intermittent failures of a few Verify steps at startup. Affected steps failed shortly after launch with a message indicating Continuous Verification\(CV\) could not reach an internal Harness service. The issue stemmed from a recent...

Excerpts are shortened. Read the full incident on Harness's status page.

Single Customer: IaCM pipeline executions failing intermittently in Prod 1 minor 2026-10-06 11:58 UTC 4h 22m

Affected: Infrastructure as Code Management (IaCM)

Failure mode: Login, tokens, certificates or credentials failed. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. investigating

    We are continuing to investigate this issue.

  3. identified

    The issue has been identified and a fix is being implemented.

  4. resolved

    This incident has been resolved.

  5. postmortem

    ## Summary On **Tuesday, 6 October 2026**, IaCM pipelines that use the **OpenTofu plugin** in **Prod1** failed intermittently for a production accountAffected runs injected secrets successfully, then later steps timed out or failed authentication. The same pipeline often...

Excerpts are shortened. Read the full incident on Harness's status page.

Hosted MCP Logins W/ SSO Failing minor 2026-10-05 22:01 UTC 2h 38m

Affected: Platform, Platform, Platform, Platform, Platform

Failure mode: Login, tokens, certificates or credentials failed. Root cause: A failure at a provider or vendor they depend on. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. monitoring

    We are continuing to monitor for any further issues.

  5. resolved

    Verified the fix and resolved SSO issues.

  6. postmortem

    ## Okta Application SP-Initiated SSO Login Failures ‌ # Summary ‌ Between October 5, 2026, 18:18 UTC and October 6, 2026, 00:26 UTC, some Harness customers were unable to sign in to the Harness Hosted MCP server via SAML Single Sign-On \(SSO\). The main Harness Portal user...

Excerpts are shortened. Read the full incident on Harness's status page.

SSO login failures for the published Harness Okta application none 2026-09-29 20:31 UTC 2d 4h

Affected: Platform, Platform

Failure mode: Login, tokens, certificates or credentials failed. Root cause: A failure at a provider or vendor they depend on. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. identified

    We identified an issue that applies only to SP-initiated login through the published Harness Okta application. After a recent update to that application, those login attempts returned an HTTP 400 error when the configured SSO URL was missing from Additional ACS URLs. General...

  4. identified

    We identified an issue that applies only to SP-initiated login through the published Harness Okta application. After a recent update to that application, those login attempts returned an HTTP 400 error when the configured SSO URL was missing from Additional ACS URLs. General...

  5. resolved

    This incident has been resolved.

  6. postmortem

    # 1. Summary Starting September 29, 2026, customers who sign in to Harness through the published Harness application in the Okta Integration Network \(OIN\) were unable to complete SP-initiated SSO login. Affected users received an HTTP 400 error from Okta instead of being...

Excerpts are shortened. Read the full incident on Harness's status page.

CI Linux Cloud VM Networking issues - intermittent minor 2026-09-29 18:45 UTC 3h 16m

Affected: Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds

Failure mode: Network, DNS, routing or connectivity failure. Root cause: Not enough capacity for the load. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. monitoring

    A fix has been implemented and we are monitoring the results.

  3. resolved

    This incident has been resolved.

  4. postmortem

    ### Summary Between approximately **11:37 AM and 3:01 PM PDT \(18:37–22:01 UTC\) on September 29, 2026**, customers using Harness CI self-hosted Linux cloud runners in **prod1/prod2 \(us-west1\)** experienced intermittent networking failures during pipeline execution — primarily...

Excerpts are shortened. Read the full incident on Harness's status page.

Prod2: CV is failing with errors for all customers minor 2026-09-29 14:41 UTC 4h 8m

Affected: Continuous Delivery - Next Generation (CDNG)

Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: Not enough capacity for the load. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. monitoring

    A fix has been implemented and we are monitoring the results.

  3. monitoring

    We are continuing to monitor for any further issues.

  4. resolved

    This incident has been resolved.

  5. postmortem

    **Summary** Customers on Prod-2 experienced elevated failure rates in Continuous Verification pipelines. Verification jobs failed to complete or reported errors because CV data-collection workers could not communicate with the platform service that coordinates their work. This...

Excerpts are shortened. Read the full incident on Harness's status page.

File Store Expression Degraded : Returning Null minor 2026-09-28 06:00 UTC 5h 30m

Failure mode: Login, tokens, certificates or credentials failed. Root cause: A configuration change. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. resolved

    On 28th September 2026, we observed an issue with copying files from the Harness Filestore during the export step, where the files were being copied as null/empty files. As a result, all pipelines using Filestore APIs were blocked during the incident window. The issue was caused...

  2. postmortem

    ### Summary On September 28, 2026, some customers on Prod-2 experienced failures in CD pipeline steps that read File Store content using pipeline expressions \(e.g., ` `\). Affected expressions returned null instead of the expected file content, causing dependent steps to fail...

Excerpts are shortened. Read the full incident on Harness's status page.

Palo Alto Networks Firewall Blocking Harness Connections none 2026-09-23 20:17 UTC 44h 54m

Affected: Platform, Platform, Platform, Platform, Platform, Platform, Platform, Platform, Platform

Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating connectivity issues affecting customers whose environments are protected by Palo Alto Networks firewalls. These firewalls are blocking connections to Harness APIs, which may result in: - Failed pipeline executions - Inability to deploy applications...

  2. monitoring

    Mitigation Available: Harness Traffic Blocked by Network Security Policy We have identified an issue where some customers may be unable to access Harness because Harness traffic is being categorized as “AI-Platform” by Palo Alto network security controls and subsequently blocked...

  3. resolved

    After consultation with Palo Alto Networks, we can confirm that on Sept 23rd 2026, app.harness.io was categorized as an AI Platform Service by the Palo Alto Networks Team. Palo Alto Networks sent a notice to customers in August about the reclassification. This change may place...

  4. postmortem

    .

Excerpts are shortened. Read the full incident on Harness's status page.

Investigating CI Pipeline Delays minor 2026-09-22 16:40 UTC 1h 58m

Affected: Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds

Failure mode: Network, DNS, routing or connectivity failure. Root cause: Not enough capacity for the load. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

  5. postmortem

    # Summary On September 22, 2026, three of our outbound network gateways in one region became unhealthy and began rejecting a small percentage of new outbound connection attempts. The issue was resolved the same day problem completely with no further recurrence or follow-on...

Excerpts are shortened. Read the full incident on Harness's status page.

Dashboard export and download APIs are currently facing issue. minor 2026-09-22 14:00 UTC 19m

Affected: Custom Dashboards, Custom Dashboards

Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by deepseek/deepseek-v4.1-flash with low confidence (taxonomy v0.3).

  1. identified

    The issue has been identified and a fix is being implemented.

  2. monitoring

    A fix has been implemented and we are monitoring the results.

  3. resolved

    This incident has been resolved.

  4. postmortem

    Same as the previous root cause.

Excerpts are shortened. Read the full incident on Harness's status page.

Dashboard aggregator experiencing timeouts across prod2 since 15:04 UTC (Sept 21) minor 2026-09-21 16:39 UTC 1h 54m

Affected: Custom Dashboards

Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

  5. postmortem

    ## Summary On Sep 21, 2026, customers in Prod 2 experienced degraded and then largely unavailable deployment dashboards for approximately three hours. The issue was caused by a set of analytics queries behind those dashboards reading far more data than they needed, which...

Excerpts are shortened. Read the full incident on Harness's status page.

Prod1: Single Customer Issue : OPA evaluations are failing for a specific workspace minor 2026-09-18 14:30 UTC 14h 28m

Affected: Infrastructure as Code Management (IaCM)

Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by deepseek/deepseek-v4.1-flash with low confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. investigating

    We are continuing to investigate this issue.

  3. identified

    The issue has been identified and a fix is being implemented.

  4. monitoring

    A fix has been implemented and we are monitoring the results.

  5. monitoring

    We are continuing to monitor for any further issues.

  6. resolved

    This incident has been resolved.

  7. postmortem

    This was a customer specific issue.

Excerpts are shortened. Read the full incident on Harness's status page.

Dashboard export and download APIs are currently facing issue. minor 2026-09-17 17:03 UTC 3d 16h

Affected: Custom Dashboards, Custom Dashboards

Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. monitoring

    A fix has been implemented and we are monitoring the results.

  3. resolved

    This incident has been resolved.

  4. postmortem

    # 1. Summary Starting on September 19, 2026, some customers began experiencing failures when downloading or exporting dashboards to CSV through our API, which returned an HTTP 500 \(internal server error\). Standard dashboard viewing, API authentication, and downloads initiated...

Excerpts are shortened. Read the full incident on Harness's status page.

DBDevOps Builds Failing intermittently minor 2026-09-17 14:00 UTC 31h 30m

Affected: DBDevOps, DBDevOps

Failure mode: Login, tokens, certificates or credentials failed. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. investigating

    We are continuing to investigate this issue.

  3. identified

    The issue has been identified and a fix is being implemented.

  4. monitoring

    A fix has been implemented and we are monitoring the results.

  5. monitoring

    A fix has been implemented and we are monitoring the results.

  6. resolved

    This incident has been resolved.

  7. postmortem

    ## Summary Between approximately **8:40 AM and 1:00 PM PDT on Wednesday, September 17, 2026**, some customers running **Database DevOps** pipelines in Production experienced intermittent failures when executing schema migration steps \(for example Apply Schema and related...

Excerpts are shortened. Read the full incident on Harness's status page.

IACM Module Registry timeouts minor 2026-09-16 04:13 UTC 12h 32m

Affected: Infrastructure as Code Management (IaCM), Infrastructure as Code Management (IaCM)

Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: Not enough capacity for the load. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. monitoring

    Fix has been implemented in Prod Eu 1 and we are monitoring for any further issues.

  5. monitoring

    Fix has been implemented in Prod 1 and we are monitoring for any further issues.

  6. resolved

    This incident has been resolved.

  7. postmortem

    # Root Cause Analysis Report ## IaCM Module Registry Timeouts ## 1. Summary On Monday, September 15, 2026, some customers using Infrastructure as Code Management \(IaCM\) Module Registry on Prod EU1, and later Prod1, experienced timeouts and failed requests. ‌ Affected customers...

Excerpts are shortened. Read the full incident on Harness's status page.

API Login failures critical 2026-09-15 17:22 UTC 21m

Affected: Platform, Platform, Platform, Platform

Failure mode: Login, tokens, certificates or credentials failed. Root cause: A configuration change. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

  5. postmortem

    # Root Cause Analysis Report ## Brief API Login Failures Due to a Security Policy Misconfiguration ## 1. Executive Summary On September 11, 2026, a change to one of our network security policies was deployed with a configuration error. For approximately 6 minutes, this caused...

Excerpts are shortened. Read the full incident on Harness's status page.

IACM Module Registry performance degradation minor 2026-09-15 12:05 UTC 2h 53m

Affected: Infrastructure as Code Management (IaCM)

Failure mode: Traffic surge or denial-of-service attack. Root cause: Not enough capacity for the load. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. monitoring

    We are continuing to monitor for any further issues.

  5. resolved

    This incident has been resolved.

  6. postmortem

    ## 1. Summary On Monday, September 15, 2026, some customers using Infrastructure as Code Management \(IaCM\) Module Registry on Prod EU1, and later Prod1, experienced timeouts and failed requests. ‌ Affected customers saw Module Registry operations hang or fail in the UI, and...

Excerpts are shortened. Read the full incident on Harness's status page.

MTLS Outage with Delegates critical 2026-09-14 19:00 UTC 8h 28m

Affected: Continuous Delivery - Next Generation (CDNG), Continuous Delivery - Next Generation (CDNG), Continuous Delivery - Next Generation (CDNG)

Failure mode: Login, tokens, certificates or credentials failed. Root cause: A configuration change. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. identified

    We are continuing to work on a fix for this issue.

  4. monitoring

    A fix has been implemented and we are monitoring the results.

  5. resolved

    This incident has been resolved.

  6. postmortem

    # **Summary** To improve the security posture, On September 14, 2026, Harness performed a scheduled rotation of the TLS certificate used to secure Delegate connections for accounts using mutual TLS \(mTLS\),The replacement certificate passed Harness's existing pre-deployment...

Excerpts are shortened. Read the full incident on Harness's status page.

Slowness in Prod1 and Prod2 environment minor 2026-09-08 21:52 UTC 6h 38m

Affected: Continuous Delivery (CD) - FirstGen - EOS, Continuous Delivery (CD) - FirstGen - EOS, Continuous Delivery - Next Generation (CDNG), Continuous Delivery - Next Generation (CDNG), Cloud Cost Management (CCM), Cloud Cost Management (CCM), Continuous Error Tracking (CET), Continuous Error Tracking (CET), Chaos Engineering, Chaos Engineering, Continuous Integration Enterprise(CIE) - Self Hosted Runners, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Custom Dashboards, Feature Flags (FF), Feature Flags (FF), Security Testing Orchestration (STO), Service Reliability Management (SRM), Internal Developer Portal (IDP), Infrastructure as Code Management (IaCM), Software Supply Chain Assurance (SSCA), Software Engineering Insights (SEI) / AI DLC Insights, Code Repository, Artifact Registry, Platform, AI Test Automation, FME, FME

Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. investigating

    We are continuing to investigate this issue.

  3. investigating

    We are continuing to investigate the issue.

  4. investigating

    We are continuing to investigate this issue.

  5. identified

    The issue has been identified and a fix is being implemented.

  6. identified

    We are continuing to work on a fix for this issue.

  7. monitoring

    A fix has been implemented and we are monitoring the results.

  8. monitoring

    A fix has been implemented and we are monitoring the results.

  9. resolved

    This incident has been resolved.

  10. postmortem

    ### Summary On September 8, 2026, customers in Prod 1 and Prod 2 experienced elevated platform latency and pipeline failures. The issue was caused by a regression in a newly released capability that triggered cascading failures under high load. Because the capability was behind...

Excerpts are shortened. Read the full incident on Harness's status page.

Prod2 was intermittently unavailable none 2026-09-05 09:40 UTC 1m

Affected: Platform

Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with medium confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. resolved

    This incident has been resolved.

  3. postmortem

    ## **Summary** Between 12:34am PST and 12:38am PST on 5th September, the Delegate service manager experienced some elevated exceptions when attempting to write to the database. Consequently, delegate connections were dropped, causing them to disconnect. Delegate automatically...

Excerpts are shortened. Read the full incident on Harness's status page.

Pipelines are stuck in Prod1 minor 2026-09-03 10:00 UTC 1h 40m

Affected: Continuous Delivery - Next Generation (CDNG)

Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: A human mistake during operations. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    Pipeline execution is stuck in Prod1. We are investigating the issue.

  2. monitoring

    A fix has been implemented and we are monitoring the results.

  3. resolved

    This incident has been resolved.

  4. postmortem

    # Summary On September 3, 2026, between approximately 2:54 AM and 3:44 AM PDT, customers running pipelines on Prod1 experienced delays in pipeline execution graph rendering and execution status updates. Pipeline execution itself was not affected — pipelines continued to run and...

Excerpts are shortened. Read the full incident on Harness's status page.

Entities in Harness are not loading on in Prod3 minor 2026-08-28 07:04 UTC 32m

Affected: Platform

Failure mode: A configuration change caused the failure. Root cause: A configuration change. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

  5. postmortem

    ## Summary Between August 27 and August 28, 2026, customers experienced an issue where some pipelines, deployments, and related resources appeared as not found in the Harness UI and API, even though the underlying data remained intact. ‌ The issue occurred during a planned...

Excerpts are shortened. Read the full incident on Harness's status page.

Pipelines are failing for harness IACM customers minor 2026-08-26 08:38 UTC 32m

Affected: Infrastructure as Code Management (IaCM), Infrastructure as Code Management (IaCM), Infrastructure as Code Management (IaCM), Infrastructure as Code Management (IaCM)

Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating an issue reported in IACM pipelines in Prod-1 , Prod-2 ,Prod-4 and EU1 harness clusters.

  2. investigating

    We are continuing to investigate this issue.

  3. monitoring

    We have reverted the change that caused this issue in all clusters.

  4. resolved

    This incident has been resolved.

  5. postmortem

    # Root Cause Analysis Report # 1. Summary On Wednesday, August 26, 2026, some customers running Infrastructure as Code Management \(IaCM\) pipelines in Harness production saw those pipelines start, sit in a Running state with no init or plan steps, then abort or expire after...

Excerpts are shortened. Read the full incident on Harness's status page.

Feature Management & Experimentation (FME) user interface unavailable major 2026-08-24 00:57 UTC 16m

Affected: FME

Failure mode: CDN or edge layer failed or served bad content. Root cause: A configuration change. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. investigating

    We are currently investigating reports that the Feature Management & Experimentation (FME) user interface is failing to load. Customers attempting to access the FME console may encounter errors or unresponsive pages. Feature flag evaluation and SDK traffic are not believed to be...

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

  5. postmortem

    ## Summary * Starting at **23:42 UTC** on August 23, 2026, several FME customers reported failures loading the FME UI. * FME UI Artifacts served from the CDN expired due to a retention policy, causing FME UI to fail to load. * Any flag request changes through the API, change...

Excerpts are shortened. Read the full incident on Harness's status page.

All modules are running slow in Prod1/2/3/4 due to cloud provider incident major 2026-08-20 15:37 UTC 3h 46m

Affected: Platform, Platform, Platform, Platform

Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

Names an upstream provider: Google Cloud.

Started during Google Cloud: We are investigating an issue where customers may experience timeouts, service degradations, errors, and elevated latencies across multiple products in the us-west1 region..

  1. investigating

    We are currently investigating this issue.

  2. investigating

    The slowness could cause either of below symptoms: - Pipelines not starting - Delays in execution - Pipelines being cancelled due to timeouts

  3. investigating

    Our cloud provider is facing an active incident and we are following up.

  4. investigating

    We are continuing to investigate this issue.

  5. identified

    Our cloud provider has confirmed an ongoing incident impacting multiple regions. Harness pipelines have not experienced failures as a result, though some users may continue to experience slowness. We are monitoring the situation closely and will provide updates as more...

  6. monitoring

    We are observing improved latencies across the board following the fix implemented by our cloud provider. We are continuing to monitor the situation closely and will provide further updates as warranted. We noted some stuck executions for CI for couple of customers, which we are...

  7. resolved

    This incident has been resolved.

  8. postmortem

    # Summary On 20 August 2026, beginning at approximately 15:00 UTC, the Harness platform experienced widespread performance degradation across all production environments. Pipeline executions that normally complete in around two minutes took seven to ten minutes. Continuous...

Excerpts are shortened. Read the full incident on Harness's status page.

FME API write operations started returning 499 errors minor 2026-08-20 14:32 UTC 30m

Affected: FME

Failure mode: Login, tokens, certificates or credentials failed. Root cause: A configuration change. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

  5. postmortem

    ### Summary On August 20, 2026, between 10:24 and 14:55 UTC, a subset of FME writes failed. Writes made from the FME UI and writes made with Harness access tokens \(PATs and SATs\) were not affected. Runtime flag evaluation continued to work normally. The issue was mitigated by...

Excerpts are shortened. Read the full incident on Harness's status page.

Data ingestion is delayed on Traceable US production major 2026-08-19 13:22 UTC 2h 44m

Affected: US - app.traceable.ai / api.traceable.ai

Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: A configuration change. Tagged by deepseek/deepseek-v4.1-flash with medium confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. investigating

    We are continuing to investigate this issue.

  3. investigating

    We are continuing to investigate this issue.

  4. identified

    The issue has been identified and a fix is being implemented.

  5. monitoring

    A fix has been implemented and we are monitoring the results.

  6. monitoring

    We are continuing to monitor for any further issues.

  7. resolved

    This incident has been resolved.

  8. postmortem

    **Summary** On 19 August 2026 between 12:35 and 17:29 UTC, the Harness Application Security service experienced a significant disruption affecting both the customer-facing console and the data ingestion pipeline in the SaaS Production and US1 regions. ‌ **Root Cause** The...

Excerpts are shortened. Read the full incident on Harness's status page.

SEI 2.0 dashboards are not loading major 2026-08-06 14:30 UTC 1h 31m

Affected: Software Engineering Insights (SEI) / AI DLC Insights, Software Engineering Insights (SEI) /AI DLC Insights, Software Engineering Insights (SEI) / AI DLC Insights, Software Engineering Insights (SEI) / AI DLC Insights, Software Engineering Insights (SEI) /AI DLC Insights

Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: Not enough capacity for the load. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating a Harness component that is experiencing issues. We are working to identify the cause and restore normal operations as soon as possible.

  2. investigating

    We are continuing to investigate this issue.

  3. identified

    The issue has been identified and a fix is being implemented.

  4. resolved

    This incident has been resolved.

  5. postmortem

    ## Summary Customers on Prod1, Prod2, and Prod3 \(US\) clusters experienced failures when loading SEI 2.0 dashboards on August 6, 2026, from 7:22 AM PDT to 9:03 AM PDT. Customers calling the SEI 2.0 API also experienced similar failures. No customer data was lost, and ingestion...

Excerpts are shortened. Read the full incident on Harness's status page.

Monitoring - Pipelines Stuck - Prod2 minor 2026-08-06 13:50 UTC 4h 31m

Affected: Continuous Delivery - Next Generation (CDNG)

Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. monitoring

    We are monitoring the stuck pipelines in prod2. The new executions are passing as we are continuously monitoring the services.

  2. monitoring

    We are monitoring the stuck pipelines in prod2. For the customers who are still seeing stuck pipelines, we request you to abort and re-trigger.

  3. resolved

    This incident has been resolved.

  4. postmortem

    ## **Summary** On August 6, 2026 \(morning PDT\), some customers running pipelines in the Prod2 production environment observed pipeline executions that stopped making progress — stages that did not advance and produced no further output or status updates. The issue was reported...

Excerpts are shortened. Read the full incident on Harness's status page.

Editing 'Variable Sets' in the IaCM module is experiencing issue minor 2026-08-04 12:07 UTC 3h 21m

Affected: Infrastructure as Code Management (IaCM), Infrastructure as Code Management (IaCM), Infrastructure as Code Management (IaCM), Infrastructure as Code Management (IaCM)

Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. investigating

    We are continuing to investigate this issue.

  3. investigating

    We are continuing to investigate this issue.

  4. investigating

    We have identified the issue and started to implement the fix , prod2 is restored.

  5. investigating

    We are continuously rolling out fixes to all Clusters, Prod EU1 has been resolved.

  6. investigating

    We are continuously rolling out fixes to all Clusters, Prod3 has been resolved.

  7. resolved

    This incident has been resolved.

  8. postmortem

    # Executive Summary On August 4, 2026, between approximately 3:36 PM and 9:00 PM IST, customers using Infrastructure as Code Management \(IaCM\) on Prod0 and Prod1 were unable to access the Variable Sets settings page. The page rendered blank with no error message, and customers...

Excerpts are shortened. Read the full incident on Harness's status page.

UI dashboards are lagging behind (CI) none 2026-07-31 20:22 UTC 12h 48m

Affected: Continuous Integration Enterprise(CIE) - Self Hosted Runners, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Self Hosted Runners, Continuous Integration Enterprise(CIE) - Self Hosted Runners, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds

Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: Not enough capacity for the load. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

  5. postmortem

    # **Summary** Between 25 July and 4 August 2026, pipeline execution dashboards and overview pages in the Harness Prod 2 and Prod 3 clusters displayed data that was between behind real time. Pipelines themselves continued to build, deploy, and execute normally throughout; the...

Excerpts are shortened. Read the full incident on Harness's status page.

Harness Artifact Registry upload is failing from pipeline - EU1 region minor 2026-07-31 13:48 UTC 34h 1m

Affected: Artifact Registry

Failure mode: A code release introduced the failure. Root cause: A human mistake during operations. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

  5. postmortem

    # **Summary** On July 31, 2026, artifact uploads performed through pipeline in the EU1 cluster began failing with an authentication error. Uploads initiated manually \(outside of a pipeline\) were not affected, and the ability to retrieve existing artifacts \(downloads\) was...

Excerpts are shortened. Read the full incident on Harness's status page.

Intermittent External Network Connectivity Issues Affecting Build VMs minor 2026-07-30 05:59 UTC 21h 24m

Affected: Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds

Failure mode: Network, DNS, routing or connectivity failure. Root cause: Not enough capacity for the load. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

Names an upstream provider: GitHub.

  1. investigating

    Summary - We are intermittently facing network connectivity issues with our Build VM's unable to connect to external resources. We are currently investigating the issue.

  2. monitoring

    A fix has been implemented and we are monitoring the results.

  3. monitoring

    We are continuing to monitor for any further issues.

  4. resolved

    This incident has been resolved.

  5. postmortem

    ## Summary CI runners in the us-west1 and us-central1 regions intermittently experienced connection timeouts of approximately 134 seconds when reaching external services such as GitHub and Bitbucket over outbound network gateways. ## Impact * CI runners in the affected regions...

Excerpts are shortened. Read the full incident on Harness's status page.

The Prod3 & Prod1 environment is experiencing intermittent outages. We are currently investigating the issue. major 2026-07-27 06:42 UTC 6h 51m

Affected: Continuous Delivery (CD) - FirstGen - EOS, Continuous Delivery (CD) - FirstGen - EOS, Continuous Delivery - Next Generation (CDNG), Continuous Delivery - Next Generation (CDNG), Cloud Cost Management (CCM), Cloud Cost Management (CCM), Continuous Error Tracking (CET), Continuous Error Tracking (CET), Chaos Engineering, Continuous Integration Enterprise(CIE) - Self Hosted Runners, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Self Hosted Runners, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Custom Dashboards, Continuous Integration Enterprise(CIE) - Linux Cloud Builds, Feature Flags (FF), Custom Dashboards, Feature Flags (FF), Security Testing Orchestration (STO), Security Testing Orchestration (STO), Service Reliability Management (SRM), Service Reliability Management (SRM), Chaos Engineering, Internal Developer Portal (IDP), Internal Developer Portal (IDP), Infrastructure as Code Management (IaCM), Infrastructure as Code Management (IaCM), Software Supply Chain Assurance (SSCA), Software Supply Chain Assurance (SSCA), Software Engineering Insights (SEI) /AI DLC Insights, Software Engineering Insights (SEI) / AI DLC Insights, Code Repository, Code Repository, Artifact Registry, Artifact Registry, Platform, Platform, AI Test Automation, FME, Release Management

Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. investigating

    We are currently investigating this issue.

  5. investigating

    We are continuing to investigate this issue.

  6. identified

    The issue has been identified and a fix is being implemented.

  7. identified

    We are continuing to work on a fix for this issue.

  8. monitoring

    A fix has been implemented and we are monitoring the results.

  9. monitoring

    We are continuing to monitor for any further issues.

  10. monitoring

    We are continuing to monitor for any further issues.

  11. resolved

    This incident has been resolved.

  12. postmortem

    # Summary During a recent production deployment, a defect in our internal deployment tooling caused two critical services to run with incorrect, non-production configuration values in our production environment This led to a related set of four distinct symptoms: incorrect...

Excerpts are shortened. Read the full incident on Harness's status page.

AIDI Dashboards – Degraded Performance minor 2026-07-22 14:55 UTC 8h 22m

Affected: Software Engineering Insights (SEI) /AI DLC Insights, Software Engineering Insights (SEI) / AI DLC Insights, Software Engineering Insights (SEI) / AI DLC Insights

Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: Not enough capacity for the load. Tagged by deepseek/deepseek-v4.1-flash with medium confidence (taxonomy v0.3).

  1. investigating

    We are investigating an issue impacting AIDI dashboards. Users may experience increased load times or intermittent failures when accessing dashboards. Our team is actively working to identify the root cause and restore normal performance. We will provide updates as more...

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

  5. postmortem

    ## Summary Customers on Prod1, Prod2, and Prod3 clusters experienced intermittent widget load failures and increased load times when accessing AIDI 2.0 dashboards on July 22, 2026. Not all widgets were affected simultaneously the issue manifested as sporadic failures rather than...

Excerpts are shortened. Read the full incident on Harness's status page.

Degraded CI performance minor 2026-07-17 17:16 UTC 4h 40m

Affected: Continuous Integration Enterprise(CIE) - Self Hosted Runners, Continuous Integration Enterprise(CIE) - Mac Cloud Builds, Continuous Integration Enterprise(CIE) - Windows Cloud Builds, Continuous Integration Enterprise(CIE) - Linux Cloud Builds

Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. resolved

    This incident has been resolved.

  5. postmortem

    # Summary On 17 July 2026, following a routine code deployment, customers on older delegate versions \(858xx and below\) began experiencing delayed CI builds on Harness Cloud-hosted builds using our global build-queueing capability. Affected builds experienced an unexpected...

Excerpts are shortened. Read the full incident on Harness's status page.

CI git clone calls are failing for specific arm builds minor 2026-07-17 10:30 UTC 3h 46m

Affected: Continuous Integration Enterprise(CIE) - Self Hosted Runners

Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. identified

    The issue has been identified and a fix is being implemented.

  3. monitoring

    A fix has been implemented and we are monitoring the results.

  4. monitoring

    We are continuing to monitor for any further issues.

  5. resolved

    This incident has been resolved.

  6. postmortem

    # Summary Between June 19 and July 17, 2026, the built-in Git Clone step — and any pipeline step using the drone-git clone plugin — failed on ARM64 Kubernetes build infrastructure with the error exec /usr/local/bin/clone: exec format error. AMD64 \(Intel/AMD\) builds, Windows...

Excerpts are shortened. Read the full incident on Harness's status page.

Code services are degraded, git clone is failing minor 2026-07-16 06:40 UTC 21m

Affected: Code Repository

Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. resolved

    This incident has been resolved.

  3. postmortem

    # Summary Between June 19 and July 17, 2026, the built-in Git Clone step — and any pipeline step using the drone-git clone plugin — failed on ARM64 Kubernetes build infrastructure with the error exec /usr/local/bin/clone: exec format error. AMD64 \(Intel/AMD\) builds, Windows...

Excerpts are shortened. Read the full incident on Harness's status page.

Certain users are unable to see feature flags in prod1 and prod2 minor 2026-07-14 11:25 UTC 32m

Affected: Feature Flags (FF), Feature Flags (FF)

Failure mode: Login, tokens, certificates or credentials failed. Root cause: A configuration change. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    Certain users are unable to see feature flags in prod1 and prod2

  2. monitoring

    A fix has been implemented and we are monitoring the results.

  3. resolved

    This incident has been resolved.

  4. postmortem

    ## Summary On July 14, 2026, certain Harness Feature Flag \(FF\) Classic customers on the Prod1 and Prod2 production environments were unable to view Feature Flags in the Harness platform. Affected requests returned an authorization error \(HTTP 403\), so Feature Flags were not...

Excerpts are shortened. Read the full incident on Harness's status page.

Few customers experiencing intermittent errors during pipeline execution. minor 2026-07-09 20:21 UTC 1h 25m

Affected: Continuous Delivery (CD) - FirstGen - EOS, Continuous Integration Enterprise(CIE) - Linux Cloud Builds

Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating this issue.

  2. monitoring

    A fix has been implemented and we are monitoring the results.

  3. resolved

    This incident has been resolved.

  4. postmortem

    # Summary On July 9, 2026, some customers in the Harness Prod3 cluster experienced pipeline failures over a ~2.5-hour window, despite making no changes in their pipelines. Shell Script steps failed when fetching scripts from the Harness File Store, and Kubernetes deployment...

Excerpts are shortened. Read the full incident on Harness's status page.

Prod3: Slowness in Harness Platform minor 2026-07-08 07:49 UTC 11h 7m

Affected: Continuous Delivery - Next Generation (CDNG)

Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating an issue in Prod3 cluster where Harness platform components are loading slower than expected.

  2. monitoring

    A fix has been implemented and we are monitoring the results.

  3. investigating

    We are currently investigating this issue.

  4. monitoring

    A fix has been implemented and we are monitoring the results.

  5. resolved

    This incident has been resolved.

  6. postmortem

    ## Summary Between July 7 and July 8, 2026, customer accounts hosted in our Prod 3 environment experienced intermittent slowness and failures when loading pipelines and resolving templates. The underlying cause was a sharp, sustained increase in internal feature-flag lookup...

Excerpts are shortened. Read the full incident on Harness's status page.

Prod3: Slowness in loading pipeline components minor 2026-07-07 10:22 UTC 2h 15m

Affected: Continuous Delivery - Next Generation (CDNG)

Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: A bug in the vendor's own code. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. investigating

    We are currently investigating an issue in Prod3 cluster where pipeline components are loading slower than expected.

  2. monitoring

    A fix has been implemented in one of our microservice responsible for dealing with pipeline templates which has resolved the issue. We are continuing to monitor the issue.

  3. resolved

    This incident has been resolved.

  4. postmortem

    ## Summary Between July 7 and July 8, 2026, customer accounts hosted in our Prod 3 environment experienced intermittent slowness and failures when loading pipelines and resolving templates. The underlying cause was a sharp, sustained increase in internal feature-flag lookup...

Excerpts are shortened. Read the full incident on Harness's status page.

FME - Some customers are experiencing delays in scheduled exports of impressions minor 2026-07-02 15:48 UTC 24h 23m

Affected: FME, FME, FME

Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by deepseek/deepseek-v4.1-flash with high confidence (taxonomy v0.3).

  1. monitoring

    A fix has been implemented and we are monitoring the results.

  2. monitoring

    We are seeing the backlogged items worked through and continuing to monitor results.

  3. monitoring

    We are continuing to monitor results while the backlog is worked through.

  4. resolved

    This incident has been resolved.

  5. postmortem

    **Incident Summary** Harness FME \(Feature Management & Experimentation\) faced substantial delays in scheduled impressions data exports on Jul 2, 2026. This issue stemmed from performance degradation within Tinybird's infrastructure, affecting query execution crucial to our...

Excerpts are shortened. Read the full incident on Harness's status page.

Few pipelines in prod4 are running with degraded performance major 2026-06-29 14:56 UTC 45m

Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by deepseek/deepseek-v4.1-flash with low confidence (taxonomy v0.3).

  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Login to Traceable Clusters Impacted minor 2026-06-26 07:20 UTC 11m

Failure mode: Login, tokens, certificates or credentials failed. Root cause: The vendor does not say why it happened. Tagged by deepseek/deepseek-v4.1-flash with low confidence (taxonomy v0.3).

  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Harness Login Failure in EU1 environment major 2026-06-24 12:03 UTC 2h 34m

Failure mode: Login, tokens, certificates or credentials failed. Root cause: The vendor does not say why it happened. Tagged by deepseek/deepseek-v4.1-flash with low confidence (taxonomy v0.3).

  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

IDP Workflows and Backend failures minor 2026-06-17 16:44 UTC 1h 6m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Cloud builds are failing with 429 Too Many Requests error while downloading artifacts from central sonatype registry. minor 2026-06-17 13:42 UTC 3h 31m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Certain customers may see odd web artifacts on Code UI. Logging out and Logging in resolves this issue. minor 2026-06-08 17:32 UTC 2h 18m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Intermittent 503s on IDP services minor 2026-06-05 22:56 UTC 1h 34m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

FME SDKs - SDKs falling back to polling minor 2026-06-04 14:33 UTC 2h 5m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Hosted CI Builds Failing Intermittently minor 2026-06-01 10:01 UTC 3h 46m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Pipeline logging streams experiencing degraded delivery to console. minor 2026-05-27 14:20 UTC 9h
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Hosted CI Builds Failing Intermittently major 2026-05-27 12:35 UTC 13h 13m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod3 pipeline execution UI slowness minor 2026-05-21 13:55 UTC 2h 39m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod3 Pipeline UI Updates on execution graph slowness minor 2026-05-20 10:48 UTC 1h 50m
  1. resolved

    This incident has been resolved. The incident was identified as a slowness on the UI updates for execution graph visualization. Executions were not impacted outside of the UI execution graph visualization.

Excerpts are shortened. Read the full incident on Harness's status page.

Custom Dashboards are failing intermittently in prod3 minor 2026-05-15 20:35 UTC 33h 2m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

IACM Pipeline Struck In Prod4 minor 2026-05-15 04:54 UTC 6d 11h
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Pipeline Updates in Prod4 is taking time. minor 2026-05-14 13:36 UTC 34m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

IACM Pipeline Struck In Prod4 minor 2026-05-14 13:00 UTC 2h 2m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Traceable APAC Cluster Slowness minor 2026-05-14 10:57 UTC 16m
  1. resolved

    We can confirm normal operation, Slowness issue is resolved. We will publish the RCA

Excerpts are shortened. Read the full incident on Harness's status page.

Hosted CI customers using secure connect are facing connectivity issues minor 2026-05-12 21:38 UTC 1h 32m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Platform access issues in Prod1/Prod2/Prod3 major 2026-05-12 17:33 UTC 22m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Secret resolution failures in CI executions - PROD2 minor 2026-05-12 09:50 UTC 4h 45m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Vercel Integration for FME is having delays to synchronize changes minor 2026-05-11 22:42 UTC 33m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Delegate Upgrades are failing for some customers none 2026-05-11 06:48 UTC 28m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Pipeline and secret resolution failures minor 2026-05-08 18:10 UTC 0m
  1. resolved

    On May 8, 2026, a CI performance optimization feature flag was inadvertantly impacted customer with older delegate version. The feature was designed to improve CI pipeline initialization performance by deferring secret resolution to runtime on supported delegate versions

Excerpts are shortened. Read the full incident on Harness's status page.

FME SDK are experiencing elevated error rates and delays in response. minor 2026-05-08 17:05 UTC 1h 48m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Deployment Degradation - Slowness in Prod3 critical 2026-05-07 08:00 UTC 4h 54m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Deployment Degradation – Failures in Prod1,2,3 minor 2026-05-07 07:54 UTC 3h 29m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

infracost integration degraded in iacm pipelines minor 2026-05-05 17:14 UTC 37m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

K8s Customer Billing Data will be outdated minor 2026-05-05 07:57 UTC 20m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod3 experiences slowness in pipelines minor 2026-05-01 16:28 UTC 3h 42m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Intermittent slowness during pipeline executions (Prod1, Prod2) minor 2026-05-01 15:02 UTC 5h 8m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Platform is experiencing degraded performance for some organizations. minor 2026-04-30 16:25 UTC 1h 25m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

FME UI errors on creating/updating Flags for subset of customers who have Jira integration. minor 2026-04-30 15:57 UTC 17m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Rule Base Segment supported SDKs timeout (FME Only) none 2026-04-28 18:27 UTC 0m
  1. resolved

    Requests made by SDKs with Rule Based Segments support could have gotten a null instead of an empty for responses with no Rule Based Segments, leading to an null pointer exception. Impact observed: 18:27 until 19:05 UTC. The impact for SDKs would have been a failure to...

Excerpts are shortened. Read the full incident on Harness's status page.

Scheduled change request delayed for a subset of flags minor 2026-04-28 17:21 UTC 0m
  1. resolved

    Between April 28 and May 1, 2026, a subset of scheduled change requests failed to execute at their scheduled times. The issue was introduced by a production deployment on April 28 and fixed with a new deployment on May 1. All affected scheduled jobs that had not been manually...

Excerpts are shortened. Read the full incident on Harness's status page.

Intermittent slowness while running pipelines none 2026-04-27 20:00 UTC 0m
  1. resolved

    We were seeing slowness while executing pipelines

Excerpts are shortened. Read the full incident on Harness's status page.

Degraded Performance — Feature Flags in PROD2 minor 2026-04-24 16:06 UTC 2h 53m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

FME - Treatments Returning Default Values none 2026-04-22 21:35 UTC 0m
  1. resolved

    On April 22, 2026, couple of customers experienced feature flags returning default treatments due to invalid empty segment membership responses being cached and served to SDKs. The issue was isolated to couple of customers under specific high-concurrency conditions involving...

Excerpts are shortened. Read the full incident on Harness's status page.

IACM infrastructure pipelines using terraform are currently experiencing an outage major 2026-04-19 14:09 UTC 1h 15m
  1. resolved

    This incident has been resolved. Customers using a pinned version older than plugins/harness_terraform:0.214.0 should update to the latest version by following the...

Excerpts are shortened. Read the full incident on Harness's status page.

We are noticing CI hosted build failures minor 2026-04-16 07:15 UTC 4h 47m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Feature Flags unable to update minor 2026-04-15 23:55 UTC 4h 20m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

FME metrics impact calculations are not updating minor 2026-04-13 16:47 UTC 44m
  1. resolved

    After monitoring post fixing the issue, all systems are back to normal and processing metrics impact calculations regularly. We will provide an RCA soon.

Excerpts are shortened. Read the full incident on Harness's status page.

Legacy Run Test step is failing intermittently for all customers in Prod2 minor 2026-04-09 05:30 UTC 5h 18m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod1 and Prod2 is facing login issues major 2026-04-09 01:05 UTC 1h 37m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Experiencing issues impacting pipeline executions in Prod1 minor 2026-04-08 13:09 UTC 1h 51m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

The IDP app is currently facing accessibility issues critical 2026-04-07 10:54 UTC 14m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Degraded Performance — Pipeline Insights Dashboards minor 2026-04-03 16:53 UTC 21h 6m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

CI degradation with CI steps using AWS connector with inherited authentication minor 2026-04-02 15:13 UTC 2h 40m

Names an upstream provider: AWS.

  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Autostopping service degraded in AWS (Middle East South 1) minor 2026-04-01 06:16 UTC 26h 24m

Names an upstream provider: AWS.

  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Intermittent STO step failure with 500 error minor 2026-03-25 10:00 UTC 2h 30m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Feature Flag SDK authentication operations are running slow in Prod2 minor 2026-03-24 18:14 UTC 2h 23m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Degraded Performance for SCIM users during login. minor 2026-03-19 16:14 UTC 45m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Test Intelligence service is impacted in Prod1 / Prod3 minor 2026-03-17 18:04 UTC 35m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

FME SDK is experiencing elevated error rates for Impressions and events minor 2026-03-17 16:36 UTC 2h 57m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Degraded performance in CI Steps in Prod 2 and Prod 3 minor 2026-03-13 16:12 UTC 1h 22m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod 2 - Customers may see some executions from March 11 in a "running" but hung state none 2026-03-12 16:20 UTC 2h 56m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Pipelines and dashboards are impacted in Prod2 major 2026-03-11 15:38 UTC 3h 7m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

GCP Billing Delay - Google Cloud billing export delays since March 8 may cause incomplete cost data for GCP resources. Resolution by GCP is expected soon minor 2026-03-09 10:47 UTC 2d 20h

Names an upstream provider: Google Cloud.

  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod4 is experiencing login issues critical 2026-03-06 00:31 UTC 1h 39m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Code Module is not accessible on prod1/2/3 minor 2026-03-05 21:21 UTC 44m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

[Prod-8] Degraded access to the login page minor 2026-03-03 10:32 UTC 6h 8m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Login issues and propagation delays on FME minor 2026-02-27 22:46 UTC 0m
  1. resolved

    Customers using FME would have experienced logging issues in addition to their Flag propagation delay from 22:46 UTC to 23:00 UTC. Services are back to normal now

Excerpts are shortened. Read the full incident on Harness's status page.

Slowness in Pipeline Execution graph UI minor 2026-02-27 14:44 UTC 1h 23m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Feature flags that were updated during 09:14:39 PM UTC and 11:39:44 PM UTC were experiencing delays to propagation. minor 2026-02-26 21:14 UTC 0m
  1. resolved

    Feature flags that were updated on Feb 26, 2026 during 09:14:39 PM UTC and 11:39:44 PM UTC were experiencing delays to propagation. The issue has been resolved, and all propagations from that window are recovering. No customer action is required

Excerpts are shortened. Read the full incident on Harness's status page.

Prod1/Prod2 pipelines and logins are degraded. Some delegates are disconnected major 2026-02-26 17:56 UTC 33m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Hosted CI mac builds are impacted major 2026-02-24 16:37 UTC 34m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Degraded performance in SEI insights minor 2026-02-23 11:03 UTC 3h 8m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Hosted CI Builds Failing none 2026-02-23 08:37 UTC 15m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Hosted CI build vm environment is seeing higher network latency minor 2026-02-19 17:36 UTC 44m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Git API rate limit errors major 2026-02-18 15:30 UTC 0m
  1. resolved

    Two enterprise customers experienced Git API rate limit errors when using remote entities backed by Git repositories on prod1 environment.This prevented loading of services, environments, and other entities stored in Git, and blocked pipeline executions that depended on the...

Excerpts are shortened. Read the full incident on Harness's status page.

Pipeline are running slow in Prod3 minor 2026-02-17 17:27 UTC 5h 32m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Some customers in Prod1 are experiencing issues with secret evaluations. minor 2026-02-16 19:37 UTC 32m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

SEI - Team Settings and Efficiency Insights Inaccessible major 2026-02-13 06:51 UTC 3h 30m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Dashboard Data Not Displaying as Expected in Prod 3 minor 2026-02-12 12:56 UTC 1h 33m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Github is experiencing degraded performance. This could affect your pipelines. none 2026-02-09 17:32 UTC 17m
  1. resolved

    Github has reported that all services are up and running without issue. https://www.githubstatus.com/incidents/ffz2k716tlhx

Excerpts are shortened. Read the full incident on Harness's status page.

Software engineering insights dashboards are unavailable critical 2026-02-04 17:38 UTC 5h 43m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Issue Affecting Feature Flag Updates - PROD2 minor 2026-02-04 12:53 UTC 35m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

PROD4 – Overview Dashboards Experiencing Issues minor 2026-02-03 11:24 UTC 3h 2m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Policy evaluation(OPA) failure in Prod2 none 2026-01-28 06:11 UTC 1m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

The Pipeline Executions list page experienced intermittent 500 errors minor 2026-01-26 21:20 UTC 53m
  1. resolved

    This incident has been resolved

Excerpts are shortened. Read the full incident on Harness's status page.

Pipeline executions failing for only users whose names contain non-ASCII characters minor 2026-01-26 13:10 UTC 10h 6m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Unable to update Feature Flags major 2026-01-22 10:14 UTC 39m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Logs not visible in CI Executions post completion minor 2026-01-20 11:00 UTC 3h 24m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

GCP Billing Delay: Google Cloud is experiencing billing export delays minor 2026-01-15 22:25 UTC 5d 2h

Names an upstream provider: Google Cloud.

  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Intermittent error while loading pipeline execution history page none 2026-01-09 18:00 UTC 30m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Intermittent error while loading template service page none 2026-01-08 19:03 UTC 5h 23m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

FME tile is not being displayed minor 2026-01-07 17:09 UTC 5h 26m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Split FME outbound impression integrations are delayed. minor 2026-01-06 21:18 UTC 43h 29m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod2: Multiple Pipeline executions are getting stuck minor 2025-12-29 15:22 UTC 3h 30m
  1. resolved

    Issue has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

CD Pipeline execution slowness in Prod3 cluster minor 2025-12-22 10:38 UTC 2h 24m
  1. resolved

    We have implemented a fix which resolved the issue. We will be providing postmortem report on this issue.

Excerpts are shortened. Read the full incident on Harness's status page.

Intermittent login flow errors on FME major 2025-12-15 21:56 UTC 17h 29m
  1. resolved

    we monitored the system for 16 hours and it remains stable with no errors observed. We will provide a detailed RCA once we receive the analysis from our vendor

Excerpts are shortened. Read the full incident on Harness's status page.

Dashboard functionality is partially unavailable major 2025-12-12 04:13 UTC 25m
  1. resolved

    The issue has been resolved, and we will share the RCA soon.

Excerpts are shortened. Read the full incident on Harness's status page.

CI Expressions(nested expressions) are impacted. minor 2025-12-05 08:56 UTC 7h 37m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Hosted CI pipelines for few accounts in Prod1/Prod2 are queued minor 2025-12-03 16:48 UTC 2h 50m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Webhooks are degraded in prod1 minor 2025-12-03 04:01 UTC 16h 13m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Availability for a subset of customers on Prod1/Prod2 major 2025-12-02 17:24 UTC 1h 13m
  1. resolved

    This incident has been resolved. We will share the RCA as soon as the analysis is completed.

Excerpts are shortened. Read the full incident on Harness's status page.

Webhooks are degraded in prod1 minor 2025-12-02 10:26 UTC 32m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Traceable - Delay in protection events in APAC region minor 2025-12-02 07:55 UTC 1h 18m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Pipelines executions are degraded minor 2025-12-02 05:21 UTC 1h 20m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

CD Pipeline slowness report in Prod-2 and Prod-3 cluster minor 2025-11-28 10:36 UTC 46m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

CD Pipeline slowness report in Prod3 minor 2025-11-28 10:36 UTC 0m
  1. resolved

    CD Pipeline execution slowness reported in Prod3

Excerpts are shortened. Read the full incident on Harness's status page.

Pipeline Execution Slowdowns — A Subset of Customers May Notice Delayed Starts minor 2025-11-26 19:12 UTC 2h 19m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

HostedCI is facing intermittent build failures in few environments minor 2025-11-25 01:15 UTC 13m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Security Testing Orchestration Outage – EU Region. critical 2025-11-24 03:15 UTC 4h 45m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

A subset of CI jobs may fail during the initial clone step in K8 environment minor 2025-11-19 21:34 UTC 27m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

[Notification] Harness Pipeline executions may be failing due to an ongoing GitHub outage minor 2025-11-18 21:07 UTC 53m

Names an upstream provider: GitHub.

Started during GitHub: Git operation failures.

  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

[Notification] Docker Engine v29 — Compatibility Notice for Harness minor 2025-11-15 05:06 UTC 4d
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Customers may experience intermittent “stuck” pipelines in Prod 2 minor 2025-11-11 18:19 UTC 2h 41m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Harness CI Cloud builds for Linux-Arm64 are impacted major 2025-11-10 23:49 UTC 5h 7m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Template service is experiencing issues when marking templates as stable. minor 2025-11-10 22:07 UTC 17h 49m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Degraded functionality in account level templates minor 2025-11-04 07:53 UTC 3h 16m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Harness cloud IDP pipeline failures minor 2025-11-03 11:00 UTC 0m
  1. resolved

    On October 31st, 2025, several IDP pipelines on Harness Cloud infrastructure failed during execution exclusively in the Prod1 environment. The failures were traced to a missing feature flag that had been archived recently while still in use by the IDP service.

Excerpts are shortened. Read the full incident on Harness's status page.

Customers in prod1 are not able to file zendesk tickets. minor 2025-10-31 23:20 UTC 0m
  1. resolved

    Customers cannot create tickets via Zendesk from the module view. But we can create via the Unified view.

Excerpts are shortened. Read the full incident on Harness's status page.

Write operations (git push) not working for Harness Code in Prod 1 major 2025-10-30 18:57 UTC 5m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Some failures on http://config.ff.harness.io/client/auth end point. minor 2025-10-29 00:30 UTC 0m
  1. resolved

    At 1:47am GMT, automated synthetic checks simulating SDK traffic for the Feature Flags service began failing. Some requests to http://config.ff.harness.io/client/auth received 502 responses. Subsequent investigation revealed that one of the service dependencies and partially...

Excerpts are shortened. Read the full incident on Harness's status page.

Test Reports are impacted in Prod2 major 2025-10-15 07:37 UTC 1h 7m
  1. resolved

    The incident has been resolved. We’ll share the RCA at the earliest.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod-2 pipeline execution list page failing intermittently minor 2025-10-04 08:30 UTC 12m
  1. resolved

    This incident has been resolved. Thank you for your patience.

Excerpts are shortened. Read the full incident on Harness's status page.

Pipeline Executions on PROD1 are running slow minor 2025-09-29 19:19 UTC 4h 35m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Degraded Performance Observed for Prod3. major 2025-09-28 02:45 UTC 3h 15m
  1. resolved

    Pipelines are running now.

Excerpts are shortened. Read the full incident on Harness's status page.

All Template updates are failing for Prod1 major 2025-09-25 13:30 UTC 32m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Public Docker Hub Outage Impacting Customer Pipelines minor 2025-09-25 00:18 UTC 1h 21m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Few customers experienced delays in warmup and cooldown operations for AutoStopping rules none 2025-09-16 11:30 UTC 0m
  1. resolved

    On Sept 16 at 2:40 AM PDT, Due to spike in resource intensive operations resulted in a queue buildup increasing contention on the worker queue and reducing the overall system throughput.

Excerpts are shortened. Read the full incident on Harness's status page.

Hosted Mac offering is not functional critical 2025-09-15 16:49 UTC 39m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Issue with In-Progress Pipelines minor 2025-09-15 10:29 UTC 37m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Pipeline executions are observing degraded performance none 2025-09-10 16:46 UTC 4h 51m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Degradation in SEI 2.0 major 2025-09-08 13:59 UTC 13h 30m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

We are experiencing Login failure in Prod1 and Prod2 clusters major 2025-09-03 15:47 UTC 18h 5m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Data delay in Custom Dashboards minor 2025-08-29 03:47 UTC 9h 45m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Few Pipelines are running slow and some failures minor 2025-08-28 03:29 UTC 3m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

CCM Perspective builder: 'Like' filter is not functional minor 2025-08-27 18:24 UTC 13h 7m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Delegates failing to establish mTLS connectivity due to SSL errors. minor 2025-08-26 12:30 UTC 0m
  1. resolved

    For customers using mTLS feature only: At approximately 12:19 PM EST, Aug 26,2025, we had some issue where Delegates could not establish connectivity over mTLS due to SSL errors. Upon further investigation, our engineering team identified there was an incorrect secret that was...

Excerpts are shortened. Read the full incident on Harness's status page.

Code Repository and Artifact registry are impacted in Prod2/Prod3 major 2025-08-15 20:54 UTC 39m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

CCM: When adding labels to cluster table dashboards, certain fields are removed limiting cost visibility to the cluster costs. minor 2025-08-15 17:50 UTC 27h 43m
  1. resolved

    This incident is resolved

Excerpts are shortened. Read the full incident on Harness's status page.

Feature Flag service down on Prod1, 2 and 3. critical 2025-08-07 17:47 UTC 1h 20m
  1. resolved

    All systems healthy

Excerpts are shortened. Read the full incident on Harness's status page.

CCM Prod2 : Degraded Performance - Cluster Utilization and Cluster cost dashboards are not loading minor 2025-08-05 18:15 UTC 48m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod2: Feature flag functionality is currently degraded minor 2025-07-29 19:33 UTC 36m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Some accounts facing degraded functionalities : PROD1 minor 2025-07-24 09:36 UTC 1h 25m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod2: Feature flag is currently degraded minor 2025-07-07 17:37 UTC 35m
  1. resolved

    This incident has been resolved at this moment. RCA will be followed.

Excerpts are shortened. Read the full incident on Harness's status page.

Mac Hosted CI builds observing failures minor 2025-07-03 19:37 UTC 19m
  1. resolved

    The issue is resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

[ PROD 2 ] - Pipelines Running Slowly minor 2025-06-24 18:13 UTC 3h 12m
  1. resolved

    The incident has been resolved

Excerpts are shortened. Read the full incident on Harness's status page.

[Prod1/Prod2/Prod3] SEI Service Degraded for Jenkins Users major 2025-06-24 16:09 UTC 1h 51m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

All clusters experiencing feature loss or degradation of functionality due to our sub-provider functionality being degraded major 2025-06-12 18:51 UTC 8h 3m
  1. resolved

    All services are fully recovered.

Excerpts are shortened. Read the full incident on Harness's status page.

CI builds for MacOS are experiencing an outage minor 2025-06-09 03:07 UTC 14h 15m
  1. resolved

    We have identified and resolved the incident. We will follow up with the detailed RCA.

Excerpts are shortened. Read the full incident on Harness's status page.

CI/STO Stage Failures minor 2025-06-06 16:30 UTC 1h 8m
  1. resolved

    The issue has been resolved and we will post our findings in the post mortem.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod1: Unified Dashboards may be experiencing delays minor 2025-06-05 14:41 UTC 1h 12m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Helm deployments failing with older delegates. (< 25.05.858XX) critical 2025-05-30 08:23 UTC 1h 37m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

EU1: Codebase Expression Fails to Resolve in Pipelines Across Multiple Projects (Partial outage) major 2025-05-20 15:15 UTC 37m
  1. resolved

    Issue is resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod2 - Resource Constraint Issues none 2025-05-10 16:44 UTC 2h 38m
  1. resolved

    We have successfully resolved the issue.

Excerpts are shortened. Read the full incident on Harness's status page.

Unified pipeline dashboard is experiencing delay in Prod3 minor 2025-05-08 12:27 UTC 2h 56m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Gitops agent using mtls is failing to connect to the gitops service none 2025-04-29 17:00 UTC 2h
  1. resolved

    We have deployed a fix for this issue, and the GitOps service is working correctly again.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod-3 was intermittently unavailable major 2025-04-16 10:42 UTC 30m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

PROD1: Unified Custom Dashboards are not loading properly minor 2025-04-08 18:37 UTC 1h 1m
  1. resolved

    We have resolved the issue. Dashboards are up and running.

Excerpts are shortened. Read the full incident on Harness's status page.

PROD2: Login is failing critical 2025-04-08 09:24 UTC 1h 2m
  1. resolved

    The incident has been resolved. A detailed Root Cause Analysis (RCA) will be shared.

Excerpts are shortened. Read the full incident on Harness's status page.

PROD1: Unable to login critical 2025-04-07 05:46 UTC 1h 10m
  1. resolved

    This incident currently stands resolved. We will publish an RCA.

Excerpts are shortened. Read the full incident on Harness's status page.

PROD1: Stale Data Observed for Unified Custom Dashboards minor 2025-04-04 17:08 UTC 35m
  1. resolved

    This incident has been resolved. Thanks for your patience.

Excerpts are shortened. Read the full incident on Harness's status page.

PROD3: UI not loading none 2025-04-01 07:05 UTC 36m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Login failures in prod4 minor 2025-03-31 18:54 UTC 15m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Stale Data Observed for Custom Dashboards in Prod1 minor 2025-03-26 02:04 UTC 2h 22m
  1. resolved

    This incident has been resolved. Thanks for your patience.

Excerpts are shortened. Read the full incident on Harness's status page.

Custom dashboards are not loading - Prod1,2,3,4 and Eu1 due to Looker managed service outage critical 2025-03-26 00:17 UTC 1h 12m
  1. resolved

    The dashboards are now rendering correctly with the recovery of Looker Service.

Excerpts are shortened. Read the full incident on Harness's status page.

Pipeline failures due to secret decryption in Prod2 minor 2025-03-19 19:43 UTC 2h 12m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

CIE Pipeline Execution Failures in Prod1 major 2025-03-18 16:56 UTC 34m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Intermittent connections errors on Prod4 major 2025-03-08 00:53 UTC 7m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

PROD1: STO pipeline execution failing minor 2025-03-06 13:32 UTC 1h 15m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod2: CI/STO Pipeline Execution failing for Customers minor 2025-03-06 08:50 UTC 2h 15m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Some CI pipelines are experiencing stage aborts in Prod2 minor 2025-03-05 20:49 UTC 7h 36m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Intermittent UI Failures on Prod4 minor 2025-03-05 03:18 UTC 7m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

CI stages are getting queued in Prod2 minor 2025-03-04 23:50 UTC 3h 33m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Prod3: Unable to Create Environments,Service Overrides and Infrastructure major 2025-03-04 08:35 UTC 3h 24m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Login issues on our Prod3 environment critical 2025-03-04 07:25 UTC 4h 34m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Some Feature Flag customers are experiencing intermittent issues with evaluating target groups on Prod2 major 2025-03-03 18:48 UTC 19m
  1. resolved

    Issue has now been resolved, and will share the RCA shortly

Excerpts are shortened. Read the full incident on Harness's status page.

Seeing intermittent login issues on our Prod4 environment critical 2025-03-02 15:42 UTC 1h 15m
  1. resolved

    After continued monitoring and further investigation issue has been considered resolved

Excerpts are shortened. Read the full incident on Harness's status page.

GCE VM Reboots in us-west1-a Zone none 2025-02-25 14:54 UTC 4h 56m
  1. resolved

    Google has marked their incident as resolved and stated that VMs utilizing the us-west1-a zone are fully operational again.

Excerpts are shortened. Read the full incident on Harness's status page.

CI Plugin Image Retrieval Failure from the Docker Hub minor 2025-02-06 09:00 UTC 29m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Users in Prod-2 cluster facing unexpected pipeline failures minor 2025-02-06 06:29 UTC 1h 24m
  1. resolved

    This incident has been resolved. Please monitor this incident for Postmortem report. Thanks for your patience.

Excerpts are shortened. Read the full incident on Harness's status page.

Harness overview dashboard is not loading on Prod-Eu1 minor 2025-02-05 10:30 UTC 6h 38m
  1. resolved

    We have fixed the issue with Overview dashboard/landing dashboard. This incident is resolved now. Please monitor this page for postmortem report.

Excerpts are shortened. Read the full incident on Harness's status page.

Harness performance degraded in Prod3. minor 2025-02-04 11:23 UTC 1h 44m
  1. resolved

    This incident is resolved now. Please monitor this page for postmortem report.

Excerpts are shortened. Read the full incident on Harness's status page.

Custom Dashboards are not loading in Prod2 major 2025-01-30 14:58 UTC 1h 6m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Custom Dashboards [Unified View Explores] are experiencing delays in updating in Prod2 minor 2025-01-24 06:32 UTC 19h 35m
  1. resolved

    Custom Dashboards [Unified View Explores] are now updating normally. The issue is now resolved. We appreciate your patience.

Excerpts are shortened. Read the full incident on Harness's status page.

CI/CD Pipeline failure on Prod4 major 2025-01-24 00:40 UTC 52m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

PROD2: Delegates got disconnected from Harness major 2025-01-21 10:45 UTC 36m
  1. resolved

    All delegate connectivity is resumed. Detailed RCA will follow soon.

Excerpts are shortened. Read the full incident on Harness's status page.

Pipelines custom webhook executions are delayed minor 2024-12-20 17:15 UTC 2h 33m
  1. resolved

    This incident has been resolved. We regret the inconvenience and will be providing an RCA for review.

Excerpts are shortened. Read the full incident on Harness's status page.

CI Harness Cloud builds were non-operational for Prod3. critical 2024-12-10 06:58 UTC 1m
  1. resolved

    This incident is resolved and services are operational.

Excerpts are shortened. Read the full incident on Harness's status page.

Queue-Service is impacted for Prod3 customers minor 2024-11-18 12:48 UTC 17m
  1. resolved

    The issue has been resolved. We apologize for the inconvenience and will share the root cause analysis (RCA) shortly.

Excerpts are shortened. Read the full incident on Harness's status page.

Feature Flags metrics service down on Prod1 minor 2024-11-13 15:30 UTC 0m
  1. resolved

    Between 14:55 UTC and 15:14 UTC the Feature Flag service on Prod1 experienced an outage on the metrics service. Customers sending metrics data during this window will have received an 500 error We have identified the issue and a fix has been applied. An RCA will follow shortly

Excerpts are shortened. Read the full incident on Harness's status page.

Harness Platform was briefly Unavailable critical 2024-11-05 14:19 UTC 1m
  1. resolved

    This incident has been resolved.

Excerpts are shortened. Read the full incident on Harness's status page.

Chaos Engineering users in Prod2 cluster may be experiencing issues minor 2024-11-05 07:06 UTC 13m
  1. resolved

    This incident has been resolved. We regret the inconvenience that this might have caused.

Excerpts are shortened. Read the full incident on Harness's status page.