Incidents | Marcode Incidents reported on status page for Marcode https://status.marcode.ai/ https://d1lppblt9t2x15.cloudfront.net/logos/4bf1c586e3e4fb4318889bceb8224586.png Incidents | Marcode https://status.marcode.ai/ en Marcode API recovered https://status.marcode.ai/ Mon, 11 Aug 2025 16:33:51 +0000 https://status.marcode.ai/#76f26f6f49d4ea5ead28cfcffd5863510dce91cff64c33ab9f29f6eaa443d70b Marcode API recovered Marcode API went down https://status.marcode.ai/ Mon, 11 Aug 2025 16:30:54 +0000 https://status.marcode.ai/#76f26f6f49d4ea5ead28cfcffd5863510dce91cff64c33ab9f29f6eaa443d70b Marcode API went down Marcode API recovered https://status.marcode.ai/ Sun, 10 Aug 2025 07:57:18 +0000 https://status.marcode.ai/#7cb4e52c59f409d85ab8b0218ae5642866f4d448b1952d8936a36638f482c7e0 Marcode API recovered Marcode API went down https://status.marcode.ai/ Sun, 10 Aug 2025 07:54:51 +0000 https://status.marcode.ai/#7cb4e52c59f409d85ab8b0218ae5642866f4d448b1952d8936a36638f482c7e0 Marcode API went down Marcode API recovered https://status.marcode.ai/ Fri, 08 Aug 2025 11:34:47 +0000 https://status.marcode.ai/#26824bd5ced491ad0421f923e7d2a34e44a6deae9b7c9ba2d5512e3cce30ef1f Marcode API recovered Marcode API went down https://status.marcode.ai/ Fri, 08 Aug 2025 11:25:29 +0000 https://status.marcode.ai/#26824bd5ced491ad0421f923e7d2a34e44a6deae9b7c9ba2d5512e3cce30ef1f Marcode API went down Marcode API recovered https://status.marcode.ai/ Thu, 07 Aug 2025 10:09:57 +0000 https://status.marcode.ai/#23e93cecb69967e5d66e2638f1943a56a77d0ab4b5edbb4879cef0c0fbf23879 Marcode API recovered Marcode API went down https://status.marcode.ai/ Thu, 07 Aug 2025 10:07:21 +0000 https://status.marcode.ai/#23e93cecb69967e5d66e2638f1943a56a77d0ab4b5edbb4879cef0c0fbf23879 Marcode API went down Marcode API recovered https://status.marcode.ai/ Sun, 06 Jul 2025 15:21:18 +0000 https://status.marcode.ai/#d5cf9a8ffb501150e57ecaff8bd33563343e184a7727dfc995ef18d8e5de9b7c Marcode API recovered Marcode API went down https://status.marcode.ai/ Sun, 06 Jul 2025 15:15:18 +0000 https://status.marcode.ai/#d5cf9a8ffb501150e57ecaff8bd33563343e184a7727dfc995ef18d8e5de9b7c Marcode API went down System upgrade planned: Intermittent downtime of app is possible https://status.marcode.ai/incident/613553 Fri, 04 Jul 2025 11:26:49 +0000 https://status.marcode.ai/incident/613553#a8680d500da8ecce9a93209fbfebf8b289445eab03f8fcb09e7ec41d11c7f9d7 Maintenance completed System upgrade planned: Intermittent downtime of app is possible https://status.marcode.ai/incident/613553 Fri, 04 Jul 2025 11:26:49 -0000 https://status.marcode.ai/incident/613553#d981f728413efc01c9ae552fd27df72bbbec84a21c3f5e5fe5b4011478476386 On 4th July, we will be rolling out a large upgrade to our analytics system. We expect this to dramatically improve load times and allow us to build new data views faster, but it requires us to replace the analytics system in use completely. We expect to start the work for this at 9:30am BST and it may take up to 6 hours to complete - although we do not expect this to impact clients, intermittent downtime during this period is possible. In the event that we have not been successful by 3:30pm, the update will be rolled back and the system should be fully functional by 4pm. System upgrade planned: Intermittent downtime of app is possible https://status.marcode.ai/incident/613553 Fri, 04 Jul 2025 11:26:49 +0000 https://status.marcode.ai/incident/613553#a8680d500da8ecce9a93209fbfebf8b289445eab03f8fcb09e7ec41d11c7f9d7 Maintenance completed System upgrade planned: Intermittent downtime of app is possible https://status.marcode.ai/incident/613553 Fri, 04 Jul 2025 11:26:49 -0000 https://status.marcode.ai/incident/613553#d981f728413efc01c9ae552fd27df72bbbec84a21c3f5e5fe5b4011478476386 On 4th July, we will be rolling out a large upgrade to our analytics system. We expect this to dramatically improve load times and allow us to build new data views faster, but it requires us to replace the analytics system in use completely. We expect to start the work for this at 9:30am BST and it may take up to 6 hours to complete - although we do not expect this to impact clients, intermittent downtime during this period is possible. In the event that we have not been successful by 3:30pm, the update will be rolled back and the system should be fully functional by 4pm. System upgrade planned: Intermittent downtime of app is possible https://status.marcode.ai/incident/613553 Fri, 04 Jul 2025 10:36:14 -0000 https://status.marcode.ai/incident/613553#d981f728413efc01c9ae552fd27df72bbbec84a21c3f5e5fe5b4011478476386 On 4th July, we will be rolling out a large upgrade to our analytics system. We expect this to dramatically improve load times and allow us to build new data views faster, but it requires us to replace the analytics system in use completely. We expect to start the work for this at 9:30am BST and it may take up to 6 hours to complete - although we do not expect this to impact clients, intermittent downtime during this period is possible. In the event that we have not been successful by 3:30pm, the update will be rolled back and the system should be fully functional by 4pm. System upgrade planned: Intermittent downtime of app is possible https://status.marcode.ai/incident/613553 Fri, 04 Jul 2025 10:36:14 -0000 https://status.marcode.ai/incident/613553#d981f728413efc01c9ae552fd27df72bbbec84a21c3f5e5fe5b4011478476386 On 4th July, we will be rolling out a large upgrade to our analytics system. We expect this to dramatically improve load times and allow us to build new data views faster, but it requires us to replace the analytics system in use completely. We expect to start the work for this at 9:30am BST and it may take up to 6 hours to complete - although we do not expect this to impact clients, intermittent downtime during this period is possible. In the event that we have not been successful by 3:30pm, the update will be rolled back and the system should be fully functional by 4pm. System upgrade planned: Intermittent downtime of app is possible https://status.marcode.ai/incident/613553 Fri, 04 Jul 2025 08:58:43 -0000 https://status.marcode.ai/incident/613553#d981f728413efc01c9ae552fd27df72bbbec84a21c3f5e5fe5b4011478476386 On 4th July, we will be rolling out a large upgrade to our analytics system. We expect this to dramatically improve load times and allow us to build new data views faster, but it requires us to replace the analytics system in use completely. We expect to start the work for this at 9:30am BST and it may take up to 6 hours to complete - although we do not expect this to impact clients, intermittent downtime during this period is possible. In the event that we have not been successful by 3:30pm, the update will be rolled back and the system should be fully functional by 4pm. System upgrade planned: Intermittent downtime of app is possible https://status.marcode.ai/incident/613553 Fri, 04 Jul 2025 08:58:43 -0000 https://status.marcode.ai/incident/613553#d981f728413efc01c9ae552fd27df72bbbec84a21c3f5e5fe5b4011478476386 On 4th July, we will be rolling out a large upgrade to our analytics system. We expect this to dramatically improve load times and allow us to build new data views faster, but it requires us to replace the analytics system in use completely. We expect to start the work for this at 9:30am BST and it may take up to 6 hours to complete - although we do not expect this to impact clients, intermittent downtime during this period is possible. In the event that we have not been successful by 3:30pm, the update will be rolled back and the system should be fully functional by 4pm. System upgrade planned: Intermittent downtime of app is possible https://status.marcode.ai/incident/613553 Fri, 04 Jul 2025 08:30:00 -0000 https://status.marcode.ai/incident/613553#d981f728413efc01c9ae552fd27df72bbbec84a21c3f5e5fe5b4011478476386 On 4th July, we will be rolling out a large upgrade to our analytics system. We expect this to dramatically improve load times and allow us to build new data views faster, but it requires us to replace the analytics system in use completely. We expect to start the work for this at 9:30am BST and it may take up to 6 hours to complete - although we do not expect this to impact clients, intermittent downtime during this period is possible. In the event that we have not been successful by 3:30pm, the update will be rolled back and the system should be fully functional by 4pm. System upgrade planned: Intermittent downtime of app is possible https://status.marcode.ai/incident/613553 Fri, 04 Jul 2025 08:30:00 -0000 https://status.marcode.ai/incident/613553#d981f728413efc01c9ae552fd27df72bbbec84a21c3f5e5fe5b4011478476386 On 4th July, we will be rolling out a large upgrade to our analytics system. We expect this to dramatically improve load times and allow us to build new data views faster, but it requires us to replace the analytics system in use completely. We expect to start the work for this at 9:30am BST and it may take up to 6 hours to complete - although we do not expect this to impact clients, intermittent downtime during this period is possible. In the event that we have not been successful by 3:30pm, the update will be rolled back and the system should be fully functional by 4pm. Reports of widespread outages in upstream service providers https://status.marcode.ai/incident/601883 Thu, 12 Jun 2025 18:37:00 -0000 https://status.marcode.ai/incident/601883#2d74305aee1814987d914ae87fce0f36970093a5cbeca7c4bf31a69c618f3401 Nothing is down - this is a preemptive notice: There are some reports of widespread outages across Google Cloud, Cloudflare, and AWS. Marcode is currently operational, but our service relies on these service providers. We will monitor the situation and update this page if any of our systems experience problems. Reports of widespread outages in upstream service providers https://status.marcode.ai/incident/601883 Thu, 12 Jun 2025 18:37:00 -0000 https://status.marcode.ai/incident/601883#2d74305aee1814987d914ae87fce0f36970093a5cbeca7c4bf31a69c618f3401 Nothing is down - this is a preemptive notice: There are some reports of widespread outages across Google Cloud, Cloudflare, and AWS. Marcode is currently operational, but our service relies on these service providers. We will monitor the situation and update this page if any of our systems experience problems. Reports of widespread outages in upstream service providers https://status.marcode.ai/incident/601883 Thu, 12 Jun 2025 18:37:00 -0000 https://status.marcode.ai/incident/601883#2d74305aee1814987d914ae87fce0f36970093a5cbeca7c4bf31a69c618f3401 Nothing is down - this is a preemptive notice: There are some reports of widespread outages across Google Cloud, Cloudflare, and AWS. Marcode is currently operational, but our service relies on these service providers. We will monitor the situation and update this page if any of our systems experience problems. Marcode API recovered https://status.marcode.ai/ Tue, 03 Jun 2025 10:43:49 +0000 https://status.marcode.ai/#a1cc62a3d1ab06cb3bbb394d72ab6e6860bc44031ec3dbe26bc2836cd2594b71 Marcode API recovered Marcode API went down https://status.marcode.ai/ Tue, 03 Jun 2025 10:34:46 +0000 https://status.marcode.ai/#a1cc62a3d1ab06cb3bbb394d72ab6e6860bc44031ec3dbe26bc2836cd2594b71 Marcode API went down Marcode API recovered https://status.marcode.ai/ Tue, 27 May 2025 20:11:31 +0000 https://status.marcode.ai/#6a359216ef7840dcda6f6365728bc35f7a2888219193161ff601927b7d1623c1 Marcode API recovered Marcode API went down https://status.marcode.ai/ Tue, 27 May 2025 20:03:31 +0000 https://status.marcode.ai/#6a359216ef7840dcda6f6365728bc35f7a2888219193161ff601927b7d1623c1 Marcode API went down Marcode API recovered https://status.marcode.ai/ Tue, 27 May 2025 11:40:58 +0000 https://status.marcode.ai/#6664b65fd7fba2fd6249c6e41ae649b8b918308346baeb321956e3eeeeed486e Marcode API recovered Marcode API went down https://status.marcode.ai/ Tue, 27 May 2025 11:29:57 +0000 https://status.marcode.ai/#6664b65fd7fba2fd6249c6e41ae649b8b918308346baeb321956e3eeeeed486e Marcode API went down Data systems upgrade https://status.marcode.ai/incident/546760 Mon, 21 Apr 2025 13:06:44 -0000 https://status.marcode.ai/incident/546760#24d2c026f1b9c80ad35fe020a772043e20f9e169d2e3cab0d25d5f475a0be8b6 The dashboard will be unavailable or intermittently available for up to 4 hours while we update a critical software package. There will be no data loss and data collection will continue as usual. Data systems upgrade https://status.marcode.ai/incident/546760 Mon, 21 Apr 2025 13:06:44 -0000 https://status.marcode.ai/incident/546760#24d2c026f1b9c80ad35fe020a772043e20f9e169d2e3cab0d25d5f475a0be8b6 The dashboard will be unavailable or intermittently available for up to 4 hours while we update a critical software package. There will be no data loss and data collection will continue as usual. Data systems upgrade https://status.marcode.ai/incident/546760 Mon, 21 Apr 2025 12:30:00 +0000 https://status.marcode.ai/incident/546760#deed27ae3424341220a544939e3ecb68606ded27a5c90d0826182265b83a4228 Maintenance completed Data systems upgrade https://status.marcode.ai/incident/546760 Mon, 21 Apr 2025 12:30:00 +0000 https://status.marcode.ai/incident/546760#deed27ae3424341220a544939e3ecb68606ded27a5c90d0826182265b83a4228 Maintenance completed Data systems upgrade https://status.marcode.ai/incident/546760 Mon, 21 Apr 2025 08:30:00 -0000 https://status.marcode.ai/incident/546760#24d2c026f1b9c80ad35fe020a772043e20f9e169d2e3cab0d25d5f475a0be8b6 The dashboard will be unavailable or intermittently available for up to 4 hours while we update a critical software package. There will be no data loss and data collection will continue as usual. Data systems upgrade https://status.marcode.ai/incident/546760 Mon, 21 Apr 2025 08:30:00 -0000 https://status.marcode.ai/incident/546760#24d2c026f1b9c80ad35fe020a772043e20f9e169d2e3cab0d25d5f475a0be8b6 The dashboard will be unavailable or intermittently available for up to 4 hours while we update a critical software package. There will be no data loss and data collection will continue as usual. API unavailable https://status.marcode.ai/incident/510974 Tue, 11 Feb 2025 11:15:00 -0000 https://status.marcode.ai/incident/510974#8e2591aa9ac8b502d3f8084ef7f5c2dcd949dc3f209a00949a138bbacb2ac992 The API is back online. API unavailable https://status.marcode.ai/incident/510974 Tue, 11 Feb 2025 10:58:00 -0000 https://status.marcode.ai/incident/510974#3d8dca969abf49f44a2fab6f63b3a39cacdbe6ab6e95879eaf5298e5df945b93 Our API is currently unavailable due to a database issue. We are working to resolve it. Degraded data collection https://status.marcode.ai/incident/500112 Wed, 22 Jan 2025 17:42:00 -0000 https://status.marcode.ai/incident/500112#3f2fc7b0102b83bfaf657a94f3d3bd8ca8d3655e54f621c73b9fcaa68a7899e6 Data collection appears to have returned to normal. We likely experienced a test for an upcoming change related to: https://techcrunch.com/2025/01/17/google-begins-requiring-javascript-for-google-search/ Degraded data collection https://status.marcode.ai/incident/500112 Wed, 22 Jan 2025 15:06:00 -0000 https://status.marcode.ai/incident/500112#492e1c52946519488909b86226b470c00a0a00a910a5a6a886b0a7bd9e266946 We're currently investigating an increase in data collection errors since 14:45 Data Collection Downtime: Google rendering changes https://status.marcode.ai/incident/496623 Thu, 16 Jan 2025 08:30:00 -0000 https://status.marcode.ai/incident/496623#ddc3916344f33b66c0cbbb6a9f38cbda1a4f1f15e1575cb01413984f9c7961c7 The Google data collection issue was fully resolved by 08:30 GMT. Retrospective: The issue was related to a change that Google made to prevent LLM crawlers from accessing results, and it has had an industry-wide impact. While Marcode was impacted for roughly 7 hours, many of our peers across the industry have experienced much more significant data blackouts. Read more: - https://techcrunch.com/2025/01/17/google-begins-requiring-javascript-for-google-search/ - https://searchengineland.com/google-disrupts-seo-tools-450872 Data Collection Downtime: Google rendering changes https://status.marcode.ai/incident/496623 Thu, 16 Jan 2025 08:14:00 -0000 https://status.marcode.ai/incident/496623#c6258d6142048bf8f196fff33e7ad2fce3bafbf2fd89bfd9aa85be580f2306ed The data collection issue has been resolved and the system is beginning to work as normal. Queues will begin to clear immediately and the system should be fully functional within 90 minutes. Data Collection Downtime: Google rendering changes https://status.marcode.ai/incident/496623 Thu, 16 Jan 2025 07:34:00 -0000 https://status.marcode.ai/incident/496623#539f33f455e1684499cb9f6ad4b4e50a54b7170d96baa3bfa70b9ec943dbd556 We have validated the fix, are currently ensuring it will work in production, and should have it released soon. Some data may be collected while we run small scale tests. Data Collection Downtime: Google rendering changes https://status.marcode.ai/incident/496623 Thu, 16 Jan 2025 02:26:00 -0000 https://status.marcode.ai/incident/496623#74df0cae3b2b8b1fbcdbc45c5b517aec8ebae08e70cba579ee84b3811f8042d9 We've identified the issue and are working on a fix. All data collection is has been disabled to allow us to quickly fix the Google issue without distractions. Data Collection Downtime: Google rendering changes https://status.marcode.ai/incident/496623 Thu, 16 Jan 2025 01:06:00 -0000 https://status.marcode.ai/incident/496623#065a37d450999164fded8b9dce44203626e1938d886cc67b2c4712abd6a0c712 We're investigating some downtime in our crawler - all data collection from Google is currently offline. Other data sources are collecting data as usual. Crawler issues https://status.marcode.ai/incident/474063 Sat, 07 Dec 2024 23:29:00 -0000 https://status.marcode.ai/incident/474063#0cb2ca7e07039fad93df259b10eb1578bdf670f1bf00e8e669992d829990919b The data collection issue was traced to an upstream provider and has been resolved. We will continue to monitor the situation and ensure a healthy system Crawler issues https://status.marcode.ai/incident/474063 Sat, 07 Dec 2024 23:05:00 -0000 https://status.marcode.ai/incident/474063#abaabaa05d12499fe0110664e4620802cf99a55800e6d660dcaa236fd3fd12b7 We're investigating an issue that is causing the data collection crawler to fail. Data is not being collected, and Micromanager installs should fall back to their default behaviour. API Offline https://status.marcode.ai/incident/442131 Thu, 10 Oct 2024 01:01:00 -0000 https://status.marcode.ai/incident/442131#b4b184944c639460f1935bb8f9b53f1e7e3c327165b76bfd6f8f570559035d5a The API issue was identified and fixed. API Offline https://status.marcode.ai/incident/442131 Thu, 10 Oct 2024 00:49:00 -0000 https://status.marcode.ai/incident/442131#75b26d72e4aca8ac518d68e91180f069621c79e985c52a5c8bc09e516deaf2cf Our monitoring services have detected that the API is offline. We are currently investigating. Data collection downtime https://status.marcode.ai/incident/384481 Fri, 14 Jun 2024 21:08:00 -0000 https://status.marcode.ai/incident/384481#848f7ca6b40ac45d586e2f73de109fae1bbbd166a7d61057da18d9dd085bcd73 The incident has been resolved. We will implement further systems to guard against this type of database misconfiguration, and are already working to improve the coverage of our monitoring systems to ensure this issue does not reoccur. Data collection downtime https://status.marcode.ai/incident/384481 Fri, 14 Jun 2024 20:32:00 -0000 https://status.marcode.ai/incident/384481#ed5d0c5ef2e56e3a3fca1a692df1a309a68c7d97aa19696ee47959f26ec6020e The data collection service was offline between approx. 18:10 and 20:50 (BST) on June 14th. This was caused by a misconfiguration in a critical database, and subsequent failures in our monitoring suite. While data was not being collected, the status quo was maintained by Micromanager installs for the first 90 minutes, they then automatically reverted to their fallback functionality when the incident was recognised. Service was restored by 21:20, but we are unable to backfill the missing data that was not collected during this time period. Corruption of data https://status.marcode.ai/incident/348975 Mon, 01 Apr 2024 12:15:00 -0000 https://status.marcode.ai/incident/348975#fb14c08a2d4d5adbe1912a19d16b57db832d28df6e5f371a207132d65a33e5d7 We have confirmed that the data from the affected period is not recoverable. Micromanager services were unaffected by this downtime: The service received correct data throughout the period. Corruption of data https://status.marcode.ai/incident/348975 Mon, 01 Apr 2024 12:15:00 -0000 https://status.marcode.ai/incident/348975#fb14c08a2d4d5adbe1912a19d16b57db832d28df6e5f371a207132d65a33e5d7 We have confirmed that the data from the affected period is not recoverable. Micromanager services were unaffected by this downtime: The service received correct data throughout the period. Corruption of data https://status.marcode.ai/incident/348975 Mon, 01 Apr 2024 11:47:00 -0000 https://status.marcode.ai/incident/348975#2dc00b91fc81585f72a944b61f21c9f514c841346f88daf36ccb6bcedb9fa8f8 Data collection and analytics services have been restored. SERP data from the period of 2024-03-31T11:00:00Z to 2024-04-01T09:00:00Z is still missing from the interface. We are attempting to recover this, but it may not be possible Corruption of data https://status.marcode.ai/incident/348975 Mon, 01 Apr 2024 11:47:00 -0000 https://status.marcode.ai/incident/348975#2dc00b91fc81585f72a944b61f21c9f514c841346f88daf36ccb6bcedb9fa8f8 Data collection and analytics services have been restored. SERP data from the period of 2024-03-31T11:00:00Z to 2024-04-01T09:00:00Z is still missing from the interface. We are attempting to recover this, but it may not be possible Corruption of data https://status.marcode.ai/incident/348975 Mon, 01 Apr 2024 09:10:00 -0000 https://status.marcode.ai/incident/348975#5fc99dbd9cdc080b098ba8b9f0d6dd7e57b30b2297b17da4e70590d0a4d16141 We're investigating the corruption of SERP data from approx. 11:00 March 31st, 2024 until 09:00 April 1st. All systems are fully operational, however the data from this time period is unavailable. Corruption of data https://status.marcode.ai/incident/348975 Mon, 01 Apr 2024 09:10:00 -0000 https://status.marcode.ai/incident/348975#5fc99dbd9cdc080b098ba8b9f0d6dd7e57b30b2297b17da4e70590d0a4d16141 We're investigating the corruption of SERP data from approx. 11:00 March 31st, 2024 until 09:00 April 1st. All systems are fully operational, however the data from this time period is unavailable.