tag:status.defenseorchestrator.com,2005:/historyCisco - Cisco Defense Orchestrator Status - Incident History2024-03-19T08:49:03ZCisco - Cisco Defense Orchestratortag:status.defenseorchestrator.com,2005:Incident/201684262024-03-18T11:00:56Z2024-03-18T11:00:56ZScheduled Maintenance Notice for Cisco Defense Orchestrator in US region<p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>11:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>10:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>17:02</var> UTC</small><br><strong>Scheduled</strong> - Please be informed that Cisco Defense Orchestrator in US region will be undergoing a scheduled maintenance on:<br /><br />Date: Monday, March 18th<br />Time: 10AM - 11AM UTC <br /><br />During this maintenance window, the Cisco Defense Orchestrator service may face interruptions or be temporarily unavailable. We advise users to plan accordingly and refrain from scheduling any critical tasks that require the system during this time frame.<br /><br />Action Required:<br />Notify relevant teams and individuals within your organization about the planned downtime.<br />Reschedule any critical operations that may be affected by the service interruption.<br />For any additional details or updates, please visit the official Cisco website or reach out to Cisco support. Stay tuned for any communications from Cisco regarding changes to the maintenance schedule or scope.<br /><br />Though CDO will be unavailable during this maintenance window, the devices it manages will continue to manage network traffic and enforce security policies.<br />We apologize for any inconvenience this may cause and appreciate your understanding as we work to improve our services.</p>tag:status.defenseorchestrator.com,2005:Incident/201683942024-03-12T22:00:57Z2024-03-12T22:00:57ZScheduled Maintenance Notice for Cisco Defense Orchestrator in EU region<p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>22:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>21:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>17:00</var> UTC</small><br><strong>Update</strong> - We will be undergoing scheduled maintenance during this time.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>16:59</var> UTC</small><br><strong>Scheduled</strong> - Please be informed that Cisco Defense Orchestrator in EU region will be undergoing a scheduled maintenance on:<br /><br />Date: Tuesday, March 12th<br />Time: 9PM - 10PM UTC <br /><br />During this maintenance window, the Cisco Defense Orchestrator service may face interruptions or be temporarily unavailable. We advise users to plan accordingly and refrain from scheduling any critical tasks that require the system during this time frame.<br /><br />Action Required:<br />Notify relevant teams and individuals within your organization about the planned downtime.<br />Reschedule any critical operations that may be affected by the service interruption.<br />For any additional details or updates, please visit the official Cisco website or reach out to Cisco support. Stay tuned for any communications from Cisco regarding changes to the maintenance schedule or scope.<br /><br />Though CDO will be unavailable during this maintenance window, the devices it manages will continue to manage network traffic and enforce security policies.<br />We apologize for any inconvenience this may cause and appreciate your understanding as we work to improve our services.</p>tag:status.defenseorchestrator.com,2005:Incident/201683182024-03-11T20:00:57Z2024-03-11T20:00:57ZScheduled Maintenance Notice for Cisco Defense Orchestrator in APJ region<p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>20:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>19:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>16:50</var> UTC</small><br><strong>Scheduled</strong> - Please be informed that Cisco Defense Orchestrator in APJ region will be undergoing a scheduled maintenance on:<br /><br />Date: Monday, March 11th<br />Time: 7PM - 8PM UTC <br /><br />During this maintenance window, the Cisco Defense Orchestrator service may face interruptions or be temporarily unavailable. We advise users to plan accordingly and refrain from scheduling any critical tasks that require the system during this time frame.<br /><br />Action Required:<br />Notify relevant teams and individuals within your organization about the planned downtime.<br />Reschedule any critical operations that may be affected by the service interruption.<br />For any additional details or updates, please visit the official Cisco website or reach out to Cisco support. Stay tuned for any communications from Cisco regarding changes to the maintenance schedule or scope.<br /><br />Though CDO will be unavailable during this maintenance window, the devices it manages will continue to manage network traffic and enforce security policies.<br />We apologize for any inconvenience this may cause and appreciate your understanding as we work to improve our services.</p>tag:status.defenseorchestrator.com,2005:Incident/191550532023-11-17T23:08:56Z2023-11-17T23:08:56ZCDO production US region is having user login issues<p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>23:08</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>23:08</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>22:00</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>21:59</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>21:31</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.defenseorchestrator.com,2005:Incident/186325522023-09-28T15:44:21Z2023-09-28T15:44:21ZIntermittent loading issues with some UI pages<p><small>Sep <var data-var='date'>28</var>, <var data-var='time'>15:44</var> UTC</small><br><strong>Resolved</strong> - The issue has been identified and resolved</p><p><small>Sep <var data-var='date'>28</var>, <var data-var='time'>14:16</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating issues with loading some of the UI pages. We recommend clearing browser cache if you see the UI pages not loading.</p>tag:status.defenseorchestrator.com,2005:Incident/184211832023-09-07T12:36:03Z2023-09-07T12:36:03ZCisco Defense Orchestrator in EU (https://defenseorchestrator.eu) is facing login issues<p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>12:36</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>12:34</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>12:20</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>12:19</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.defenseorchestrator.com,2005:Incident/175649632023-06-13T23:20:51Z2023-06-13T23:20:51ZCDO Event Viewer Services<p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>23:20</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>21:04</var> UTC</small><br><strong>Monitoring</strong> - A cloud provider outage is currently impacting the CDO event viewer services.</p>tag:status.defenseorchestrator.com,2005:Incident/166979592023-03-30T13:51:43Z2023-03-30T13:51:43ZThis incident has been resolved and now it is possible to use Multi-Tenant Portals normally.<p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>13:51</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>13:19</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>13:19</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>13:18</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>13:16</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.defenseorchestrator.com,2005:Incident/91427982022-01-22T17:35:11Z2022-01-22T17:35:11ZAPJ certificate is expired.<p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>17:35</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>16:58</var> UTC</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>16:58</var> UTC</small><br><strong>Identified</strong> - APJ certificate is expired. We are fixing it now. CDO APJ is up otherwise.</p>tag:status.defenseorchestrator.com,2005:Incident/88552602021-12-15T16:19:22Z2021-12-15T16:19:22ZGeneral access issues<p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>16:19</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>15:59</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>15:48</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.<br />https://status.aws.amazon.com/ shows issues in Oregon and N. California regions</p>tag:status.defenseorchestrator.com,2005:Incident/87861272021-12-08T01:34:26Z2021-12-08T01:34:26ZFTD communication issues CDO US region<p><small>Dec <var data-var='date'> 8</var>, <var data-var='time'>01:34</var> UTC</small><br><strong>Resolved</strong> - Issue was resolved around 6:30 EST.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>21:19</var> UTC</small><br><strong>Identified</strong> - SSE service is the communication layer that is used by CDO to talk to FTDs. SSE got impacted by the AWS outage in us-east-1, as soon as the issue is resolved on AWS side, things should be backup and running.<br /><br />SSE incident - https://status.sse.security.cisco.com/incidents/qkxvzhq7ldgc</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>21:17</var> UTC</small><br><strong>Investigating</strong> - FTD devices onboarded through registration mode and serial onboarding are impacted. Customers will not be able to communicate with their FTD's onboarded through serial or registration mode in US region. <br />Root cause for this has been identified as an outage in AWS us-east-1 region.</p>tag:status.defenseorchestrator.com,2005:Incident/82210022021-10-13T19:29:36Z2021-10-13T19:29:36ZPartial degradation in FTD connectivity in CDO (EU)<p><small>Oct <var data-var='date'>13</var>, <var data-var='time'>19:29</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>13</var>, <var data-var='time'>18:44</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Oct <var data-var='date'>13</var>, <var data-var='time'>17:34</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating an issue with FTD connectivity that affects devices onboarded via registration token/serial number.</p>tag:status.defenseorchestrator.com,2005:Incident/77390422021-08-12T04:00:35Z2021-08-12T04:00:36ZFTD maintenance window<p><small>Aug <var data-var='date'>12</var>, <var data-var='time'>04:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Aug <var data-var='date'>12</var>, <var data-var='time'>03:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Aug <var data-var='date'>11</var>, <var data-var='time'>15:46</var> UTC</small><br><strong>Scheduled</strong> - On Wednesday 8/12 , 03:00 UTC / * PM PDT (8 PM PDT) there will be a one hour maintenance window were it is expected to be a disruption in the management of FTD devices onboarded using serial number or token onboarding. Any other devices won't be affected by this.</p>tag:status.defenseorchestrator.com,2005:Incident/77216252021-08-11T04:00:34Z2021-08-11T04:00:34ZFTD maintenance window<p><small>Aug <var data-var='date'>11</var>, <var data-var='time'>04:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Aug <var data-var='date'>11</var>, <var data-var='time'>03:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Aug <var data-var='date'> 9</var>, <var data-var='time'>16:33</var> UTC</small><br><strong>Update</strong> - We will be undergoing scheduled maintenance during this time.</p><p><small>Aug <var data-var='date'> 9</var>, <var data-var='time'>16:31</var> UTC</small><br><strong>Scheduled</strong> - On Wednesday 8/11 , 03:00 UTC / * PM PDT (8 PM PDT) there will be a one hour maintenance window were it is expected to be a disruption in the management of FTD devices onboarded using serial number or token onboarding. Any other devices won't be affected by this.</p>tag:status.defenseorchestrator.com,2005:Incident/74933502021-07-13T13:56:15Z2021-07-13T13:56:15ZEU defenseorchestrator is down<p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>13:56</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>13:56</var> UTC</small><br><strong>Monitoring</strong> - Fix has been identified and implemented</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>13:46</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>13:46</var> UTC</small><br><strong>Update</strong> - We identified the issue on AWS side and are working a work around</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>13:05</var> UTC</small><br><strong>Investigating</strong> - AWS EU Zone has issues with EC2 instances, EU CDO is down because of this.</p>tag:status.defenseorchestrator.com,2005:Incident/70049692021-05-15T01:35:32Z2021-05-15T01:35:32ZDevice Communication Issues<p><small>May <var data-var='date'>15</var>, <var data-var='time'>01:35</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>May <var data-var='date'>14</var>, <var data-var='time'>21:00</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>May <var data-var='date'>14</var>, <var data-var='time'>20:04</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>May <var data-var='date'>14</var>, <var data-var='time'>19:49</var> UTC</small><br><strong>Investigating</strong> - We are currently experiencing issues in our device communication service. We are currently investigating.</p>tag:status.defenseorchestrator.com,2005:Incident/70045902021-05-14T19:34:25Z2021-05-14T19:34:25ZDevice Communication Issue (US region only)<p><small>May <var data-var='date'>14</var>, <var data-var='time'>19:34</var> UTC</small><br><strong>Resolved</strong> - The issue has been resolved. One our queuing services was in a bad a state requiring a restart. All services are now operational.</p><p><small>May <var data-var='date'>14</var>, <var data-var='time'>18:42</var> UTC</small><br><strong>Investigating</strong> - We are currently experiencing issues in our device communication service. We are currently investigating.</p>tag:status.defenseorchestrator.com,2005:Incident/56541392020-11-26T03:43:38Z2020-11-26T03:43:38ZIntermittent Login Issues and communication to FTD token onboarded devices<p><small>Nov <var data-var='date'>26</var>, <var data-var='time'>03:43</var> UTC</small><br><strong>Resolved</strong> - All services are now operational.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>16:57</var> UTC</small><br><strong>Update</strong> - All events for security and analytics offering are impacted at this time.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>16:27</var> UTC</small><br><strong>Update</strong> - We have also identified intermittent issues communicating to FTD token onboarded devices.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>16:09</var> UTC</small><br><strong>Update</strong> - The issue seems intermittent at this time. Occasional logins to your account may work.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>15:50</var> UTC</small><br><strong>Identified</strong> - We are currently experiencing login issues in CDO (US) due to a backend system utilizing AWS Kinesis having issues. You can see https://status.aws.amazon.com/ for more information.</p>tag:status.defenseorchestrator.com,2005:Incident/48536582020-08-14T15:19:05Z2020-08-14T15:19:05ZCisco Defense Orchestrator is currently experiencing issues<p><small>Aug <var data-var='date'>14</var>, <var data-var='time'>15:19</var> UTC</small><br><strong>Resolved</strong> - Cisco Defense Orchestrator is healthy and operational. No data loss occurred during this incident and we apologize for any inconvenience this may have caused to your operations. We will be assessing the root cause to determine proper action going forward.</p><p><small>Aug <var data-var='date'>14</var>, <var data-var='time'>14:12</var> UTC</small><br><strong>Identified</strong> - We have identified the issue and the system is up but in a degraded state. You may experience login or performance issues while the system is trying to get back to normal. We will post a message when the system has fully recovered.</p><p><small>Aug <var data-var='date'>14</var>, <var data-var='time'>13:11</var> UTC</small><br><strong>Investigating</strong> - Cisco Defense Orchestrator is currently experiencing issues. We are investigating the issue and working hard to restore the system to a healthy state.</p>tag:status.defenseorchestrator.com,2005:Incident/18205102018-07-19T01:26:43Z2018-07-19T01:28:07ZLogin Issues (CDO EU)<p><small>Jul <var data-var='date'>19</var>, <var data-var='time'>01:26</var> UTC</small><br><strong>Resolved</strong> - We discovered some issues with our queue service causing the system to be down. We have recovered the services and the system is back to operational.</p><p><small>Jul <var data-var='date'>19</var>, <var data-var='time'>01:08</var> UTC</small><br><strong>Investigating</strong> - We are currently experiencing issues preventing login from working in our Cisco Defense Orchestrator (EU) environment. We are actively investigating the issue.</p>