tag:status.joinhomebase.com,2005:/historyHomebase Status - Incident History2024-03-28T08:47:22-07:00Homebasetag:status.joinhomebase.com,2005:Incident/186495032023-10-01T02:30:41-07:002023-10-01T02:30:41-07:00Database Upgrade<p><small>Oct <var data-var='date'> 1</var>, <var data-var='time'>02:30</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'> 1</var>, <var data-var='time'>00:30</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>30</var>, <var data-var='time'>02:00</var> PDT</small><br><strong>Scheduled</strong> - On [10/1], we’ve scheduled some updates to make things run smoother for all teams. Homebase services will not be available from 3:30 AM to 5:30 AM EDT.</p>tag:status.joinhomebase.com,2005:Incident/166721692023-03-27T21:00:00-07:002023-03-27T22:38:39-07:00Elevated error rates across multiple endpoints<p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>21:00</var> PDT</small><br><strong>Resolved</strong> - From 9:05 PM PT - 10:04 PM PT there were elevated error rates across multiple endpoints, resulting in some pages and parts of the web and mobile applications failing to load. Most of the errors happened between 9:05 - 9:08, but there was a long tail of lower error rates afterward. The incident was fully resolved at 10:04 PM PT.</p>tag:status.joinhomebase.com,2005:Incident/108466312022-08-17T10:18:37-07:002022-08-17T10:18:37-07:00Payroll Companies cannot add new employees correctly for payroll.<p><small>Aug <var data-var='date'>17</var>, <var data-var='time'>10:18</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved as of 1:12pm ET / 10:12am PT.</p><p><small>Aug <var data-var='date'>17</var>, <var data-var='time'>09:21</var> PDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Aug <var data-var='date'>17</var>, <var data-var='time'>09:19</var> PDT</small><br><strong>Investigating</strong> - Our partner is investigating an issue affecting some customers to create employees when the employee country field is not properly populated.</p>tag:status.joinhomebase.com,2005:Incident/106555372022-07-20T13:02:13-07:002022-07-20T13:02:13-07:00Payroll - Degraded Performance<p><small>Jul <var data-var='date'>20</var>, <var data-var='time'>13:02</var> PDT</small><br><strong>Resolved</strong> - Issue resolved.</p><p><small>Jul <var data-var='date'>20</var>, <var data-var='time'>12:59</var> PDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Jul <var data-var='date'>20</var>, <var data-var='time'>12:58</var> PDT</small><br><strong>Investigating</strong> - Our payroll partner is currently experiencing degraded performance. We are investigating.</p>tag:status.joinhomebase.com,2005:Incident/105536302022-07-13T01:45:41-07:002022-07-13T01:45:41-07:00Database Maintenance<p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>01:45</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>01:15</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'>12</var>, <var data-var='time'>09:44</var> PDT</small><br><strong>Scheduled</strong> - We will be undergoing scheduled database maintenance at this time.</p>tag:status.joinhomebase.com,2005:Incident/88552032021-12-15T09:19:26-08:002021-12-15T09:19:26-08:00AWS outage<p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>09:19</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>08:10</var> PST</small><br><strong>Monitoring</strong> - AWS reports that a fix has been made, and we're seeing performance go back to normal. We're continuing to monitor.</p><p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>07:47</var> PST</small><br><strong>Identified</strong> - An outage with AWS is causing widespread issues across the internet, including Homebase's services.</p>tag:status.joinhomebase.com,2005:Incident/90652262021-12-07T14:00:00-08:002022-01-12T09:33:07-08:00AWS Outage<p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>14:00</var> PST</small><br><strong>Resolved</strong> - AWS Region US-EAST-1 outage affecting payroll</p>tag:status.joinhomebase.com,2005:Incident/87283592021-12-04T03:00:30-08:002021-12-04T03:00:30-08:00Database upgrade<p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>03:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>01:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>15:55</var> PST</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance on our database during this time. All systems will be offline for the duration of this operation.</p>tag:status.joinhomebase.com,2005:Incident/68746252021-04-29T13:39:16-07:002021-04-29T13:39:16-07:00No application access<p><small>Apr <var data-var='date'>29</var>, <var data-var='time'>13:39</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Apr <var data-var='date'>29</var>, <var data-var='time'>13:06</var> PDT</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.joinhomebase.com,2005:Incident/62626372021-02-13T11:30:58-08:002021-02-13T11:30:58-08:00System-wide outage<p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>11:30</var> PST</small><br><strong>Resolved</strong> - The incident has been resolved.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>11:24</var> PST</small><br><strong>Monitoring</strong> - A fix has been implemented and we're monitoring the results</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>11:15</var> PST</small><br><strong>Identified</strong> - We've identified the issue and are working on a fix.</p>tag:status.joinhomebase.com,2005:Incident/46442932020-07-17T14:58:24-07:002020-07-17T14:58:24-07:00DNS issues affecting site<p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>14:58</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>14:32</var> PDT</small><br><strong>Investigating</strong> - We've identified a DNS issue from a downstream provider that is affecting many websites across the internet, ours included. This may result in slow response times, or pages failing to load entirely.</p>tag:status.joinhomebase.com,2005:Incident/38428452020-04-12T02:53:40-07:002020-04-12T02:53:40-07:00Database maintenance<p><small>Apr <var data-var='date'>12</var>, <var data-var='time'>02:53</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Apr <var data-var='date'>12</var>, <var data-var='time'>01:20</var> PDT</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Apr <var data-var='date'>12</var>, <var data-var='time'>00:00</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Apr <var data-var='date'> 6</var>, <var data-var='time'>13:15</var> PDT</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance on our database during this time.</p>tag:status.joinhomebase.com,2005:Incident/34106502020-01-14T23:39:45-08:002020-01-14T23:39:45-08:00Update Database SSL Certificates<p><small>Jan <var data-var='date'>14</var>, <var data-var='time'>23:39</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>14</var>, <var data-var='time'>23:30</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>15:51</var> PST</small><br><strong>Scheduled</strong> - We will be undergoing a scheduled database certificate update operation during this time.</p>tag:status.joinhomebase.com,2005:Incident/32557612019-11-26T01:00:53-08:002019-11-26T01:00:53-08:00Database upgrade<p><small>Nov <var data-var='date'>26</var>, <var data-var='time'>01:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>22:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>16:32</var> PST</small><br><strong>Scheduled</strong> - We will be undergoing a scheduled database upgrade during this time</p>tag:status.joinhomebase.com,2005:Incident/31536872019-10-28T14:46:33-07:002019-10-28T14:46:33-07:00Customers seeing 404 errors and site slowness<p><small>Oct <var data-var='date'>28</var>, <var data-var='time'>14:46</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>28</var>, <var data-var='time'>13:05</var> PDT</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.joinhomebase.com,2005:Incident/31329862019-10-22T22:29:37-07:002019-10-22T22:29:37-07:00DNS outage affecting some users<p><small>Oct <var data-var='date'>22</var>, <var data-var='time'>22:29</var> PDT</small><br><strong>Resolved</strong> - Amazon Web Services has reported that the DNS issue they were experiencing earlier has been resolved. We'll continue monitoring for issues but expect things to be back to normal.</p><p><small>Oct <var data-var='date'>22</var>, <var data-var='time'>16:17</var> PDT</small><br><strong>Identified</strong> - The hosting provider we use, Amazon Web Services, is currently experiencing an intermittent outage with DNS resolution. <br /><br />This is impacting some users on mobile devices with error messages such as "A server with the specified hostname could not be found", and some users on the web with error messages such as "This site can't be reached".<br /><br />We're waiting for Amazon Web Services to resolve the issue.</p>tag:status.joinhomebase.com,2005:Incident/30286982019-09-23T15:00:56-07:002019-09-23T15:01:07-07:00Elevated error rate<p><small>Sep <var data-var='date'>23</var>, <var data-var='time'>15:00</var> PDT</small><br><strong>Resolved</strong> - The incident has been resolved. We apologize for the disruption and thank you for your patience.</p><p><small>Sep <var data-var='date'>23</var>, <var data-var='time'>15:00</var> PDT</small><br><strong>Investigating</strong> - We have resolved the issue with elevated error rates. We apologize or any disruption this has caused.</p><p><small>Sep <var data-var='date'>23</var>, <var data-var='time'>14:25</var> PDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Sep <var data-var='date'>23</var>, <var data-var='time'>14:08</var> PDT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p>