Some Job Boards Not Loading

Incident Report for Greenhouse

Postmortem

Impact

On June 6th, 2016 from approximately 7PM-7:30PM we began to receive reports that job boards for a small subset of customers were behaving strangely. Affected customers would have seen one or more of the following behaviors:

  1. Job descriptions would not load above the application form
  2. A redirect loop prevented certain job board pages from loading

This issue affected a small number of customers whose job boards had been updated in the few hours preceding this incident.

Resolution

Our engineering team immediately began discovery efforts to isolate the issue, and were able to quickly switch back to an unaffected version of the job boards system.

The root cause of the incident was found to be a malformed API call between the job boards system and the main application. To prevent this class of issue from recurring, we will be implementing additional automated tests to validate that such API calls are well formed.

To those customers affected by this issue, we offer our sincere apologies for the disruption.

Posted Jan 10, 2016 - 18:27 UTC

Resolved

The issue has been resolved. We are investigating the root cause and will post a post-mortem once we have identified the issue.
Posted Jan 07, 2016 - 00:31 UTC

Investigating

We are investigating an issue affecting some customers which is preventing job boards from loading. We will post an update as soon as we have additional information.
Posted Jan 07, 2016 - 00:20 UTC