The Greenhouse Recruitment application was unavailable for 4 minutes from 4:04pm EDT on April 21st 2016. This was due to issues that occurred during a routine deployment.
The Greenhouse Recruiting application was unavailable for a period of approximately 4 minutes. Other parts of the Greenhouse platform, such as Greenhouse Onboarding, Greenhouse Analytics and job boards hosted by Greenhouse or implemented using the Greenhouse Job Boards API were not affected and remained 100% available.
This disruption affected all of our customers using the Greenhouse Recruitment application. Job applicants browsing or applying to job postings on job boards hosted by Greenhouse or implemented using the Greenhouse Job Boards API were not affected.
Greenhouse Recruiting uses different data sources for different types of data. In order to facilitate this, we use a component dedicated to this purpose. We had slightly changed the way we use this component, which caused the new version of the application to crash when we deployed it to our production environment.
As soon as we were aware of the downtime, we rolled back to our previous release, bringing the application back online.
We have identified some changes that will enable us to better catch these types of issue in our pre-production environments, and will implementing them shortly.
We have also identified some additional monitoring that will alert us to this kind of misconfiguration and prevent us from deploying code that contains similar issues.
We take the availability of our software very seriously, and look forward to making changes to prevent this kind of downtime happening again.