GOV.UK Platform as a Service (PaaS)
All Systems Operational

About This Site

Overview of the current status of GOV.UK PaaS, including updates on any active incidents.

Updates on new features are provided through the paas-announce mailing list. If you're unable to subscribe to a googlegroup with your work address, please email GOV.UK PaaS support to be added.

Apps - availability of tenant applications to end users   ? Operational
API - availability of the Cloud Foundry API to tenants   Operational
Postgres Backing service - availability of platform-provided services   ? Operational
MySQL Backing service - availability of platform-provided services   ? Operational
Redis Elasticache Backing service - availability of platform-provided services   ? Operational
Logging - availability of app logs to external logging services   Operational
Docker (experimental feature)   ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Past Incidents
Aug 14, 2018
Resolved - This incident has been resolved.
Aug 14, 09:15 UTC
Update - All the HA instances are running on full redundancy now.
Aug 13, 11:24 UTC
Identified - Hello,

We have identified an issue affecting a number of RDS (mysql and postgres) instances provisioned by GOV.UK PaaS.

A small number of postgres and mysql instances that should be running in a highly available (HA) configuration are currently running with a reduced level of redundancy until this issue is resolved.

All RDS master instances are operating correctly, and we do not expect this to impact tenant services.

If your service is experiencing problems and you think it might be related to this issue, please email us via gov-uk-paas-support@digital.cabinet-office.gov.uk.

We will update you as soon as we have resolved the issue.

Regards,

GOV.UK PaaS team
Aug 10, 16:39 UTC
Aug 12, 2018

No incidents reported.

Aug 11, 2018

No incidents reported.

Aug 9, 2018

No incidents reported.

Aug 8, 2018

No incidents reported.

Aug 7, 2018

No incidents reported.

Aug 6, 2018

No incidents reported.

Aug 5, 2018

No incidents reported.

Aug 4, 2018

No incidents reported.

Aug 3, 2018

No incidents reported.

Aug 2, 2018

No incidents reported.

Aug 1, 2018
Resolved - Hello,

We’ve resolved the issue that affected GOV.UK PaaS today, and full service has been restored to development and production applications running on the platform.

The routers in the production environment exhausted their available memory, causing them to provide a degraded service. Eventually the processes were stopped by the out-of-memory killer. Once all of the routers had restarted normal service was restored.

Tenant applications experienced slow responses and occasional 502 (bad gateway) http errors. These will have been visible to end users. The incident lasted ~5.5 hours (from 04:45 to 10:22).

We’ll now start looking into why and how this happened. In the coming days, we’ll publish an incident report describing the timelines of the event, root cause of the problem, lessons we’ve learned and actions we’ll take to ensure it doesn’t happen again.

I’m sorry for the impact that this has had on your users and the service you provide, and the problems this has caused for your team.

The quickest way to get help using the platform is to email us via gov-uk-paas-support@digital.cabinet-office.gov.uk. To let us know how this incident has affected you, please contact the GOV.UK PaaS product manager: ben.andrews@digital.cabinet-office.gov.uk.

Regards,

Richard Towers,
Developer,
GOV.UK PaaS team
Aug 1, 12:30 UTC
Monitoring - We identified that some of our routers had exhausted their allocated memory. The operating systems out-of-memory killer eventually killed the routers, causing them to restart. During this time users will have experienced slow requests.

We expect apps and API to be performing normally again now. We will continue to monitor the situation.

If your service is continuing to experience problems and you think it might be related to this issue, please email us via gov-uk-paas-support@digital.cabinet-office.gov.uk.
Aug 1, 10:34 UTC
Investigating - Hello,

We’re investigating a possible problem with GOV.UK PaaS.

A problem has been reported and we’re investigating whether it’s an issue with the platform or with certain services/apps running on it, and whether or not end users are affected.

If your service is experiencing problems and you think it might be related to this issue, please email us via gov-uk-paas-support@digital.cabinet-office.gov.uk.

We will update you as soon as we know more.

Regards,

Richard Towers
GOV.UK PaaS team
Aug 1, 09:57 UTC
Jul 31, 2018

No incidents reported.