GOV.UK Platform as a Service (PaaS)
All Systems Operational

About This Site

Overview of the current status of GOV.UK PaaS, including updates on any active incidents.

Updates on new features are provided through the paas-announce mailing list. If you're unable to subscribe to a googlegroup with your work address, please email GOV.UK PaaS support to be added.

HTTPS availability - between tenant apps and end users   ? Operational
Database service - availability for tenants   ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
PaaS HTTPS Uptime (from a sample Application)
Fetching
PaaS Database Uptime (from a sample Application)
Fetching
Past Incidents
May 26, 2018

No incidents reported today.

May 25, 2018
Resolved - This incident has been resolved.
May 25, 09:19 UTC
Update - Hello,

We are still working to resolve the problem with using Docker images on GOV.UK PaaS, where files deleted during the Docker build process are still visible in the filesystem, but any attempts to access the underlying file cause an error.

Since our last update, the upstream fix to the Cloud Foundry platform, has been released, and we are implementing an upgrade to resolve the problem.

If you are experiencing similar issues using Docker with your applications and you think it might be due to this issue, please contact us via gov-uk-paas-support@digital.cabinet-office.gov.uk and let us know.


We’ll let you know as soon as the problem has been resolved.


Regards,

Urmi Shah, Delivery Manager
GOV.UK PaaS team
May 23, 15:35 UTC
Update - We are continuing to work on the problem with using Docker images on GOV.UK PaaS, where files deleted during the Docker build process are still visible in the filesystem, but any attempts to access the underlying file cause an error.

We are waiting for confirmation of when the upstream fix in the Cloud Foundry platform will be available. Once this is available in a release, we will apply it. We will update you as soon as we learn more.

If you are experiencing issues using Docker with your applications and you think it might be due to this issue, please contact us via gov-uk-paas-support@digital.cabinet-office.gov.uk and let us know.
May 17, 13:49 UTC
Identified - Hello,

We have an update on the problem with using Docker images on GOV.UK PaaS, where files deleted during the Docker build process are still visible in the filesystem, but any attempts to access the underlying file cause an error.

There has been an upstream fix applied in the Cloud Foundry platform. Once this is available in a release, we will apply it. We will update you as soon as we learn more. We have downgraded this to a P4 issue as it not impacting any tenant apps or end users.

If you are experiencing issues using Docker with your applications and you think it might be due to this issue, please contact us via gov-uk-paas-support@digital.cabinet-office.gov.uk and let us know.


Regards,
Urmi Shah, Delivery Manager
The GOV.UK PaaS team
May 16, 09:58 UTC
Investigating - Hello,

We are still working to resolve the problem with using Docker images on GOV.UK PaaS, where files deleted during the Docker build process are still visible in the filesystem, but any attempts to access the underlying file cause an error.

Since our last update, the upstream fix to the Cloud Foundry platform, has been identified, and is in progress.

If you are experiencing similar issues using Docker with your applications and you think it might be due to this issue, please contact us via gov-uk-paas-support@digital.cabinet-office.gov.uk and let us know.


We’ll continue to update you as we know more, and we’ll let you know as soon as the problem has been resolved.


Regards,

Urmi Shah, Delivery Manager
GOV.UK PaaS team
May 15, 09:35 UTC
Identified - Hello,

We are aware of and are investigating a problem with using Docker images on GOV.UK PaaS. We have identified a regression in a component responsible for deploying Docker images to the platform. Some applications using Docker may be experiencing problems that affect end users.

Files deleted during the Docker build process are still visible in the filesystem, but any attempts to access the underlying file will cause an error.

If you are experiencing similar issues using Docker with your applications and you think it might be due to this issue, please contact us via gov-uk-paas-support@digital.cabinet-office.gov.uk and let us know.

To address this issue, we have documented the problem and are waiting for an upstream fix to the Cloud Foundry platform, which is in process. We will update you as soon as we learn more.

Regards,

The GOV.UK PaaS team
May 14, 11:17 UTC
May 24, 2018

No incidents reported.

May 22, 2018

No incidents reported.

May 21, 2018

No incidents reported.

May 20, 2018

No incidents reported.

May 19, 2018

No incidents reported.

May 18, 2018

No incidents reported.

May 17, 2018
Resolved - Hello,

We’ve resolved the issue that affected GOV.UK PaaS today, and full service has been restored to development and production applications running on the platform.

Some users were unable to unbind Postgres or MySQL databases from apps.
We have applied a patch to our rds-broker which means that users are no longer affected by this issue.

We’ll now start looking into why and how this happened. In the coming days, we’ll publish an incident report describing the timelines of the event, root cause of the problem, lessons we’ve learned and actions we’ll take to ensure it doesn’t happen again.

I’m sorry for the impact that this has had on your users and the service you provide, and the problems this has caused for your team.

The quickest way to get help using the platform is to email us via gov-uk-paas-support@digital.cabinet-office.gov.uk. To let us know how this incident has affected you, please contact the GOV.UK PaaS product managers: ben.andrews@digital.cabinet-office.gov.uk and jessica.o’leary@digital.cabinet-office.gov.uk.

Regards,

Urmi Shah
GOV.UK PaaS team
May 17, 11:59 UTC
Identified - Hello,

We are actively working on the issue with unbinding existing Postgres or MySQL databases.

We have established that this will affect the unbinding of most existing Postgres or MySQL databases, but will not affect new bindings (and unbindings which follow this). We are working on a fix and will let you know as soon as we have applied it

- this should not affect the availability of your service
- this means that until the fix is applied, you may not be able to unbind Postgres or MySQL databases from apps

Fixing this issue is our priority - we know that this may have impacted on the service you provide and we’re doing everything we can to resolve it as quickly as possible.

We’ll continue to update you as we know more, and we’ll let you know as soon as the problem has been resolved.

We’re sorry for the inconvenience that this has caused to your users and your team.

If you need to contact us for help or anything else, please email us via gov-uk-paas-support@digital.cabinet-office.gov.uk

Regards,

Urmi Shah
GOV.UK PaaS team
May 17, 09:59 UTC
Update - Hello,

We are aware of and investigating a problem with GOV.UK PaaS.

Some users are reporting issues with unbinding MySQL and Postgres databases. We think this might also affect binding databases to apps.

We’re looking into this as a matter of urgency and will update you as soon as we know more.

Regards,

Urmi Shah
GOV.UK PaaS team
May 17, 09:41 UTC
Update - We are continuing to investigate this issue.
May 17, 09:25 UTC
Investigating - Hello,

We’re investigating a possible problem with GOV.UK PaaS.

A problem has been reported and we’re investigating whether it’s an issue with the platform or with certain services/apps running on it, and whether or not end users are affected.

If your service is experiencing problems and you think it might be related to this issue, please email us via gov-uk-paas-support@digital.cabinet-office.gov.uk.

We will update you as soon as we know more.

Regards,

Urmi Shah
GOV.UK PaaS team
May 17, 09:21 UTC
May 16, 2018
Resolved - Hello,

We’ve resolved the issue that affected GOV.UK PaaS today, and full service has been restored to development and production applications running on the platform.

The issue was that some services could have experienced failures if they tried to bind an RDS database which already existed (MySQL or Postgres), to an app that it was not previously bound to.

We have tested and applied a fix to the platform.

In the coming days, we’ll publish an incident report describing the timelines of the event, root cause of the problem, lessons we’ve learned and actions we’ll take to ensure it doesn’t happen again.

We are not aware of any services which have been impacted, I'm sorry if there has been an impact on your users and the service you provide, and the problems this has caused for your team.

The quickest way to get help using the platform is to email us via gov-uk-paas-support@digital.cabinet-office.gov.uk. To let us know how this incident has affected you, please contact the GOV.UK PaaS product managers: ben.andrews@digital.cabinet-office.gov.uk and jessica.o’leary@digital.cabinet-office.gov.uk.

Regards,

Urmi Shah, Delivery Manager
GOV.UK PaaS team
May 16, 14:45 UTC
Update - Hello,

Hello,

We are aware of and investigating a problem with GOV.UK PaaS.

There is an issue which could affect users of your service. Some services will experience failures if you try to bind an RDS database which already exists (MySQL or postgres), to an app that it was not previously bound to.

We have identified a fix, and will update you as soon as we know more.

Regards,

Urmi Shah, Delivery Manager
GOV.UK PaaS team
May 16, 13:51 UTC
Investigating - Hello,

We’re investigating a possible problem with GOV.UK PaaS.

A problem has been reported and we’re investigating whether it’s an issue with the platform or with certain services/apps running on it, and whether or not end users are affected.

If your service is experiencing problems and you think it might be related to this issue, please email us via gov-uk-paas-support@digital.cabinet-office.gov.uk.

We will update you as soon as we know more.

Regards,

Urmi Shah
GOV.UK PaaS team
May 16, 13:37 UTC
May 13, 2018

No incidents reported.

May 12, 2018

No incidents reported.