Incidents | Lanelink Incidents reported on status page for Lanelink https://status.gobwlng.uk/ en Dashboard recovered https://status.gobwlng.uk/ Thu, 11 Dec 2025 01:28:59 +0000 https://status.gobwlng.uk/#46b363b2b8dc7a8e77cf0b23b08793583809fb02fe5999d017bb2bc4f88730e2 Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Thu, 11 Dec 2025 01:22:57 +0000 https://status.gobwlng.uk/#46b363b2b8dc7a8e77cf0b23b08793583809fb02fe5999d017bb2bc4f88730e2 Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Thu, 11 Dec 2025 00:58:59 +0000 https://status.gobwlng.uk/#bb47e34f233278b622ac6191511202c3e25d66393b8edbb3b98e2eb44e8a2fbe Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Thu, 11 Dec 2025 00:52:59 +0000 https://status.gobwlng.uk/#bb47e34f233278b622ac6191511202c3e25d66393b8edbb3b98e2eb44e8a2fbe Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Thu, 11 Dec 2025 00:13:58 +0000 https://status.gobwlng.uk/#0ac2dcdba29284f2b6994ccfcff6a88391c15e2d632b28b6aed2debf9495c29d Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Thu, 11 Dec 2025 00:07:56 +0000 https://status.gobwlng.uk/#0ac2dcdba29284f2b6994ccfcff6a88391c15e2d632b28b6aed2debf9495c29d Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 23:31:58 +0000 https://status.gobwlng.uk/#1f958fc794d54c41a8f641188b91ecf898c1ace860a3e28df59d7d4bcc44f553 Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 23:25:59 +0000 https://status.gobwlng.uk/#1f958fc794d54c41a8f641188b91ecf898c1ace860a3e28df59d7d4bcc44f553 Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 22:34:59 +0000 https://status.gobwlng.uk/#cb139e959f892fb3a29e6fc3560602ab8f0e80b3f43868a621e0479d46da49c9 Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 22:19:57 +0000 https://status.gobwlng.uk/#cb139e959f892fb3a29e6fc3560602ab8f0e80b3f43868a621e0479d46da49c9 Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 22:10:59 +0000 https://status.gobwlng.uk/#d72a62db5fd03f8d220126fa90cbf793907cdd96a373f5058d5427141ee48bda Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 22:04:58 +0000 https://status.gobwlng.uk/#d72a62db5fd03f8d220126fa90cbf793907cdd96a373f5058d5427141ee48bda Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 21:16:59 +0000 https://status.gobwlng.uk/#fd0093db6b1033a67c9e70066ce5ddce3d11501e313bb194637989db647e079c Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 21:11:03 +0000 https://status.gobwlng.uk/#fd0093db6b1033a67c9e70066ce5ddce3d11501e313bb194637989db647e079c Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 20:58:57 +0000 https://status.gobwlng.uk/#d01f059856b895d3d0c641d9445ae82468c627aa81f1ca64c0b5c0345ca98e7c Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 20:46:57 +0000 https://status.gobwlng.uk/#d01f059856b895d3d0c641d9445ae82468c627aa81f1ca64c0b5c0345ca98e7c Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 20:31:57 +0000 https://status.gobwlng.uk/#6ab16737cf5dd51c84ba0afb8780b6131da09982d04407e24731ea31abc23326 Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 20:19:54 +0000 https://status.gobwlng.uk/#6ab16737cf5dd51c84ba0afb8780b6131da09982d04407e24731ea31abc23326 Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 19:52:58 +0000 https://status.gobwlng.uk/#2c413f3de554b30eebd74f60d30cc4ec0653ab50bc5d9202419bc55f63d14a7d Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 19:46:56 +0000 https://status.gobwlng.uk/#2c413f3de554b30eebd74f60d30cc4ec0653ab50bc5d9202419bc55f63d14a7d Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 18:44:26 +0000 https://status.gobwlng.uk/#35d4e3e3ea7c9fb947c01c2197b8be4ce10af6224ec2ca74824e401dc1b24705 Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 18:40:55 +0000 https://status.gobwlng.uk/#35d4e3e3ea7c9fb947c01c2197b8be4ce10af6224ec2ca74824e401dc1b24705 Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 18:08:03 +0000 https://status.gobwlng.uk/#044c549bcc2114326c00b177f5c7023d03d847349a90cd3039c0055c74953aae Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 17:56:35 +0000 https://status.gobwlng.uk/#044c549bcc2114326c00b177f5c7023d03d847349a90cd3039c0055c74953aae Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 17:45:21 +0000 https://status.gobwlng.uk/#bd56b88edda9d6bd1c48742fbadbfc61c9fa04ce3390a4b7512917b09225708a Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 17:37:39 +0000 https://status.gobwlng.uk/#bd56b88edda9d6bd1c48742fbadbfc61c9fa04ce3390a4b7512917b09225708a Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 16:49:22 +0000 https://status.gobwlng.uk/#04622c455ded14d8c76ea7878a3230ae15b4e9899e45fa9e2482d01ae6f24bd6 Dashboard recovered Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 16:43:19 +0000 https://status.gobwlng.uk/#04622c455ded14d8c76ea7878a3230ae15b4e9899e45fa9e2482d01ae6f24bd6 Dashboard went down Dashboard recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 16:25:22 +0000 https://status.gobwlng.uk/#e923473cc2ea47463b93b9d4d156ce00a17b16a9338b5494fbd1125ab03a517f Dashboard recovered Authentication Service recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 16:19:27 +0000 https://status.gobwlng.uk/#0d6b8ca3992087bdf472ae4f26a9bdfcd79482fe8cab73db0c05cbe7321fb85b Authentication Service recovered Users Service recovered https://status.gobwlng.uk/ Wed, 10 Dec 2025 16:17:58 +0000 https://status.gobwlng.uk/#38ca4e4e33108562bc175bb021d901cec8c7253ac0aed55579d7ffa4e235df45 Users Service recovered Authentication Service went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 10:12:23 +0000 https://status.gobwlng.uk/#0d6b8ca3992087bdf472ae4f26a9bdfcd79482fe8cab73db0c05cbe7321fb85b Authentication Service went down Dashboard went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 10:11:54 +0000 https://status.gobwlng.uk/#e923473cc2ea47463b93b9d4d156ce00a17b16a9338b5494fbd1125ab03a517f Dashboard went down Users Service went down https://status.gobwlng.uk/ Wed, 10 Dec 2025 10:10:44 +0000 https://status.gobwlng.uk/#38ca4e4e33108562bc175bb021d901cec8c7253ac0aed55579d7ffa4e235df45 Users Service went down Authentication Service recovered https://status.gobwlng.uk/ Tue, 02 Dec 2025 06:54:32 +0000 https://status.gobwlng.uk/#899879867bc235e56b8bc814d2f1123bf97746bffb9c2dabeed231cfdced4b83 Authentication Service recovered Authentication Service went down https://status.gobwlng.uk/ Tue, 02 Dec 2025 06:48:35 +0000 https://status.gobwlng.uk/#899879867bc235e56b8bc814d2f1123bf97746bffb9c2dabeed231cfdced4b83 Authentication Service went down Authentication Service recovered https://status.gobwlng.uk/ Fri, 28 Nov 2025 16:53:15 +0000 https://status.gobwlng.uk/#a1d31a29173d58a034c4a4d0cf8f014c81229ab25d7659ba062a9f713df34caa Authentication Service recovered Authentication Service went down https://status.gobwlng.uk/ Fri, 28 Nov 2025 16:45:49 +0000 https://status.gobwlng.uk/#a1d31a29173d58a034c4a4d0cf8f014c81229ab25d7659ba062a9f713df34caa Authentication Service went down Instance Upgrades https://status.gobwlng.uk/incident/774259 Wed, 26 Nov 2025 02:00:08 -0000 https://status.gobwlng.uk/incident/774259#ce74510afb913a0c06a3933512ce585a93f13b7fad90cc6082106c0dabaf23f4 Maintenance completed Instance Upgrades https://status.gobwlng.uk/incident/774259 Wed, 26 Nov 2025 02:00:08 -0000 https://status.gobwlng.uk/incident/774259#ce74510afb913a0c06a3933512ce585a93f13b7fad90cc6082106c0dabaf23f4 Maintenance completed Instance Upgrades https://status.gobwlng.uk/incident/774259 Wed, 26 Nov 2025 02:00:08 -0000 https://status.gobwlng.uk/incident/774259#ce74510afb913a0c06a3933512ce585a93f13b7fad90cc6082106c0dabaf23f4 Maintenance completed Instance Upgrades https://status.gobwlng.uk/incident/774259 Wed, 26 Nov 2025 00:00:08 -0000 https://status.gobwlng.uk/incident/774259#34b73b1093e4bbd06df9bd922e0696adb70f46475cc4c5304a50b9a9e8903353 We are upgrading out K8's version. Nodes might be down during the upgrade Instance Upgrades https://status.gobwlng.uk/incident/774259 Wed, 26 Nov 2025 00:00:08 -0000 https://status.gobwlng.uk/incident/774259#34b73b1093e4bbd06df9bd922e0696adb70f46475cc4c5304a50b9a9e8903353 We are upgrading out K8's version. Nodes might be down during the upgrade Instance Upgrades https://status.gobwlng.uk/incident/774259 Wed, 26 Nov 2025 00:00:08 -0000 https://status.gobwlng.uk/incident/774259#34b73b1093e4bbd06df9bd922e0696adb70f46475cc4c5304a50b9a9e8903353 We are upgrading out K8's version. Nodes might be down during the upgrade Internal cluster failure https://status.gobwlng.uk/incident/754596 Sun, 02 Nov 2025 11:13:00 -0000 https://status.gobwlng.uk/incident/754596#95d1ea3ae65d79526f2ea92ed5f86ae88992525730928439ae30c6dec82b1ed6 Complete the fixes, backfilled all migrations We are back, sorry for the inconvenience caused Internal cluster failure https://status.gobwlng.uk/incident/754596 Sun, 02 Nov 2025 11:13:00 -0000 https://status.gobwlng.uk/incident/754596#95d1ea3ae65d79526f2ea92ed5f86ae88992525730928439ae30c6dec82b1ed6 Complete the fixes, backfilled all migrations We are back, sorry for the inconvenience caused Internal cluster failure https://status.gobwlng.uk/incident/754596 Sun, 02 Nov 2025 11:13:00 -0000 https://status.gobwlng.uk/incident/754596#95d1ea3ae65d79526f2ea92ed5f86ae88992525730928439ae30c6dec82b1ed6 Complete the fixes, backfilled all migrations We are back, sorry for the inconvenience caused Internal cluster failure https://status.gobwlng.uk/incident/754596 Sat, 01 Nov 2025 17:24:00 -0000 https://status.gobwlng.uk/incident/754596#708d8d2197af61b0b9e1d08d791fbbd48eab2642bcac1cab007cb549706ffa1f Due to changes in a build step, the decision was made to bring a beta branch into production. This is soon to be up and running, some database migrations and data backfils are needed to run. Projected 1 hour to complete Internal cluster failure https://status.gobwlng.uk/incident/754596 Sat, 01 Nov 2025 17:24:00 -0000 https://status.gobwlng.uk/incident/754596#708d8d2197af61b0b9e1d08d791fbbd48eab2642bcac1cab007cb549706ffa1f Due to changes in a build step, the decision was made to bring a beta branch into production. This is soon to be up and running, some database migrations and data backfils are needed to run. Projected 1 hour to complete Internal cluster failure https://status.gobwlng.uk/incident/754596 Sat, 01 Nov 2025 17:24:00 -0000 https://status.gobwlng.uk/incident/754596#708d8d2197af61b0b9e1d08d791fbbd48eab2642bcac1cab007cb549706ffa1f Due to changes in a build step, the decision was made to bring a beta branch into production. This is soon to be up and running, some database migrations and data backfils are needed to run. Projected 1 hour to complete Dashboard recovered https://status.gobwlng.uk/ Sat, 01 Nov 2025 16:54:25 +0000 https://status.gobwlng.uk/#a2ce148516833d93144cf1618edeb94430ed4892a81b642576912be5e9d2cdab Dashboard recovered Authentication Service recovered https://status.gobwlng.uk/ Thu, 30 Oct 2025 14:57:30 +0000 https://status.gobwlng.uk/#9470ee642e42628347cd195ef480a2b403b413cac4db7463f7c46c08a5b9e948 Authentication Service recovered Internal cluster failure https://status.gobwlng.uk/incident/754596 Thu, 30 Oct 2025 14:57:00 -0000 https://status.gobwlng.uk/incident/754596#4222fb872434dc25344f47675435f266216ff58455f1ca3187e67c59446c3a3a Accounts API is back up and running. Dashboard should be back within the next 10-15 minutes Internal cluster failure https://status.gobwlng.uk/incident/754596 Thu, 30 Oct 2025 14:57:00 -0000 https://status.gobwlng.uk/incident/754596#4222fb872434dc25344f47675435f266216ff58455f1ca3187e67c59446c3a3a Accounts API is back up and running. Dashboard should be back within the next 10-15 minutes Internal cluster failure https://status.gobwlng.uk/incident/754596 Thu, 30 Oct 2025 14:57:00 -0000 https://status.gobwlng.uk/incident/754596#4222fb872434dc25344f47675435f266216ff58455f1ca3187e67c59446c3a3a Accounts API is back up and running. Dashboard should be back within the next 10-15 minutes Users Service recovered https://status.gobwlng.uk/ Thu, 30 Oct 2025 14:37:22 +0000 https://status.gobwlng.uk/#f8421ae0ddfbd2fcdbf5fc2d04c104eebc42315d5dfd15429467b21fb013ff7e Users Service recovered Internal cluster failure https://status.gobwlng.uk/incident/754596 Thu, 30 Oct 2025 14:00:00 -0000 https://status.gobwlng.uk/incident/754596#34889b7c38a3b2659b78b07466e5dae3978f5f421ba0dfa6b190ce8a68177181 All services down due to unresolved updates within our cluster linked to bitnami. Helm charts were updated to handle the change to bitnamilegacy but were not implemented. During an K8s cluster update, when argocd span back up it propagated these changes, unbeknownst to us at the time the versions were not compaible with some dependencies. These have all been reciftied, and the images are being recreated to be re-deployed. Internal cluster failure https://status.gobwlng.uk/incident/754596 Thu, 30 Oct 2025 14:00:00 -0000 https://status.gobwlng.uk/incident/754596#34889b7c38a3b2659b78b07466e5dae3978f5f421ba0dfa6b190ce8a68177181 All services down due to unresolved updates within our cluster linked to bitnami. Helm charts were updated to handle the change to bitnamilegacy but were not implemented. During an K8s cluster update, when argocd span back up it propagated these changes, unbeknownst to us at the time the versions were not compaible with some dependencies. These have all been reciftied, and the images are being recreated to be re-deployed. Internal cluster failure https://status.gobwlng.uk/incident/754596 Thu, 30 Oct 2025 14:00:00 -0000 https://status.gobwlng.uk/incident/754596#34889b7c38a3b2659b78b07466e5dae3978f5f421ba0dfa6b190ce8a68177181 All services down due to unresolved updates within our cluster linked to bitnami. Helm charts were updated to handle the change to bitnamilegacy but were not implemented. During an K8s cluster update, when argocd span back up it propagated these changes, unbeknownst to us at the time the versions were not compaible with some dependencies. These have all been reciftied, and the images are being recreated to be re-deployed. Dashboard went down https://status.gobwlng.uk/ Wed, 29 Oct 2025 16:11:42 +0000 https://status.gobwlng.uk/#a2ce148516833d93144cf1618edeb94430ed4892a81b642576912be5e9d2cdab Dashboard went down Users Service went down https://status.gobwlng.uk/ Wed, 29 Oct 2025 16:11:04 +0000 https://status.gobwlng.uk/#f8421ae0ddfbd2fcdbf5fc2d04c104eebc42315d5dfd15429467b21fb013ff7e Users Service went down Authentication Service went down https://status.gobwlng.uk/ Wed, 29 Oct 2025 16:09:24 +0000 https://status.gobwlng.uk/#9470ee642e42628347cd195ef480a2b403b413cac4db7463f7c46c08a5b9e948 Authentication Service went down Instance Upgrades https://status.gobwlng.uk/incident/583123 Sat, 24 May 2025 15:00:11 -0000 https://status.gobwlng.uk/incident/583123#e53b85c58204351cb9c7a285a6aed8caad14da3c76ed47349846bca5d2bd1414 Maintenance completed Instance Upgrades https://status.gobwlng.uk/incident/583123 Sat, 24 May 2025 15:00:11 -0000 https://status.gobwlng.uk/incident/583123#e53b85c58204351cb9c7a285a6aed8caad14da3c76ed47349846bca5d2bd1414 Maintenance completed Instance Upgrades https://status.gobwlng.uk/incident/583123 Sat, 24 May 2025 15:00:11 -0000 https://status.gobwlng.uk/incident/583123#e53b85c58204351cb9c7a285a6aed8caad14da3c76ed47349846bca5d2bd1414 Maintenance completed Instance Upgrades https://status.gobwlng.uk/incident/583123 Sat, 24 May 2025 14:00:11 -0000 https://status.gobwlng.uk/incident/583123#1468bddfe7dd43cab8332f23d7f0ed2f8ad56dd6a4e2cf4bac9efa5e81b29216 To prevent future losses of nodes due to insuficent memory, they will be upgraded. Doubling the current RAM and vCPU per node. Instance Upgrades https://status.gobwlng.uk/incident/583123 Sat, 24 May 2025 14:00:11 -0000 https://status.gobwlng.uk/incident/583123#1468bddfe7dd43cab8332f23d7f0ed2f8ad56dd6a4e2cf4bac9efa5e81b29216 To prevent future losses of nodes due to insuficent memory, they will be upgraded. Doubling the current RAM and vCPU per node. Instance Upgrades https://status.gobwlng.uk/incident/583123 Sat, 24 May 2025 14:00:11 -0000 https://status.gobwlng.uk/incident/583123#1468bddfe7dd43cab8332f23d7f0ed2f8ad56dd6a4e2cf4bac9efa5e81b29216 To prevent future losses of nodes due to insuficent memory, they will be upgraded. Doubling the current RAM and vCPU per node.