Recent searches
Search options
Administered by:
As you may have seen, gitlab.freedesktop.org has been offline for maintenance for the past 24h.
This maintenance operation was supposed to last ~4h on Sunday morning, but was extended to expedite a number of much-needed upgrades:
- migration to a new datacenter which would save us ~$20K/year
- updated postgresql, allowing us to upgrade to gitlab 16.x
1/3
Unfortunately, what should have been a largely-seamless migration was made impossible due to a flaky network connection between the two datacenters (even though it had been stable for the past 2 months). The plan was thus changed to perform the database upgrade in the current datacenter until the networking issue is addressed.
At the current rate of progress, we are expecting the outage to last for another 12h.
2/3
We are sorry for the inconvenience and the sudden change of plans. Stay tuned for updates!
3/3
@XOrgFoundation Good luck to you guys!
@XOrgFoundation
thanks for the update. good luck
@XOrgFoundation Official update: gitlab.freedesktop.org is partially back, and we achieved 2 out of 3 of our goals \o/!
All the services should be functional, albeit a little wonky due to services and data being in different datacenters.
Please report issues here, or on OFTC's #freedesktop IRC channel. We'll get back to them tomorrow morning, after a much-needed break, then proceed to consolidate all the services within the same datacenter.
Sorry again for the inconvenience!
@mupuf @XOrgFoundation How are you securing the traffic?
@alwayscurious @XOrgFoundation We use a Wireguard tunnel.
PS: I say we, but I am not actively working on it. I am merely reviewing the plan and communicating about it to lighten the load of the admin working on it.
| 
| 
| 
@XOrgFoundation@floss.social Shall we call @NetworkManager@fosstodon.org to handle this situation 
@XOrgFoundation big thanks for working on this.
@XOrgFoundation > migration to a new datacenter
Does it mean that gitlab.freedesktop.org will be finally reachable over ipv6?
@illiliti @XOrgFoundation Can't say for sure if or when, but IPv6 is indeed on the to do list related to the move.
@mupuf @XOrgFoundation I lost hope, but sounds good if true.
@XOrgFoundation great you are putting the effort in, these things sometimes surface these unexpected issues.
@XOrgFoundation thank you ops team 
@XOrgFoundation 
sending #hugops to the sysadmin team