5 ms·

Arch Linux: Git migration completed

129 points by timnf 3y ago

likeclockwork 3y ago
Context: https://wiki.archlinux.org/title/DeveloperWiki:GitMigration https://wiki.archlinux.org/title/DeveloperWiki:GitMigration
- Foxboron 3y ago
  Well, that is a bit outdated. I think my draft is more detailed: https://wiki.archlinux.org/title/User:Foxboron/GitMigration https://wiki.archlinux.org/title/User:Foxboron/GitMigration Runbook for the migration can be found here: https://md.archlinux.org/utjjQ-bQTsipIKntPrpf8g?both https://md.archlinux.org/utjjQ-bQTsipIKntPrpf8g?both
  - 5e92cb50239222b 3y ago
    Seems like you're using btrfs for repos.archlinux.org. Any problems with reliability and/or performance? Very rarely does someone share their experience if everything is working fine, regardless of a technology in question.
    - Foxboron 3y ago
      I don't do any of the actual server infra so I don't have all the details. The btrfs raid setup is standardized across all our infra and can be found on ansible. https://gitlab.archlinux.org/archlinux/infrastructure/-/blob/master/host_vars/gemini.archlinux.org/misc https://gitlab.archlinux.org/archlinux/infrastructure/-/blob... https://gitlab.archlinux.org/archlinux/infrastructure/-/blob/master/roles/install_arch/tasks/main.yml#L41-L51 https://gitlab.archlinux.org/archlinux/infrastructure/-/blob... From what I can tell it's been working fine and behaves nicely with failing disks.
  - zeusk 3y ago
    Is there a reason why you have a mix of github and gitlab?
    - Foxboron 3y ago
      Historical mostly. Github usage predates the Gitlab instance and some projects haven't been migrated. We also keep some repositories on Github as a secondary mirror. We've also had some performance issues on Gitlab for `svntogit` repository because of weird branch structures. However this repo is not deprecated so it doesn't matter anymore.
- xeromal 3y ago
  Thanks!
bdhcuidbebe 3y ago
mirrors are all still unsynced since may 19, so announcement was premature
- qD29Lno-oKXPLEv 3y ago
  Most mirrors (at least within the US) are now up-to-date. I finished installing pacman 6.0.2-7 a few minutes ago.
  - conaclos 3y ago
    Which mirror do you use? I got some issues with all my mirrors: the size of the last pacman package is very (too) small (60 vs 944412 for previous version). e.g. https://archlinux.uk.mirror.allworldit.com/archlinux/core/os/x86_64/ https://archlinux.uk.mirror.allworldit.com/archlinux/core/os...
    - qD29Lno-oKXPLEv 3y ago
      Most of the US ones now are synced. I haven't tried out other countries. Initially, there were ~130 that I tried and got a 404 on all of them for the latest pacman. When I tried again a about half an hour ago, only ~50 of the US mirrors returned a 404 I would try and generate a new mirrorlist for your locale: https://archlinux.org/mirrorlist/ https://archlinux.org/mirrorlist/
  - 5e92cb50239222b 3y ago
    Probably PEBCAK, but even the best mirrors according to https://archlinux.org/mirrors/status https://archlinux.org/mirrors/status still seem unsynced on my arch systems.
    - Foxboron 3y ago
      The 1 Gbit/s uplink for the Tier 0 mirror has been fully saturated for almost 4-5 hours now and I expect servers to be syncing for rest of the day really.
  - 3y ago
unixhero 3y ago
This is going to be huge
- lytedev 3y ago
  Why is that?
  - unixhero 3y ago
    Better quality of life for the rest of the world looking into Arch Linux packages. The aggregate of this, will most probably be more involvement from more people as it brings the development to life on the Gitlab Web interface.
pm2222 3y ago
I check several mirrors which are said to be in sync but got this. This cannot be right: pacman-6.0.2-6-x86_64.pkg.tar.zst 18-Mar-2023 15:24 944412 pacman-6.0.2-6-x86_64.pkg.tar.zst.sig 18-Mar-2023 15:24 119 pacman-6.0.2-7-x86_64.pkg.tar.zst 20-May-2023 14:17 56 pacman-6.0.2-7-x86_64.pkg.tar.zst.sig 20-May-2023 14:17 60

129 points by timnf 3y ago

Context: https://wiki.archlinux.org/title/DeveloperWiki:GitMigration https://wiki.archlinux.org/title/DeveloperWiki:GitMigration

Foxboron 3y ago
Well, that is a bit outdated. I think my draft is more detailed: https://wiki.archlinux.org/title/User:Foxboron/GitMigration https://wiki.archlinux.org/title/User:Foxboron/GitMigration Runbook for the migration can be found here: https://md.archlinux.org/utjjQ-bQTsipIKntPrpf8g?both https://md.archlinux.org/utjjQ-bQTsipIKntPrpf8g?both
- 5e92cb50239222b 3y ago
  Seems like you're using btrfs for repos.archlinux.org. Any problems with reliability and/or performance? Very rarely does someone share their experience if everything is working fine, regardless of a technology in question.
  - Foxboron 3y ago
    I don't do any of the actual server infra so I don't have all the details. The btrfs raid setup is standardized across all our infra and can be found on ansible. https://gitlab.archlinux.org/archlinux/infrastructure/-/blob/master/host_vars/gemini.archlinux.org/misc https://gitlab.archlinux.org/archlinux/infrastructure/-/blob... https://gitlab.archlinux.org/archlinux/infrastructure/-/blob/master/roles/install_arch/tasks/main.yml#L41-L51 https://gitlab.archlinux.org/archlinux/infrastructure/-/blob... From what I can tell it's been working fine and behaves nicely with failing disks.
- zeusk 3y ago
  Is there a reason why you have a mix of github and gitlab?
  - Foxboron 3y ago
    Historical mostly. Github usage predates the Gitlab instance and some projects haven't been migrated. We also keep some repositories on Github as a secondary mirror. We've also had some performance issues on Gitlab for `svntogit` repository because of weird branch structures. However this repo is not deprecated so it doesn't matter anymore.
xeromal 3y ago
Thanks!

bdhcuidbebe 3y ago

mirrors are all still unsynced since may 19, so announcement was premature

qD29Lno-oKXPLEv 3y ago
Most mirrors (at least within the US) are now up-to-date. I finished installing pacman 6.0.2-7 a few minutes ago.
- conaclos 3y ago
  Which mirror do you use? I got some issues with all my mirrors: the size of the last pacman package is very (too) small (60 vs 944412 for previous version). e.g. https://archlinux.uk.mirror.allworldit.com/archlinux/core/os/x86_64/ https://archlinux.uk.mirror.allworldit.com/archlinux/core/os...
  - qD29Lno-oKXPLEv 3y ago
    Most of the US ones now are synced. I haven't tried out other countries. Initially, there were ~130 that I tried and got a 404 on all of them for the latest pacman. When I tried again a about half an hour ago, only ~50 of the US mirrors returned a 404 I would try and generate a new mirrorlist for your locale: https://archlinux.org/mirrorlist/ https://archlinux.org/mirrorlist/
- 5e92cb50239222b 3y ago
  Probably PEBCAK, but even the best mirrors according to https://archlinux.org/mirrors/status https://archlinux.org/mirrors/status still seem unsynced on my arch systems.
  - Foxboron 3y ago
    The 1 Gbit/s uplink for the Tier 0 mirror has been fully saturated for almost 4-5 hours now and I expect servers to be syncing for rest of the day really.
- 3y ago

unixhero 3y ago

This is going to be huge

lytedev 3y ago
Why is that?
- unixhero 3y ago
  Better quality of life for the rest of the world looking into Arch Linux packages. The aggregate of this, will most probably be more involvement from more people as it brings the development to life on the Gitlab Web interface.

pm2222 3y ago

I check several mirrors which are said to be in sync but got this. This cannot be right: pacman-6.0.2-6-x86_64.pkg.tar.zst 18-Mar-2023 15:24 944412 pacman-6.0.2-6-x86_64.pkg.tar.zst.sig 18-Mar-2023 15:24 119 pacman-6.0.2-7-x86_64.pkg.tar.zst 20-May-2023 14:17 56 pacman-6.0.2-7-x86_64.pkg.tar.zst.sig 20-May-2023 14:17 60