Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor ports-mirror to use remote object storage #82

Open
kallisti5 opened this issue Mar 24, 2023 · 0 comments
Open

refactor ports-mirror to use remote object storage #82

kallisti5 opened this issue Mar 24, 2023 · 0 comments

Comments

@kallisti5
Copy link
Contributor

kallisti5 commented Mar 24, 2023

Ports-mirror rummages around in Haikuports and makes backups of sources for our packages. It's handy, however used a considerable amount of locally bound resources and storage.

https://github.com/haiku/infrastructure/tree/master/containers/ports-mirror

ports-mirror really needs refactored to use generic s3 buckets (aka Wasabi) for storage. This would enable us to archive large amounts of storage for cheap, while maintaining small and agile storage dependencies on our infrastructure

Ideas:

  • While archiving ports, store the date, time, source, sha256, recipe as metadata in s3
    • sha256 in metadata is important so we can compare what the recipe expects, and what is stored in s3.
  • We should be able to point haikuporter directly at the s3 storage provider ideally to reduce bandwidth within our infrastructure.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

No branches or pull requests

1 participant