Skip to content

Stream PostgreSQL backups safely to S3 - #4

Open
frnandu wants to merge 3 commits into
masterfrom
fix/stream-postgres-backups-to-s3
Open

Stream PostgreSQL backups safely to S3#4
frnandu wants to merge 3 commits into
masterfrom
fix/stream-postgres-backups-to-s3

Conversation

@frnandu

@frnandu frnandu commented Aug 31, 2026

Copy link
Copy Markdown

Summary

  • stream pg_dump through gzip and GPG directly to S3
  • upload under an .in-progress key and promote it only after the stream succeeds
  • clean up temporary objects when streaming or promotion fails
  • ignore .in-progress objects in the S3 backup checker
  • use loopback pinentry for noninteractive encryption

Testing

  • validated shell syntax for both scripts
  • exercised single-database and all-databases streaming with mocked PostgreSQL, GPG, and S3 commands
  • verified failed streams and failed promotions clean up the temporary object
  • verified the checker query excludes newer .in-progress objects

@frnandu frnandu changed the title Stream PostgreSQL backups directly to S3 Stream PostgreSQL backups safely to S3 Aug 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant