Tens of TB per hour

Episode 164

Nik talks Michael through a recent benchmark he worked with Maxim Boguk on, to see how quickly they could provision a replica.

Here are some links to things they mentioned:

Ultra-fast replica creation with pgBackRest (blog post by Maxim Boguk and Nik) https://postgres.ai/blog/20251105-postgres-marathon-2-012-ultra-fast-replica-creation-pgbackrest
Copying a database episode https://postgres.fm/episodes/copying-a-database
Add snapshot backup support for PostgreSQL in wal-g (draft PR by Andrey Borodin) https://github.com/wal-g/wal-g/pull/2101
Multi-threaded pg_basebackup discussion 1: https://www.postgresql.org/message-id/flat/CAEHH7R4%3D_GN%2BLSsj0YZOXZ13yc%3DGk9umJOLNopjS%3DimK0c1mWA%40mail.gmail.com
Multi-threaded pg_basebackup discussion 2: https://www.postgresql.org/message-id/flat/
io_method https://www.postgresql.org/docs/current/runtime-config-resource.html#GUC-IO-METHOD
pgBackRest https://github.com/pgbackrest/pgbackrest
Add sequence synchronization for logical replication (commit) https://git.postgresql.org/gitweb/?p=postgresql.git;a=commit;h=5509055d6956745532e65ab218e15b99d87d66ce
Allow process priority to be set (pgBackRest feature added by David Steele) https://github.com/pgbackrest/pgbackrest/pull/2693
Hard limit on process-max (pgBackRest issue from 2019) https://github.com/pgbackrest/pgbackrest/issues/696

~~~

What did you like or not like? What should we discuss next time? Let us know via a YouTube comment, on social media, or by commenting on our Google doc!

~~~

Postgres FM is produced by:

Michael Christofides, founder of pgMustard
Nikolay Samokhvalov, founder of Postgres.ai

With credit to:

Jessie Draws for the elephant artwork

Published on 9 hours ago

Podcast Episode Details

Tens of TB per hour