Scaling Postgres

To get the show notes as well as get notified of new episodes, visit:  https://www.scalingpostgres.com/episodes/263-lz4-zstd-compression-avoiding-problems-triggers-simplify-indexes-can-hurt/ In this episode of Scaling Postgres, we discuss LZ4 and ZSTD pg_dump compression, how to avoid problems, can triggers simplify and indexes can hurt.

To get the show notes as well as get notified of new episodes, visit:  https://www.scalingpostgres.com/episodes/262-pg_failover_slots-standby-logical-decoding-trusted-language-extensions-postgres-package-manager/ In this episode of Scaling Postgres, we discuss the pg_failover_slots extension, how PG16 allows logical decoding on standbys, what are trusted language extensions and how a package manager has been built for them.

To get the show notes as well as get notified of new episodes, visit:  https://www.scalingpostgres.com/episodes/261-easy-foreign-data-wrappers-jsonb-cheatsheet-updating-cost-limit-parallel-aggregate/ In this episode of Scaling Postgres, we discuss how to easily crate a foreign data wrapper to consume an API, present a convenient JSONB cheatsheet, changes to updating the vacuum cost limit and new parallel aggregates.

To get the show notes as well as get notified of new episodes, visit:  https://www.scalingpostgres.com/episodes/260-plrust-row-locks-postgres-errors-sql-2023/ In this episode of Scaling Postgres, we discuss PL/Rust 1.0 release, row locks, Postgres errors and the new SQL 2023 standard.

To get the show notes as well as get notified of new episodes, visit:  https://www.scalingpostgres.com/episodes/258-logical-replication-database-antipatterns-max_wal_size-delete-vs-truncate/ In this episode of Scaling Postgres, we discuss max_wal_size as it relates to recovery time, losing your data with collation changes, getting production ready and highlights coming in Postgres 16.

To get the show notes as well as get notified of new episodes, visit:  https://www.scalingpostgres.com/episodes/258-logical-replication-database-antipatterns-max_wal_size-delete-vs-truncate/ In this episode of Scaling Postgres, we discuss use cases for logical replication, database anti-patterns, how to set max_wal_size and the difference between delete and truncate.

To get the show notes as well as get notified of new episodes, visit:  https://www.scalingpostgres.com/episodes/257-adopting-pgcat-time-bins-work_mem-settings-bad-constraints/ In this episode of Scaling Postgres, we discuss Instacart adopting PgCat, binning or bucketing your data by time, the best settings for work_mem and how to avoid bad check constraints.

In this episode of Scaling Postgres, we discuss WAL growing to 11 Terabytes, pgec supporting writes, Patroni 3.0 & Citus for high availability, and setting up PostgREST. Visit https://www.scalingpostgres.com/episodes/255-integer-overflow-user-friendly-permissions-dump-logical-replication-worker-config/ to get the show notes as well as subscribe to get notified of new episodes.

In this episode of Scaling Postgres, we discuss how to detect & handle integer overflows, a wish for user-friendly permissions, using a dump to start logical replication and configuring background workers. Visit https://www.scalingpostgres.com/episodes/255-integer-overflow-user-friendly-permissions-dump-logical-replication-worker-config/ to get the show notes as well as subscribe to get notified of new episodes.

In this episode of Scaling Postgres, we discuss PG Edge Cache, using Postgres & OpenAI, migrating citext to case-insenstive collations and PG16 compression options. Visit https://www.scalingpostgres.com to get the show notes as well as subscribe to get notified of new episodes.  

In this episode of Scaling Postgres, we discuss working with unlogged tables, the new pg_stat_io feature, handling complex type constraints and choosing the best text type. Visit https://www.scalingpostgres.com to get the show notes as well as subscribe to get notified of new episodes.

In this episode of Scaling Postgres, we discuss new Postgres releases, performance secrets, things not to do and filter vs. case. Visit https://www.scalingpostgres.com to get the show notes as well as subscribe to get notified of new episodes.  

In this episode of Scaling Postgres, we discuss how to use the filter clause, create hypothetical indexes, store non-relational data and manage TOAST. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.crunchydata.com/blog/using-postgres-filter https://www.crunchydata.com/blog/will-postgres-use-my-index-hypothetical-indexing-with-postgres https://blog.rustprooflabs.com/2023/02/postgres-relational-plus https://hdombrovskaya.wordpress.com/2023/02/03/pgsql-phriday-005-relational-and-non-relational-data/ https://www.pgmustard.com/blog/storing-blobs-in-postgres https://andreas.scherbaum.la/blog/archives/1132-Relational-and-Non-relational-Data-PGSQL-Phriday-005.html https://www.percona.com/blog/unlocking-the-secrets-of-toast-how-to-optimize-large-column-storage-in-postgresql-for-top-performance-and-scalability/ http://peter.eisentraut.org/blog/2023/01/30/postgresql-supply-chain https://www.red-gate.com/simple-talk/databases/postgresql/postgresql-

In this episode of Scaling Postgres, we discuss resolving a performance issue, how PG16 allows you to survive without a superuser, reserving connections and handling partition management. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://medium.com/engineering-at-birdie/puzzling-postgres-a-story-of-solving-an-unreproducible-performance-issue-778075ed7998 http://rhaas.blogspot.com/2023/01/surviving-without-superuser-coming-to.html https://www.red-gate.com/simple-talk/databases/postgresql/postgresql-basics-roles-and-privileges/ https://www.dbi-services.com/blog/postgresql-16-reserved_connections/ https://pganalyze.com/blog/5mins-postgres-16-superuser-reserved-connections https://www.timescale.com/blog/how-timescaledb-solves-common-postgresql-problems-in-database-operations-with-data-retention-management/ https://www.percona.com/blog/wal-compression-in-postgresql-and-recent-improvements-in-version-15/ https://www.cybertec-postgresql.com/en/uniq

In this episode of Scaling Postgres, we discuss issues with locking tables, foreign keys and slow decimals. We also cover when joins use memoize. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links: https://thebuild.com/blog/2023/01/16/ok-sometimes-you-can-lock-tables/ https://thebuild.com/blog/2023/01/18/a-foreign-key-pathology-to-avoid/ https://thebuild.com/blog/2023/01/15/how-slow-is-decimal-anyway/ https://pganalyze.com/blog/5mins-postgres-memoize-speed-up-joins https://www.cybertec-postgresql.com/en/usql-universal-psql/ https://www.crunchydata.com/blog/solving-advent-of-code-2022-using-postgres-day-13 https://gavinray97.github.io/blog/postgres-wire-protocol-jdk-21 https://www.citusdata.com/blog/2023/01/18/debugging-postgres-ci-failures-faster-4-tips/ https://postgres.fm/episodes/auditing https://postgresql.life/post/miroslav_sedivy/ https://www.rubberduckdevshow.com/episodes/70-teaching-young-developers-with-melissa-amaya/  

In this episode of Scaling Postgres, we discuss different pagination solutions, how to return modifications, soft deletion alternatives and how to use JSON with PostgreSQL. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.cybertec-postgresql.com/en/pagination-problem-total-result-count/ https://sqlfordevs.com/returning-modified-rows https://brandur.org/fragments/deleted-record-insert https://dev.to/ftisiot/how-to-json-in-postgresqlr-1lj7 https://momjian.us/main/writings/pgsql/beyond.pdf http://peter.eisentraut.org/blog/2023/01/11/postgresql-largest-commits https://supabase.com/blog/postgres-foreign-data-wrappers-rust https://medium.com/@walttonm/using-the-window-function-row-number-to-remove-duplicates-in-postgresql-5aef1edfb78c https://pgdash.io/blog/horizontally-scaling-postgresql.html https://www.percona.com/blog/upgrading-postgresql-extensions/ https://www.timescale.com/blog/a-postgresql-developers-perspective-six-interesting-patches-fr

In this episode of Scaling Postgres, we discuss how to generate test data, how WAL archiving is faster in PG15, how to set date statistics on a timestamp and how to avoid useless indexes. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://kmoppel.github.io/2022-12-23-generating-lots-of-test-data-with-postgres-fast-and-faster/ https://www.percona.com/blog/speed-up-of-the-wal-archiving-in-postgresql-15/ https://www.cybertec-postgresql.com/en/improving-group-by-with-create-statistics/ https://mydbanotebook.org/post/too-many-indexes/ https://www.cybertec-postgresql.com/en/json-logs-in-postgresql-15/ http://peter.eisentraut.org/blog/2022/12/27/postgresql-hidden-gems https://www.softwareandbooz.com/advent-of-code-2022-days-6-10-with-postgresql/ https://www.crunchydata.com/blog/solving-advent-of-code-2022-using-postgres-day-6 https://www.crunchydata.com/blog/solving-advent-of-code-2022-using-postgres-day-7 https://www.crunchydata.com/blog/solving-a

In this episode of Scaling Postgres, we discuss columnar table storage, solving Advent of Code using Postgres, new features coming in Postgres 16 and when Postgres development happens. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.percona.com/blog/powering-postgresql-15-with-columnar-tables/ https://github.com/citusdata/citus/blob/main/src/backend/columnar/README.md https://www.softwareandbooz.com/advent-of-code-2022-with-postgresql-part1/ https://www.crunchydata.com/blog/solving-advent-of-code-2022-using-postgres-day-1 https://www.crunchydata.com/blog/solving-advent-of-code-2022-using-postgres-day-2 https://www.crunchydata.com/blog/solving-advent-of-code-2022-using-postgres-day-3 https://www.crunchydata.com/blog/solving-advent-of-code-2022-using-postgres-day-4 https://www.crunchydata.com/blog/solving-advent-of-code-2022-using-postgres-day-5 https://www.depesz.com/2022/12/14/waiting-for-postgresql-16-add-grantable-maintain-privilege

In this episode of Scaling Postgres, we discuss ENUMs vs. check constraints, querying table facets with roaring bitmaps, a better way to handle scaling and whether you should store your business logic in Postgres. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.crunchydata.com/blog/enums-vs-check-constraints-in-postgres https://www.cybertec-postgresql.com/en/faceting-large-result-sets/ https://github.com/cybertec-postgresql/pgfaceting https://pganalyze.com/blog/5mins-postgres-roaring-bitmaps-pgfaceting-query-performance https://thenewstack.io/iso-better-scaling-instacart-drops-postgres-for-amazon-dynamodb/ https://www.rubberduckdevshow.com/episodes/68-should-you-store-business-logic-in-your-database/ https://www.ongres.com/blog/debugging-postgres-wal-events-with-pg_walinspect/ https://kmoppel.github.io/2022-12-09-the-bountiful-world-of-postgres-indexing-options/ https://andreas.scherbaum.la/blog/archives/1125-PGSQL-Phriday-003-What-is-

In this episode of Scaling Postgres, we discuss merging indexes vs. a composite index, implementing transparent column encryption, developing trusted language extensions, and reviewing the WAL archive module. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://sirupsen.com/index-merges https://supabase.com/blog/transparent-column-encryption-with-postgres https://aws.amazon.com/blogs/aws/new-trusted-language-extensions-for-postgresql-on-amazon-aurora-and-amazon-rds/ https://pganalyze.com/blog/5mins-postgres-pg-tle-custom-extensions-aws-rds-aurora-trusted-languages-hooks https://github.com/aws/pg_tle https://www.percona.com/blog/new-wal-archive-module-library-in-postgresql-15/ https://sqlasylum.wordpress.com/2022/11/29/pgsql-phriday-003-what-is-the-community-to-you/ https://www.softwareandbooz.com/postgresql-community-passionate-knowledgeable-and-thoughtful/ https://www.scarydba.com/2022/12/02/pgsql-phriday-3-what-is-the-postgresql-community-to-y