Scaling Postgres

In this episode of Scaling Postgres, we discuss the Postgres 15 RC2, optimizing shared buffers, how to secure your database connections and blog posts from PGSQL Phriday. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.postgresql.org/about/news/postgresql-15-rc-2-released-2521/ https://www.enterprisedb.com/blog/harnessing-shared-buffers-and-reaping-performance-benefits-part-1 https://innerjoin.bit.io/the-majority-of-postgresql-servers-on-the-internet-are-insecure-f1e5ea4b3da3 https://www.softwareandbooz.com/pgsql-phriday-001-invite/ https://andreas.scherbaum.la/blog/archives/1121-PGSQL-Phriday-001-Two-truths-and-a-lie.html https://mydbanotebook.org/post/2-it-depends-and-1-must/ https://andyatkinson.com/blog/2022/10/07/pgsqlphriday-2-truths-lie https://www.scarydba.com/2022/10/07/pgsql-phriday-001-two-truths-and-a-lie/ https://sqlasylum.wordpress.com/2022/10/07/pgsqlphriday-001-truth-and-lies/ https://hakibenita.com/future-proof-sql htt

In this episode of Scaling Postgres, we discuss the release of the Postgres 15 Release Candidate 1, new ICU collations features, how to use listen & notify and understanding TOAST. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.postgresql.org/about/news/postgresql-15-rc-1-released-2516/ http://peter.eisentraut.org/blog/2022/09/26/icu-features-in-postgresql-15 https://pganalyze.com/blog/5mins-postgres-15-logical-replication-filters-database-wide-icu-collations https://www.cybertec-postgresql.com/en/listen-notify-automatic-client-notification-in-postgresql/ https://www.crunchydata.com/blog/real-time-database-events-with-pg_eventserv https://www.dbi-services.com/blog/toasting-strategies-in-postgresql/ https://www.dbi-services.com/blog/toasting-in-postgresql-toast-tables/ https://www.dbi-services.com/blog/toasting-in-postgresql-lets-see-it-in-action/ https://blog.rustprooflabs.com/2022/10/announce-mastering-postgis-openstreemap https

In this episode of Scaling Postgres, we discuss using rust for Postgres extensions, performance comparisons of TimescaleDB vs. Postgres, uninterrupted writes when sharding in Citus and the Postgres data flow. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://postgresml.org/blog/postgresml-is-moving-to-rust-for-our-2.0-release/ https://www.timescale.com/blog/postgresql-timescaledb-1000x-faster-queries-90-data-compression-and-much-more/ https://www.citusdata.com/blog/2022/09/19/citus-11-1-shards-postgres-tables-without-interruption/ https://www.crunchydata.com/blog/postgres-data-flow https://www.cybertec-postgresql.com/en/postgresql-sequences-vs-invoice-numbers/ https://postgrespro.com/blog/pgsql/5969741 https://www.crunchydata.com/blog/fun-with-postgres-functions https://www.depesz.com/2022/09/18/what-is-lateral-what-is-it-for-and-how-can-one-use-it/ https://www.postgresql.fastware.com/blog/column-lists-in-logical-replication-publications https

In this episode of Scaling Postgres, we discuss little known useful features, a monthly community blogging initiative, PG 15 Anticipation, and getting generic plans. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://it.badykov.com/blog/2022/09/12/simple-and-usefull-postgresql-features/ https://www.softwareandbooz.com/introducing-psql-phriday/ https://www.youtube.com/watch?v=b-C3TjmzEmU https://dev.to/yugabyte/explain-from-pgstatstatements-normalized-queries-how-to-always-get-the-generic-plan-in--5cfi https://pganalyze.com/blog/5mins-postgres-explain-pg-stat-statements-plan-cache-mode-normalized-query https://www.cybertec-postgresql.com/en/what-is-an-inner-join-in-sql-and-what-is-an-outer-join/ https://proopensource.it/blog/json-versus-jsonb https://www.percona.com/blog/working-with-snapshots-in-postgresql/ https://www.crunchydata.com/blog/postgres-pgcrypto https://www.citusdata.com/blog/2022/09/12/distributed-postgres-goes-full-open-source-wit

In this episode of Scaling Postgres, we discuss the release of Postgres 15 Beta 4, different primary key options, sequence limits and how to examine your Postgres configuration. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.postgresql.org/about/news/postgresql-15-beta-4-released-2507/ https://supabase.com/blog/choosing-a-postgres-primary-key#the-post-uuidv1v4-era-a-cambrian-explosion-of-identifiers https://blog.devgenius.io/analyzing-new-unique-identifier-formats-uuidv6-uuidv7-and-uuidv8-d6cc5cd7391a https://www.2ndquadrant.com/en/blog/sequential-uuid-generators/ https://www.cybertec-postgresql.com/en/error-nextval-reached-maximum-value-of-sequence/ https://proopensource.it/blog/postgresql-configuration https://aws.amazon.com/blogs/database/parallel-vacuuming-in-amazon-rds-for-postgresql-and-amazon-aurora-postgresql/ https://pganalyze.com/blog/5mins-postgres-parallel-vacuum-sql-json-postgres-16 https://blog.jooq.org/how-to-plot-an-asci

In this episode of Scaling Postgres, we discuss the PG15 changes to public schema permissions, experiences with kubernetes for Postgres management, using dump manifests for restores and a fork of PgBouncer. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://andreas.scherbaum.la/blog/archives/1120-Changes-to-the-public-schema-in-PostgreSQL-15-and-how-to-handle-upgrades.html https://proopensource.it/blog/postgresql-on-k8s-experiences https://pganalyze.com/blog/5mins-postgres-kubernetes-operator-handling-major-version-upgrades https://www.percona.com/blog/working-with-postgresql-dump-manifests/ https://blog.cloudflare.com/open-sourcing-our-fork-of-pgbouncer/ https://www.postgresql.fastware.com/blog/how-postgresql-15-improved-communication-in-logical-replication https://www.depesz.com/2022/09/02/sql-json-is-postponed/ https://www.cybertec-postgresql.com/en/postgresql-alter-table-add-column-done-right/ https://www.crunchydata.com/blog/postgres-migra

In this episode of Scaling Postgres, we discuss how the stats collector disappears in PG15, steps to mitigate high latency connections, how to run Postgres in the browser and the future of high availability. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.percona.com/blog/postgresql-15-stats-collector-gone-whats-new/ https://pganalyze.com/blog/5mins-postgres-improve-query-network-latency-performance-pipeline-mode-copy-tc https://www.crunchydata.com/blog/crazy-idea-to-postgres-in-the-web-browser https://www.enterprisedb.com/blog/pg-phriday-defining-high-availability-postgres-world https://www.enterprisedb.com/blog/ansible-benchmark-framework-postgresql https://www.timescale.com/blog/what-does-a-postgresql-commitfest-manager-do-and-should-you-become-one/ https://postgis.net/2022/08/25/tip-upgrading-postgis-sfcgal/ https://www.cybertec-postgresql.com/en/migrate-scheduled-jobs-to-pg_timetable-from-pgagent/ https://postgres.fm/episodes/how-t

In this episode of Scaling Postgres, we discuss a new Postgres playground, a book about PG14 internals, how to corrupt your database and using anti-joins. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.crunchydata.com/blog/learn-postgres-at-the-playground https://www.crunchydata.com/developers/tutorials https://www.youtube.com/watch?v=Ryj5c8zLF50 https://postgrespro.com/blog/pgsql/5969682 https://www.cybertec-postgresql.com/en/how-to-corrupt-your-postgresql-database/ https://www.crunchydata.com/blog/rise-of-the-anti-join https://www.enterprisedb.com/blog/aws-rds-postgresql-deployment-pgadmin-4 https://www.enterprisedb.com/blog/leverage-new-way-import-existing-postgres-database-kubernetes https://postgrespro.com/blog/pgsql/5969676 https://www.cybertec-postgresql.com/en/aliases-for-sub-selects-in-from-clause/ https://postgres.fm/episodes/monitoring-checklist https://pganalyze.com/blog/5mins-postgres-security-patch-releases-pgspot-pghostil

In this episode of Scaling Postgres, we discuss new Postgres releases, a new privilege escalation CVE, chaos testing a high availability kubernetes cluster as well as addressing other H/A questions. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.postgresql.org/about/news/postgresql-145-138-1212-1117-1022-and-15-beta-3-released-2496/ https://www.enterprisedb.com/blog/postgresql-extensions-impacted-cve-2022-2625-privilege-escalation https://coroot.com/blog/chaos-testing-zalando-postgres-operator https://www.timescale.com/blog/how-high-availability-works-in-our-cloud-database/ https://www.enterprisedb.com/blog/pg-phriday-dos-and-donts-postgres-high-availability-qa https://pganalyze.com/blog/5mins-postgres-linux-readahead-effective-io-concurrency https://smallthingssql.com/having-a-less-understood-sql-clause https://postgrespro.com/blog/pgsql/5969673 https://postgres.fm/episodes/vacuum https://postgresql.life/post/adam_wright/ https://www.r

In this episode of Scaling Postgres, we discuss PG14's new SQL function In this episode of Scaling Postgres, we discuss research into a performance puzzle, results from a Postgres and pgAdmin survey as well as the impacts of long running queries on Aurora and Postgres. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://ardentperf.com/2022/07/31/researching-the-performance-puzzle/ https://www.timescale.com/state-of-postgres/2022 https://www.enterprisedb.com/blog/pgadmin-user-survey-2022 https://aws.amazon.com/blogs/database/manage-long-running-read-queries-on-amazon-aurora-postgresql-compatible-edition/ https://pganalyze.com/blog/5mins-postgres-lock-conflicts-amazon-aurora-max-standby-streaming-delay-hot-standby-feedback https://www.highgo.ca/2022/08/05/how-to-set-up-nfs-and-run-pg-on-it/ https://postgresql.life/post/beena_emerson/ https://www.rubberduckdevshow.com/episodes/53-discussing-no-more-estimates-jason-charnes/  

In this episode of Scaling Postgres, we discuss PG14's new SQL function syntax, including buffers when doing explain analyze, how to debug autovacuum and using row-level security to handle multi-tenancy. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.cybertec-postgresql.com/en/better-sql-functions-in-postgresql-v14/ https://jkatz05.com/post/postgres/postgres-begin-atomic/ https://www.pgmustard.com/blog/using-postgres-buffers-for-query-optimization https://www.citusdata.com/blog/2022/07/28/debugging-postgres-autovacuum-problems-13-tips/ https://www.thenile.dev/blog/multi-tenant-rls https://pganalyze.com/blog/5mins-postgres-row-level-security-bypassrls-security-invoker-views-leakproof-functions https://www.timescale.com/blog/state-of-postgresql-2022-13-tools-that-arent-psql/ https://www.youtube.com/c/percona/videos https://www.crunchydata.com/blog/native-partitioning-with-postgres https://www.endpointdev.com/blog/2022/07/running-postgres

In this episode of Scaling Postgres, we discuss /gexec available in psql, how to delete duplicates using a window function, a new Postgres podcast and a performance talk about going from puny to powerful. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.cybertec-postgresql.com/en/gexec-psql-postgresql-poweruser-practice/ https://www.postgresql.org/docs/14/functions-string.html#FUNCTIONS-STRING-FORMAT https://sqlfordevs.io/delete-duplicate-rows https://www.pgmustard.com/blog/postgres-fm-a-new-postgres-podcast https://www.youtube.com/watch?v=CIYbpYKrX8Y https://pganalyze.com/blog/5mins-postgres-waiting-for-postgres-16-subquery-alias-optional https://www.youtube.com/watch?v=mJw3al4Ms2o https://ardentperf.com/2022/07/16/postgresql-performance-puzzle/ https://postgresql.life/post/laura_ricci/ https://www.rubberduckdevshow.com/episodes/51-andrew-mason-collin-jilbert-ruby-radar/  

In this episode of Scaling Postgres, we discuss how too many columns in a table can affect performance, at what point BRIN indexes win over btree, and Postgres 15 supporting unique nulls and parallel distinct queries. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.cybertec-postgresql.com/en/column-order-in-postgresql-does-matter/ https://www.crunchydata.com/blog/postgres-indexing-when-does-brin-win https://blog.rustprooflabs.com/2022/07/postgres-15-unique-improvement-with-null https://www.percona.com/blog/introducing-postgresql-15-working-with-distinct/ https://pganalyze.com/blog/5mins-postgres-unique-constraint-null-parallel-distinct https://postgrespro.com/blog/pgsql/5969637 https://coroot.com/blog/pg-agent https://www.timescale.com/blog/state-of-postgresql-how-to-contribute-to-postgresql-and-the-community/ https://shekhargulati.com/2022/07/08/my-notes-on-gitlabs-postgres-schema-design/ https://pgstef.github.io/2022/07/12/patroni_an

In this episode of Scaling Postgres, we discuss the process of decomposing your database, how to search text in Postgres quickly, how to understand the output of pg_stat_activity and how to use window functions to solve a use case. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://about.gitlab.com/blog/2022/06/02/splitting-database-into-main-and-ci/ https://gitlab.com/groups/gitlab-org/-/epics/6168 https://docs.gitlab.com/ee/development/database/multiple_databases.html https://www.rubberduckdevshow.com/episodes/49-fast-text-search-in-postgres/ https://www.depesz.com/2022/07/05/understanding-pg_stat_activity/ https://www.cybertec-postgresql.com/en/handling-bonus-programs-in-sql/ https://www.crunchydata.com/blog/choosing-a-postgresql-number-format https://www.crunchydata.com/blog/data-to-go-postgres-logical-replication https://www.percona.com/blog/postgresql-replication-and-conflicts/ https://www.timescale.com/blog/state-of-postgresql-2022-fi

In this episode of Scaling Postgres, we discuss psql shortcuts, how to debug deadlocks, how to find & stop queries and how to understand and use SCRAM authentication. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.postgresql.org/about/news/postgresql-15-beta-2-released-2479/ https://www.crunchydata.com/blog/postgres-locking-when-is-it-concerning https://www.percona.com/blog/importance-of-postgresql-vacuum-tuning-and-custom-scheduled-vacuum-job/ https://www.cybertec-postgresql.com/en/transaction-anomalies-with-select-for-update/ https://andreas.scherbaum.la/blog/archives/1117-ctid-and-other-PostgreSQL-table-internals.html https://www.postgresql.fastware.com/blog/introducing-publication-row-filters https://pganalyze.com/blog/5mins-postgres-tuning-statistics-target-selectivity-spatial-indexes https://andreas.scherbaum.la/blog/archives/1118-2-+-2-4-16.html https://supabase.com/blog/2022/06/28/partial-postgresql-data-dumps-with-rls ht

In this episode of Scaling Postgres, we discuss psql shortcuts, how to debug deadlocks, how to find & stop queries and how to understand and use SCRAM authentication. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://elephas.io/psql-helper-managing-connections-and-simplifying-queries/ https://www.cybertec-postgresql.com/en/debugging-deadlocks-in-postgresql/ https://adamj.eu/tech/2022/06/20/how-to-find-and-stop-running-queries-on-postgresql/ https://www.youtube.com/watch?v=whvXiAa_T6A https://andreas.scherbaum.la/blog/archives/1116-PostgreSQL-Upgrades-are-hard!.html https://fluca1978.github.io/2022/06/23/PostgreSQLOrdinality.html https://www.crunchydata.com/blog/indexes-selectivity-and-statistics https://blog.rustprooflabs.com/2022/06/h3-indexes-on-postgis-data https://pganalyze.com/blog/5mins-postgres-fuzzy-text-search-case-insensitive-ICU-collations https://www.timescale.com/blog/how-we-made-data-aggregation-better-and-faster-on-postgre

In this episode of Scaling Postgres, we discuss a PG 14.4 release, how to skip transactions with logical replication, how to use schemas and Citus going fully open source. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.postgresql.org/about/news/postgresql-144-released-2470/ https://www.postgresql.fastware.com/blog/addressing-replication-conflicts-using-alter-subscription-skip https://aaronoellis.com/articles/using-postgres-schemas https://www.citusdata.com/blog/2022/06/17/citus-11-goes-fully-open-source/ https://www.cybertec-postgresql.com/en/case-insensitive-pattern-matching-in-postgresql/ https://blog.brendanscullion.com/postgresql-text-search https://www.crunchydata.com/blog/quick-and-easy-postgres-data-compare https://sqlfordevs.io/uuid-prevent-enumeration-attack https://andreas.scherbaum.la/blog/archives/1113-My-PostgreSQL-database-is-empty!.html https://pganalyze.com/blog/5mins-postgres-reducing-aws-aurora-io-costs-table-partitio

In this episode of Scaling Postgres, we discuss a Postgres 14 out-of-cycle release next week, whether you should upgrade, the state of Postgres survey and a tool for automatic indexing. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode:

In this episode of Scaling Postgres, we discuss a severe bug with index creation in Postgres 14, view permissions options, dealing with logical replication conflicts and looking under the hood of AlloyDB. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://pganalyze.com/blog/5mins-postgres-14-reindex-create-index-concurrently-bug-amcheck-extension https://git.postgresql.org/gitweb/?p=postgresql.git;a=commit;h=042b584c7f7d6216c54359c0ee0f613ba3b3d9c2 https://www.postgresql.org/docs/14/amcheck.html https://www.cybertec-postgresql.com/en/view-permissions-and-row-level-security-in-postgresql/ https://www.postgresql.fastware.com/blog/how-to-handle-logical-replication-conflicts-in-postgresql https://cloud.google.com/blog/products/databases/alloydb-for-postgresql-intelligent-scalable-storage https://cloud.google.com/blog/products/databases/alloydb-for-postgresql-columnar-engine https://www.enterprisedb.com/blog/using-virtual-environment-plpython3-post

In this episode of Scaling Postgres, we discuss mistakes you can make when doing schema changes, how best to cancel statements, looking into pg_rman, and looking at a pedantry removal. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://postgres.ai/blog/20220525-common-db-schema-change-mistakes https://www.cybertec-postgresql.com/en/cancel-hanging-postgresql-query/ https://www.highgo.ca/2022/05/27/how-to-do-backup-and-restore-for-postgresql-using-pg_rman/ https://mydbanotebook.org/post/pedantry/ https://pganalyze.com/blog/5mins-postgres-15-speeding-up-sort-performance https://www.timescale.com/blog/opentelemetry-where-sql-is-better-than-the-original/ https://www.crunchydata.com/blog/exporter2perfdata-connecting-postgres-monitoring-tools https://postgresql.life/post/masahiko_sawada/ https://www.rubberduckdevshow.com/episodes/43-typed-or-untyped-ruby/