Scaling Postgres

In this episode of Scaling Postgres, we discuss new CVEs, programming Postgres, JSONB comparison and using advisory locks. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.postgresql.org/about/news/1960/ https://www.2ndquadrant.com/en/blog/postgres-is-the-coolest-database-reason-5-it-can-not-be-bought-out/ https://pgdash.io/blog/postgres-server-side-programming.html https://blog.couchbase.com/postgres-jsonb-and-nosql/ https://paquier.xyz/postgresql-2/postgres-12-jsonpath/ https://unexpectedeof.net/pg-lock-asyncio.html https://brandur.org/sortsupport-inet http://pgsqlpgpool.blogspot.com/2019/08/automatically-updating-materialized.html https://www.alibabacloud.com/blog/postgresql-graph-search-practices---10-billion-scale-graph-with-millisecond-response_595039 https://info.crunchydata.com/blog/waiting-for-postgis-3-separate-raster-extension  

In this episode of Scaling Postgres, we discuss combining indexes, regular expressions, parallelism in Postgres and PostGIS content. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.cybertec-postgresql.com/en/combined-indexes-vs-separate-indexes-in-postgresql/ https://www.2ndquadrant.com/en/blog/postgresql-regular-expressions-and-pattern-matching/ https://www.percona.com/blog/2019/07/30/parallelism-in-postgresql/ https://www.percona.com/blog/2019/08/02/out-of-memory-killer-or-savior/ https://www.percona.com/blog/2019/07/31/postgresql-simple-c-extension-development-for-a-novice-user/ https://www.percona.com/blog/2019/07/30/using-plpgsql_check-to-find-compilation-errors-and-profile-functions/ https://paquier.xyz/postgresql-2/postgres-12-replication-slot-copy/ https://www.depesz.com/2019/07/31/waiting-for-postgresql-13-add-support-for-jobs-in-reindexdb/ http://blog.cleverelephant.ca/2019/07/postgis-overlays.html http://blog.cleverelephant.c

In this episode of Scaling Postgres, we discuss vacuum through pictures, upcoming recovery changes, certification authentication and how functions get replicated. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.2ndquadrant.com/en/blog/postgresql-award/ https://www.2ndquadrant.com/en/blog/postgres-vacuuming-webinar/ https://paquier.xyz/postgresql-2/postgres-12-recovery-change/ https://info.crunchydata.com/blog/ssl-certificate-authentication-postgresql-docker-containers https://www.cybertec-postgresql.com/en/postgresql-how-are-functions-and-stored-procedures-replicated/ https://fluca1978.github.io/2019/07/22/PostgreSQLCentosUpgrade.html https://www.percona.com/blog/2019/07/22/automatic-index-recommendations-in-postgresql-using-pg_qualstats-and-hypopg/ https://thombrown.blogspot.com/2019/07/jsquery-vs-sqljson.html https://info.crunchydata.com/blog/postgis-3-geojson-st-asgeojson https://info.crunchydata.com/blog/waiting-for-postgis-3-hilbert-g

In this episode of Scaling Postgres, we discuss BRIN indexes, partition enhancements, general tips and standby scaling. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.percona.com/blog/2019/07/16/brin-index-for-postgresql-dont-forget-the-benefits/ https://www.2ndquadrant.com/en/blog/partitioning-enhancements-in-postgresql-12/ https://www.citusdata.com/blog/2019/07/17/postgres-tips-for-average-and-power-user/ https://medium.com/avitotech/standby-in-production-scaling-application-in-second-largest-classified-site-in-the-world-97a79a1929de https://www.cybertec-postgresql.com/en/the-mysterious-backend_flush_after-configuration-setting/ https://fluca1978.github.io/2019/07/17/SuggestPrimaryKeys.html https://fluca1978.github.io/2019/07/18/CheckPostgreSQLVersionInScripts.html https://medium.com/swlh/per-user-encryption-with-postgres-1c76a3462245 https://pgstef.github.io/2019/07/19/pgbackrest_s3_configuration.html  

In this episode of Scaling Postgres, we discuss collation issues, how to load data quickly, recovery changes in Postgres 12 and moving to SCRAM authentication. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.cybertec-postgresql.com/en/icu-collations-against-glibc-2-28-data-corruption/ https://postgresql.verite.pro/blog/2018/08/27/glibc-upgrade.html https://hakibenita.com/fast-load-data-python-postgresql https://www.scalingpostgres.com/tutorials/fast-postgresql-data-loading-using-ruby/ https://winand.at/newsletter/2019-07/sql-standard-extensions-and-cloud-war https://fluca1978.github.io/2019/07/08/PostgreSQL12Recovery.html https://info.crunchydata.com/blog/how-to-upgrade-postgresql-passwords-to-scram https://www.youtube.com/channel/UCAJ1P67u3qQyLpLm5bvPNPw/videos https://www.cybertec-postgresql.com/en/implementing-autonomous-transactions-in-postgres/ https://www.postgresql.org/docs/current/libpq-notify.html https://medium.com/engineered-pu

In this episode of Scaling Postgres, we discuss indexing documents, how GIN indexes work, using Postgres for Data Science and generated columns. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://pgsnake.blogspot.com/2019/06/indexing-documents-for-full-text-search.html http://www.louisemeta.com/blog/indexes-gin/ http://www.louisemeta.com/blog/indexes-gin-algorithms/ https://www.percona.com/blog/2019/07/01/deep-dive-into-postgresql-indexes-webinar-q-a/ https://www.postgresql.org/docs/11/textsearch-indexes.html https://www.cybertec-postgresql.com/en/postgresql-meets-data-science-and-ai/ https://info.crunchydata.com/blog/cis-11-benchmark https://www.2ndquadrant.com/en/blog/generated-columns-in-postgresql-12/ https://www.2ndquadrant.com/en/blog/know-what-time-it-is/ https://pgbouncer.github.io/changelog.html#pgbouncer-110x https://vimeo.com/281409168 https://www.youtube.com/channel/UC6gJN4hEmnPHZ53HP2r7zhA/videos  

In this episode of Scaling Postgres, we discuss the default security, max_connections and pooling, progress reporting and migrating to Postgres. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://info.crunchydata.com/blog/postgresql-defaults-and-impact-on-security-part-1 https://info.crunchydata.com/blog/postgresql-defaults-and-impact-on-security-part-2 http://richyen.com/postgres/2019/06/25/pools_arent_just_for_cars.html https://paquier.xyz/postgresql-2/postgres-12-progress-reports/ https://momjian.us/main/writings/pgsql/features.pdf https://momjian.us/main/writings/pgsql/democratization https://fluca1978.github.io/2019/06/27/PostgreSQLSingleMode.html https://www.percona.com/blog/2019/06/24/managing-multiple-postgresql-instances-on-ubuntu-debian/ https://www.2ndquadrant.com/en/blog/webinar-migration-to-postgresql-follow-up/ https://www.cybertec-postgresql.com/en/version-1-6-of-pgwatch2-postgresql-monitoring-tool-released/  

In this episode of Scaling Postgres, we discuss performance training, SQL/JSON path support, hypothetical indexes and linear interpolation of data. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.postgresql.org/about/news/1949/ https://info.crunchydata.com/blog/explaining-cve-2019-10164-with-postgresql-security-best-practices http://evol-monkey.blogspot.com/2019/06/cve-2019-10164-whos-affected-and-how-to.html https://www.youtube.com/watch?v=OWL8jqrJKPQ https://www.youtube.com/watch?v=fHlIJg4x13g https://paquier.xyz/postgresql-2/postgres-12-jsonpath/ https://www.percona.com/blog/2019/06/21/hypothetical-indexes-in-postgresql/ https://jamey.thesharps.us/2019/05/29/per-project-postgres/ https://bytefish.de/blog/postgresql_interpolation/ https://pgdash.io/blog/postgres-physical-replication.html https://www.scalingpostgres.com/tutorials/postgresql-streaming-replication/ https://www.cybertec-postgresql.com/en/install-postgresql-9-6-with-transpare

In this episode of Scaling Postgres, we discuss prepared plans, materialization, recursive CTEs and how to run safe database migrations. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.cybertec-postgresql.com/en/tech-preview-how-postgresql-12-handles-prepared-plans/ https://www.cybertec-postgresql.com/en/tech-preview-improving-copy-and-bulkloading-in-postgresql-12/ https://blog.timescale.com/rethinking-the-database-materialized-view-as-an-index/ https://fluca1978.github.io/2019/06/11/SequenceCheck.html https://fluca1978.github.io/2019/06/11/FizzBuzz.html https://fluca1978.github.io/2019/06/12/PartitioningCTE.html https://www.youtube.com/watch?v=KROgsx5zosA https://www.youtube.com/watch?v=B-iq4iHLnJU https://www.youtube.com/watch?v=a4OBp6edNaM https://habr.com/en/company/postgrespro/blog/452968/ https://info.crunchydata.com/blog/crunchy-postgres-kubernetes-operator-4.0  

In this episode of Scaling Postgres, we discuss videos from PGCon, Postgres tips & tricks, PostGIS parallel performance and using strings. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.youtube.com/channel/UCer4R0y7DrLsOXo-bI71O6A/videos https://www.youtube.com/user/PerconaMySQL/videos https://momjian.us/main/writings/pgsql/tips.pdf https://www.youtube.com/watch?v=vFq9Yg8a3CE http://blog.cleverelephant.ca/2019/06/parallel-postgis-4b.html https://www.2ndquadrant.com/en/blog/beautiful-things-strings/ http://rhaas.blogspot.com/2019/06/the-contributors-team.html https://habr.com/en/company/postgrespro/blog/452900/ https://pgdash.io/blog/postgres-incremental-backup-recovery.html https://www.scalingpostgres.com/tutorials/postgresql-backup-point-in-time-recovery/ https://severalnines.com/blog/how-optimize-postgresql-logical-replication https://rjuju.github.io/postgresql/2019/06/05/powa-4-new-in-powa-archivist.html  

In this episode of Scaling Postgres, we discuss different query optimizations, normalizing to save space, visualizing vacuum and shardings future. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.postgresql.org/about/news/1943/ https://parallelthoughts.xyz/2019/05/a-tale-of-query-optimization/ https://blog.checklyhq.com/how-i-decimated-postgres-response-times-for-my-saas/ https://www.youtube.com/watch?v=vfiz1J8mWEs https://fluca1978.github.io/2019/05/31/RefactorToSaveSpace.html http://dtrace.org/blogs/dap/2019/05/22/visualizing-postgresql-vacuum-progress/ https://www.citusdata.com/blog/2019/05/30/introducing-pg-auto-failover/ https://www.2ndquadrant.com/en/blog/swoop-de-dupe/ http://momjian.us/main/writings/pgsql/sharding.pdf http://blog.cleverelephant.ca/2019/05/parallel-postgis-4.html https://info.crunchydata.com/blog/active-active-on-kubernetes  

In this episode of Scaling Postgres, we discuss multi-column indexes, using multiple databases, Postgres dos & don'ts as well as using RUM indexes. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://medium.com/pgmustard/multi-column-indexes-4d17bac764c5 https://www.citusdata.com/blog/2019/05/23/rails-6-multiple-databases/ https://wiki.postgresql.org/wiki/Don't_Do_This http://ledgersmbdev.blogspot.com/2019/05/table-inheritance-whats-it-good-for.html https://www.2ndquadrant.com/en/blog/using-docker-hub-postgresql-images/ https://pgstef.github.io/talks/en/20190517_pgconfBE_Streaming-Replication.reveal.pdf https://habr.com/en/company/postgrespro/blog/452116/ https://www.youtube.com/watch?v=PcDWIOj863k https://fluca1978.github.io/2019/05/21/pgcron.html https://www.percona.com/blog/2019/05/24/an-overview-of-sharding-in-postgresql-and-how-it-relates-to-mongodbs/  

In this episode of Scaling Postgres, we discuss leveraging indexes, a slug function, addresses and security definer in functions. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.postgresql.org/about/news/1939/ https://pgdash.io/blog/postgres-indexes.html https://www.kdobson.net/2019/ultimate-postgresql-slug-function/ https://info.crunchydata.com/blog/quick-and-dirty-address-matching-with-libpostal https://www.cybertec-postgresql.com/en/abusing-security-definer-functions/ http://www.sai.msu.su/~megera/postgres/talks/pg12-stachka-2019.pdf https://rjuju.github.io/postgresql/2019/05/17/powa-4-with-remote-mode-beta-is-available.html https://www.depesz.com/2019/05/15/how-to-play-with-upcoming-unreleased-postgresql/  

In this episode of Scaling Postgres, we review articles covering how to identify slow queries, the pg_auto_failover utility, working with roles and Hyperscale. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://dev.to/pythonmeister/how-to-identify-slow-queries-in-postgresql-4igk https://cloudblogs.microsoft.com/opensource/2019/05/06/introducing-pg_auto_failover-postgresql-open-source-extension-automated-failover-high-availability/ https://www.cybertec-postgresql.com/en/postgresql-using-create-user-with-caution/ https://fluca1978.github.io/2019/05/09/PostgreSQL_Roles.html https://www.citusdata.com/blog/2019/05/06/introducing-hyperscale-citus-on-azure-database-for-postgres/ https://www.youtube.com/watch?v=hEbK05xmUcc https://www.youtube.com/watch?v=-cbT64D9KFk https://www.cybertec-postgresql.com/en/optimizer-support-functions/ https://www.percona.com/blog/2019/05/10/pgbackrest-a-great-backup-solution-and-a-wonderful-year-of-growth/  

In this episode of Scaling Postgres, we review articles covering the index include clause, exporting data to CSV, using JSON in Postgres and Zedstore. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://use-the-index-luke.com/blog/2019-04/include-columns-in-btree-indexes https://phili.pe/posts/exporting-csv-from-postgresql/ https://www.ongres.com/blog/having-lunch-with-postgresql-mongodb-json/ https://www.depesz.com/2019/05/01/waiting-for-postgresql-12-allow-vacuum-to-be-run-with-index-cleanup-disabled/ https://www.depesz.com/2019/04/30/waiting-for-postgresql-12-add-settings-option-to-explain-to-print-modified-settings/ https://www.postgresql.org/message-id/flat/CALfoeiuF-m5jg51mJUPm5GN8u396o5sA2AF5N97vTRAEDYac7w%40mail.gmail.com https://www.cybertec-postgresql.com/en/1-to-1-relationship-in-postgresql-for-real/ https://www.tonic.ai/post/masquerade-a-postgres-proxy/ https://www.tonic.ai/post/masquerade-implentation/ https://habr.com/en/company/pos

In this episode of Scaling Postgres, we review articles covering constraint triggers, simple shards, data streams and OIDs. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.cybertec-postgresql.com/en/triggers-to-enforce-constraints/ https://www.youtube.com/watch?v=5sc_zoyDhwg https://www.depesz.com/2019/04/24/waiting-for-postgresql-12-support-foreign-keys-that-reference-partitioned-tables/ https://medium.com/high-alpha/data-stream-processing-for-newbies-with-kafka-ksql-and-postgres-c30309cfaaf8 https://postgresql.verite.pro/blog/2019/04/24/oid-column.html https://malisper.me/generating-fractals-with-postgres-escape-time-fractals/ https://www.2ndquadrant.com/en/blog/webinar-security-and-compliance-with-postgresql-follow-up/  

In this episode of Scaling Postgres, we review articles covering pluggable storage, gotchas for developers, using cursors and new PG12 features. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.2ndquadrant.com/en/blog/around-world-two-billion-transactions/ https://www.youtube.com/watch?v=GhCCs_K7194 https://www.cybertec-postgresql.com/en/declare-cursor-in-postgresql-or-how-to-reduce-memory-consumption/ https://medium.freecodecamp.org/how-to-update-objects-inside-jsonb-arrays-with-postgresql-5c4e03be256a https://www.depesz.com/2019/04/18/waiting-for-postgresql-12-report-progress-of-create-index-operations/ https://www.depesz.com/2019/04/17/waiting-for-postgresql-12-generated-columns/ https://www.depesz.com/2019/04/18/waiting-for-postgresql-12-log-all-statements-from-a-sample-of-transactions/ https://rjuju.github.io/postgresql/2019/04/18/new-in-pg12-statistics-checksums-errors.html https://www.youtube.com/watch?v=8Fb5Qgpr03g  

In this episode of Scaling Postgres, we review articles covering Posgres' popularity, conducting load testing, checksums in PG12 and pg_hba configuration. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://blog.2ndquadrant.com/postgres-coolest-database-reason-1-developers-love/ https://www.youtube.com/watch?v=eaqvykLIOYc https://blog.lawrencejones.dev/building-a-postgresql-load-tester/ https://paquier.xyz/postgresql-2/postgres-12-pg-checksums/ https://blog.2ndquadrant.com/optimizing-storage-small-tables-postgresql-12/ https://hub.packtpub.com/postgresql-security-a-quick-look-at-authentication-best-practices-tutorial/ https://www.percona.com/blog/2019/04/09/continuous-replication-from-legacy-postgresql-version-using-slony/ https://www.percona.com/blog/2019/04/12/fast-upgrade-of-legacy-postgresql-with-minimum-downtime-using-pg_upgrade/  

In this episode of Scaling Postgres, we review articles covering security concerns, fast counting tables, indexing basics and PostgreSQL trends. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.postgresql.org/about/news/1935/ https://blog.hagander.net/when-a-vulnerability-is-not-a-vulnerability-244/ https://www.trustwave.com/en-us/resources/blogs/spiderlabs-blog/cve-2019-9193-authenticated-arbitrary-command-execution-on-postgresql-9-3/ https://www.citusdata.com/blog/2019/04/04/postgres-and-superuser/ https://www.cybertec-postgresql.com/en/secure-postgresql-a-reminder-on-various-attack-surfaces/ https://info.crunchydata.com/blog/enhancing-your-postgresql-10-security-with-the-cis-benchmark https://www.cybertec-postgresql.com/en/count-made-fast/ https://medium.com/pgmustard/postgres-indexes-for-absolute-beginners-b95dfbe5a1e2 https://scalegrid.io/blog/2019-postgresql-trends-report-private-vs-public-cloud-migrations-database-combinations-top-

In this episode of Scaling Postgres, we review articles covering checking on vacuum, how to get a fast distinct count and speed up group by and a health check playbook. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://medium.com/gett-engineering/scaling-postgresql-check-your-vacuum-f03092a6399e https://www.peterbe.com/plog/best-way-to-count-distinct-indexed-things-in-postgresql https://www.cybertec-postgresql.com/en/speeding-up-group-by-in-postgresql/ https://www.citusdata.com/blog/2019/03/29/health-checks-for-your-postgres-database/ https://habr.com/en/company/postgrespro/blog/443284/ https://www.depesz.com/2019/03/29/waiting-for-postgresql-12-reindex-concurrently/ http://www.postgis.us/presentations/PGConf2019_data_loading.pdf https://blog.2ndquadrant.com/need-root-crt-file/ http://blog.cleverelephant.ca/2019/03/geojson.html https://postgresql.verite.pro/blog/2019/03/28/tsearch-dictionary.html https://pgstef.github.io/2019/03/26/pgbackrest_