Postgres FM cover image

Postgres FM

Real-time analytics

Feb 17, 2023
The podcast discusses real-time analytics in Postgres, including the challenges of integration and the importance of partitioning and analytics databases. They explore materialized views in real-time analytics and discuss estimates and Autovacuum for performance optimization in Postgres.
34:02

Podcast summary created with Snipd AI

Quick takeaways

  • Real-time analytics in Postgres can be achieved through the combination of transactional workloads and analytical capabilities or using separate databases.
  • To improve performance for real-time analytics in Postgres, options such as using column store storage engines like Clickhouse, utilizing foreign data wrappers for offloading load, and implementing partitioning with tools like Timescale are discussed.

Deep dives

Running real-time analytics in Postgres

Running real-time analytics in Postgres is a controversial topic, with a debate between running real-time analytics workloads in combination with transactional workloads or using separate analytical databases. The goal is to achieve better performance by running aggregate queries in a regular OLTP database and potentially eliminating the need for analytical databases like Vertica or Snowflake. However, there are challenges with this approach, as analytical databases are optimized for processing large data volumes and may not perform well with user-facing workloads. Some solutions discussed include the potential for transactional systems to add analytical capabilities and vice versa, as well as the use of hybrid systems that have two separate databases. Additionally, the importance of real-time analytics is highlighted, emphasizing the need for systems that can provide access to data at all times.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode