Sign in to confirm you’re not a bot
This helps protect our community. Learn more

On compression of everything in Postgres | Citus Con 2023

Microsoft Developer
589K subscribers
<__slot-el>
<__slot-el>
687 views 1 year ago #PostgreSQL #Database #CitusCon
Video of a conference talk given by Andrey Borodin about the Postgres pglz algorithm to compress TOASTs and full page images in WAL. The talk examines the impact of Postgres features already committed, with lz4 everywhere. In this talk you’ll also learn about the prospects of compression application that are yet to come: protocol compression, temp files compression, WAL compression, and data segments compression. Also discussed is the so-called “random access compressed file.” Having random write compressed files in the Postgres core would allow many very cool things. Andrey believes this component could increase OLTP performance by a significant multiplier on IO bottlenecked installations. Andrey Borodin has been hacking on Postgres since 2016. He is an associated professor at Yandex School for Data Analysis and Ural Federal University. ► Video bookmarks: ⏩ 00:00 Introducing Andrey ⏩ 02:00 Andrey’s talk begins ⏩ 02:58 Basics of comp …...more
...more
On compression of everything in Postgres | Citus Con 2023
17Likes
687Views
2023May 8
Video of a conference talk given by Andrey Borodin about the Postgres pglz algorithm to compress TOASTs and full page images in WAL. The talk examines the impact of Postgres features already committed, with lz4 everywhere. In this talk you’ll also learn about the prospects of compression application that are yet to come: protocol compression, temp files compression, WAL compression, and data segments compression. Also discussed is the so-called “random access compressed file.” Having random write compressed files in the Postgres core would allow many very cool things. Andrey believes this component could increase OLTP performance by a significant multiplier on IO bottlenecked installations. Andrey Borodin has been hacking on Postgres since 2016. He is an associated professor at Yandex School for Data Analysis and Ural Federal University. ► Video bookmarks: ⏩ 00:00 Introducing Andrey ⏩ 02:00 Andrey’s talk begins ⏩ 02:58 Basics of compression ⏩ 05:42 Pareto frontier ⏩ 07:06 pglz ⏩ 08:00 zlib ⏩ 08:40 Lz4 ⏩ 09:34 Zstd ⏩ 10:26 Compression dictionaries ⏩ 15:30 WAL compression idea ⏩ 20:51 Protocol compression futures ⏩ 23:15 Temporary files compression (future, maybe) ⏩ 27:57 Q&A ✅ Learn more: Watch more Citus Con talks: https://aka.ms/cituscon-playlist 📕 Everything you need to know about Citus Con: An Event for Postgres can be found at: https://aka.ms/cituscon 📌 Let’s connect:   Twitter – @CitusCon,   / cituscon   #CitusCon #PostgreSQL #Database

Follow along using the transcript.

Microsoft Developer

589K subscribers