Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Lessons Learned from benchmarking and profiling distributed PostgreSQL | POSETTE 2024

Microsoft Developer
588K subscribers
<__slot-el>
<__slot-el>
314 views 10 months ago #PostgreSQL #PosetteConf #Citus
Video of a conference talk about lessons learned from benchmarking and profilling distributed PostgreSQL presented by Lotte Felius at POSETTE: An Event for Postgres 2024. In this talk, I’ll explain how I investigated the performance of Citus using the Citus Benchmark Suite and YCSB. Quantifying performance however is not straightforward since Citus is a distributed system where queries are distributed across multiple worker nodes. Therefore, I’ll explain some of my learnings as a former intern with no prior experience in benchmarking Databases, which includes:  …...more
...more
Lessons Learned from benchmarking and profiling distributed PostgreSQL | POSETTE 2024
14Likes
314Views
Jun 132024
Video of a conference talk about lessons learned from benchmarking and profilling distributed PostgreSQL presented by Lotte Felius at POSETTE: An Event for Postgres 2024. In this talk, I’ll explain how I investigated the performance of Citus using the Citus Benchmark Suite and YCSB. Quantifying performance however is not straightforward since Citus is a distributed system where queries are distributed across multiple worker nodes. Therefore, I’ll explain some of my learnings as a former intern with no prior experience in benchmarking Databases, which includes:
  • The pros and cons of different architectures used for distributed database systems based on PostgreSQL
  • Why quantifying performance is harder for distributed database systems and how you can use benchmarks to get an accurate indication of the performance
  • How to identify bottlenecks based on benchmarking results and which optimizations you can possibly to do mitigate them
Lotte is currently a second year PhD student at the “Centrum voor Wiskunde & Informatica” (CWI), based in Amsterdam, Netherlands. She is in the Database Architectures group and her current research includes secure query processing, lightweight compression on GPUs and secure next-gen file formats. Former intern at Citus (Microsoft). Chapters: 00:00 - Intro 01:44 - Architectures for Distributed PostreSQL 05:53 - The PostgreSQL Query Processing Pipeline 08:56 - The scope of the research 11:09 - Benchmarking Citus 17:41 - Identifying bottlenecks 22:14 - Key Takeaways 📕 Everything you need to know about POSETTE: An Event for Postgres 2024 can be found at: https://aka.ms/posette ✅ Learn more: Watch more POSETTE talks: https://aka.ms/posette-playlist-2024 📌 Let’s connect: X – @PosetteConf https://x.com/PosetteConf Mastodon - @posetteconf https://mastodon.social/@posetteconf Threads – @posetteconf https://www.threads.net/@posetteconf 🔔 Subscribe to the POSETTE News: https://aka.ms/posette-subscribe #PosetteConf #PostgreSQL #Citus Presenters: Lotte Felius, PhD Student in the Database Architectures group at CWI Connect: Lotte Felius:   / ccfelius  ,   / lottefelius  

Follow along using the transcript.

Microsoft Developer

588K subscribers