Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Practical approach to building real-time analytics for cybersecurity applications | Citus Con 2023

Microsoft Developer
588K subscribers
<__slot-el>
<__slot-el>
615 views 2 years ago #Cybersecurity #PostgreSQL #CitusCon
Video of a conference talk about how to design a Postgres database schema and ingestion workflow that employs the Citus database extension to power Analytics for cybersecurity data. This talk was delivered at Citus Con: An Event for Postgres 2023 by Slava Moudry. Similar approaches can be used in other time-series applications, not just cybersecurity data. In this talk, you will learn about: ■ Advantages of Citus and Postgres over other streaming technologies ■ How to choose the best data structures for table columns ■ How to choose a distribution key to ensure colocation and even distribution in a Citus cluster ■ Best practices with native Postgres partitioning ■ Schema design to support flexible API request queries ■ Optimizing data ingestion and data aggregation using Manual Query Propagation ■ Keeping things running smoothly. Watching for I/O spikes. Optimizing autovacuum settings Slava Moudry has been using Postgres to build anal …...more
...more
Practical approach to building real-time analytics for cybersecurity applications | Citus Con 2023
15Likes
615Views
2023Apr 18
Video of a conference talk about how to design a Postgres database schema and ingestion workflow that employs the Citus database extension to power Analytics for cybersecurity data. This talk was delivered at Citus Con: An Event for Postgres 2023 by Slava Moudry. Similar approaches can be used in other time-series applications, not just cybersecurity data. In this talk, you will learn about: ■ Advantages of Citus and Postgres over other streaming technologies ■ How to choose the best data structures for table columns ■ How to choose a distribution key to ensure colocation and even distribution in a Citus cluster ■ Best practices with native Postgres partitioning ■ Schema design to support flexible API request queries ■ Optimizing data ingestion and data aggregation using Manual Query Propagation ■ Keeping things running smoothly. Watching for I/O spikes. Optimizing autovacuum settings Slava Moudry has been using Postgres to build analytics and data warehouses since 2005. Slava has worked as a Postgres DBA and a Database engineer—and has used Citus and Postgres together to build real-time analytics workflows in at least 2 different companies. ► Video bookmarks: ⏩ 00:00 Introduction ⏩ 02:20 Data pipeline for cybersecurity applications ⏩ 04:48 Attributes of cybersecurity applications ⏩ 12:02 Tuning Citus performance ⏩ 17:42 Features that make Citus stand out ✅ Learn more: Watch more Citus Con 2023 talks: https://aka.ms/cituscon-playlist 📕 Everything you need to know about Citus Con: An Event for Postgres can be found at: https://aka.ms/cituscon 📌 Let’s connect:   Twitter – @CitusCon,   / cituscon   ⭐ Stay connected with the Citus open source project on GitHub: https://github.com/citusdata/citus 🔔 Subscribe to the Citus monthly technical newsletter: https://aka.ms/citus-newsletter #CitusCon #PostgreSQL #Cybersecurity

Follow along using the transcript.

Microsoft Developer

588K subscribers