Sign in to confirm you’re not a bot
This helps protect our community. Learn more

KEYNOTE: Big Opportunities in Small Data | Citus Con: An Event for Postgres 2023

Microsoft Developer
588K subscribers
<__slot-el>
<__slot-el>
1.9K views 1 year ago #PostgreSQL #Database #CitusCon
Not all data needs to be big. Video of a conference keynote by Simon Willison at Citus Con: An Event for Postgres 2023—about the tools that are missing that could help people explore data at a smaller scale. Simon has spent the last 5 years exploring the world of small data with Datasette, his open source multi-tool for exploring, analyzing, and publishing data. Civic data is more abundant than ever, with local and national governments around the world publishing rich data to open data portals. Every organization has untapped data about their business, and every individual has untapped data about their personal activity. This data is measured in megabytes, not terabytes. What's missing are the tools that help people understand small data: too big for Excel, but not so big that it demands a Big Data warehouse. Datasette is built on SQLite. Why SQLite? It's tiny, fast, and ubiquitous—and supports a workflow where databases can be created, shar …...more
...more
KEYNOTE: Big Opportunities in Small Data | Citus Con: An Event for Postgres 2023
47Likes
1,944Views
2023May 8
Not all data needs to be big. Video of a conference keynote by Simon Willison at Citus Con: An Event for Postgres 2023—about the tools that are missing that could help people explore data at a smaller scale. Simon has spent the last 5 years exploring the world of small data with Datasette, his open source multi-tool for exploring, analyzing, and publishing data. Civic data is more abundant than ever, with local and national governments around the world publishing rich data to open data portals. Every organization has untapped data about their business, and every individual has untapped data about their personal activity. This data is measured in megabytes, not terabytes. What's missing are the tools that help people understand small data: too big for Excel, but not so big that it demands a Big Data warehouse. Datasette is built on SQLite. Why SQLite? It's tiny, fast, and ubiquitous—and supports a workflow where databases can be created, shared, and even discarded with ease. Through the lens of Datasette and SQLite, Simon explores this problem space and asks how the PostgreSQL ecosystem can evolve to address the fascinating opportunities presented by Small Data. Simon Willison is the creator of Datasette, an open source tool for exploring data. He recently completed a JSK journalism fellowship at Stanford, during which he focused on building open source tools for journalism based on his experience working as a data journalist at the UK's Guardian newspaper. Simon is a co-creator of the Django Web Framework, and has been blogging about web development and programming since 2002 at https://simonwillison.net/ ► Video bookmarks: ⏩ 00:00 Introducing Simon ⏩ 01:31 Why talk about Small data? ⏩ 02:23 Demo of Datasette ⏩ 08:03 Read-only SQL queries via API ⏩ 11:57 Datasette built on SQLite ⏩ 13:37 Baked Data architectural pattern ⏩ 16:30 SQL + HTTP as integration tool ⏩ 18:44 Baked Data with PostgreSQL? ⏩ 19:48 Demo of Datasette in WebAssembly in browser ⏩ 26:26 Q&A ✅ Learn more: Watch more talks from Citus Con: An Event for Postgres: https://aka.ms/cituscon-playlist 📕 Everything you need to know about Citus Con: An Event for Postgres can be found at: https://aka.ms/cituscon 📌 Let’s connect:   Twitter – @CitusCon,   / cituscon   #CitusCon #PostgreSQL #Database

Follow along using the transcript.

Microsoft Developer

588K subscribers