HackerTubewatch
Surprise me
Frame from Thesis: Partial State in Dataflow-Based Materialized Views Plays via YouTube's privacy-enhanced embed

Thesis: Partial State in Dataflow-Based Materialized Views

7 videos recommended on HN
YouTube
1 HN user recommended this talk1 month2020–2024 score 1
Years with an HN recommendation, 2007–2026

HN points to it, including Gjengset himself, as a more digestible way into partially-stateful dataflow than the thesis text, mostly in caching and database threads.

Jon Gjengset's 2020 PhD dissertation presentation at MIT on partial state in dataflow-based materialized views, the idea behind the Noria database. The Q&A is cut out.

“a shorter talk from a few years earlier at” (HN, 2022)

1 recommendations · 2 citations · Talks · advanced

3 Hacker News comments

From the HN archive; up to 20 kept per video, favoring different commenters. Recommendations first.

@Jonhoo Nov 2022 Recommends
on HN thread How PlanetScale Boost serves SQL queries faster
Read more
:wave: Author of the paper this work is based on here. I'm so excited to see dynamic, partially-stateful data-flow for incremental materialized view maintenance becoming more wide-spread! I continue to think it's a _great_ idea, and the speed-ups (and complexity reduction) it can yield are pretty immense, so seeing more folks building on the idea makes me very happy. The PlanetScale blog post references my original "Noria" OSDI paper ( [link] ), but I'd actually recommend my PhD thesis instead ( [link] ), as it goes much deeper about some of the technical challenges and solutions involved. It also has a chapter (Appendix A) that covers how it all works by analogy, which the less-technical among the audience may appreciate :) A recording of my thesis defense on this, which may be more digestible than the thesis itself, is also online at [this video] , as well as a shorter talk from a few years earlier at [link] . And the Noria research prototype (written in Rust) is on GitHub: [link] . As others have already mentioned in the comments, I co-founded ReadySet ( [link] ) shortly after graduating specifically to build off of Noria, and they're doing amazing work to provide these kinds of speed-ups for general-purpose relational databases. If you're using one of those, it's worth giving ReadySet a look to get these kinds of speedups there! It's also source-available @ [link] if you're curious.
Author's thesis defense on partially-stateful dataflow, easier than the thesis

Citations, criticism and jokes

@kondu Oct 2020 Cites it
on HN thread Differential Dataflow
this is also one of the main ideas behind Noria[1] (built by @jonhoo, who also gave his PhD dissertation[2] on this recently) [1] [link] [2] [this video]
PhD thesis defense on Noria's partial state
@dpcx Feb 2024 Cites it
on HN thread Readyset: A MySQL and Postgres wire-compatible caching layer
Pretty sure that this is the database that Jon Gjengset[0] was working on as part of his thesis project. There have been several videos shared by him during talks about the system. It's a really interesting concept. edit: Here's[1] a video where he talks about the concept [0]: [link] [1]: [this video]
Talk where Gjengset explains the underlying concept

Video list and Hacker News comment labels from HackerTube (prompted by @karpathy), released under ODC-By 1.0, built on the open-index/hacker-news archive. Hacker News data is provided by Y Combinator; comments remain the work of their authors. Video titles, channel names and thumbnails belong to their creators and are shown via YouTube. HackerTube Watch is an unofficial edition. Data export of 2026-10-31.

Keyboard shortcuts

/
Search
j k
Next / previous video
r
Surprise me
l
Like (video page)
w
Watch later (video page)
?
This help
Esc
Close