I recently gave a talk at the West Michigan Ruby Users Group for their night on data topics, inspired by my recent series on optimizing Rails memory usage. The video above is a recording of the talk.[1]

The talk covers ActiveRecord#find_each, ActiveRecord#pluck, the PostgreSQL Cursor gem, a short intro to Lazy Enumerators, a brief reference for how to stream an HTTP response that’s larger than your server’s available memory, a presentation of a crazy demo app that tries to be git for data storage, and an attempt at using streaming to optimize the action of that app that constructs the current table from its commit history.

I hope you enjoy and learn something!

[1] The recorded audio is from my computer’s built-in mic. When the sound gets super-quiet, that’s when I turned around to look at the screen. My apologies.