A recurring theme for me: I need something like make, but good at managing data. Make is all about compiling files and testing filestamps. I need something that’s about download data, and inserting into databases, and testing whether data needs to be regenerated. It’s possible to coerce make into doing this with lots of touching sentinel files but it’s kind of a mess.
Some quick links on this topic: