4 min read
dbt, Spark, or just a Python script?
A decision guide for the question every data team argues about, based on data volume, team size, and how much operational burden you can actually carry.
Tag
engineering
4 pieces tagged “engineering”, newest first.
3 min read
Data contracts without the ceremony
The idea is sound and the tooling around it has become theatre. Here is the version that fits on one page and actually prevents incidents.
4 min read
The data engineer's guide to timestamps
Timezones, DST, event time versus processing time, and the specific bugs each produces. This is the topic that costs the most engineering hours per unit of conceptual difficulty.
4 min read
A practical guide to data file formats
CSV, JSON, Parquet, Arrow, and the table formats layered on top. What each is actually for, and the specific ways choosing wrong costs you.