Data Engineering
8 posts filed under Data Engineering.
Pipeline Replay Decision Tree
Most pipelines are designed for the happy path. The first real outage makes recovery the only thing that matters.
Read →Wrong DE Hire Cost Matrix
A wrong data engineering hire runs you about three salaries by the time you count the ramp, the re-hire, and the work that stalled in …
Read →The Data Maturity Assessment You Can Do in 30 Minutes
Most maturity assessments take six weeks and a consulting firm. This one takes 30 minutes and a whiteboard.
Read →The Deployment Pipeline Concept Applied to Data Products
Your data team deploys to production the same way software teams did in 2008. Manually, nervously, with a 1000-step runbook nobody trusts.
Read →Cost-Aware Data Engineering - FinOps for Data
Your data team doesn't know what their pipelines cost. That's the first problem.
Read →Data Architecture vs Data Engineering: What's the Difference?
Architects design the blueprint. Engineers build the system. Hire the wrong one first and you'll hire both twice.
Read →Platform Review: What I Find in Week One
In week one of every platform review, I find the same five problems. Your company probably has at least three.
Read →You're Hiring Data Engineers Wrong
You're hiring data engineers wrong. And your best candidates know it.
Read →