Data Architecture & Strategy
42 posts filed under Data Architecture & Strategy.
Iceberg Is Open. Your Security Model Isn't
An auditor asked who could read the customer table. With three engines on one Iceberg catalog, nobody could answer.
Read →AI Modeling Crisis Patterns
Every failed RAG project I've reviewed had the same upstream issue: nobody modeled the data underneath it.
Read →Data Product Canvas Update For AI Consumers
Your newest data consumers don't file tickets. They're AI agents, and they break differently.
Read →Too Deep Into Snowflake" Is an Architecture Smell
You can measure architecture health by the price of an exit. For one stack I reviewed, it was 18 months.
Read →Pipeline Replay Decision Tree
Most pipelines are designed for the happy path. The first real outage makes recovery the only thing that matters.
Read →Lakehouse Convergence Risks
The lakehouse pitch is one platform for raw files and clean tables. The trap is inheriting the data lake's oldest habit: land everything, …
Read →Premature Real-Time Tax
Streaming has a cost nobody puts in the business case: the weekly tax of running it after the demo works.
Read →Semantic Layer Pitfalls - Invisible Technical Debt
You bought a semantic layer to end the "which number is right" argument. Eighteen months later you have 200 metrics and the same argument, …
Read →Deterministic vs Non-Deterministic AI
Run your AI feature twice on the same input. If a different answer would be a problem, you've found a deterministic requirement.
Read →Your AI Initiative Is Blocked by Context, Not Tokens
The team bought more tokens. The agent still gave confident, wrong answers. The bottleneck was never compute.
Read →