#schema-registry

Data Engineering Bug Report

A producer renamed one event field and a downstream service dropped events for nine days

Ravi Subramanian · Nov 5, 2026 · 8 min read

The orders team renamed customer_id to buyer_id in their event payload. The loyalty service kept consuming without errors and silently skipped every event it could no longer read. Nine days of points were missing. How it happened and how a schema registry with compatibility rules prevents it.

Data Engineering

Why Kafka projects fail: eight failure modes we have seen and how to avoid them

John Nguyen · Oct 19, 2024 · 7 min read

Kafka rarely fails because the broker is buggy. Projects fail because teams pick it for the wrong job, skip schemas, guess at partitions, assume exactly-once, and leave operations and security for later. Here are the eight patterns we keep seeing and what to do instead.