WarpStream Blog

How we separated data from metadata to build support for idempotent producers in our Apache Kafka protocol layer.

We first introduced WarpStream in our blog post: "Kafka is Dead, Long Live Kafka", but to summarize: WarpStream is a Kafka protocol compatible data streaming system built directly on top of object storage.

How we built stateless load balancing into a protocol that was never designed for it.

Chances are you probably had a strong reaction to the title of this post. In our experience, Kafka is one of the most polarizing technologies in the data space. Some people hate it, some people swear by it, but almost every technology company uses it.