Kafka Replication Without the (Offset) Gaps

Arjun Nair
November 13, 2024
Orbit is a tool which creates identical, inexpensive, scaleable, and secure continuous replicas of Kafka clusters. It is built into WarpStream and works without any user intervention to create WarpStream replicas of any Apache Kafka-compatible source cluster.
Read More

Announcing Schema Validation with AWS Glue Schema Registry

Brian Shih
September 25, 2024
WarpStream now supports AWS Glue Schema Registries, in addition to the Kafka-compatible schema registries. The WarpStream Agent can use schemas stored in the user’s AWS Glue Schema Registries to validate records.
Read More

Dealing with rejection (in distributed systems)

Richard Artoul
August 13, 2024
Backpressure is a really simple concept. When the system is nearing overload, it should start “saying no” by slowing down or rejecting requests. Of course, the big question is: How do we know when we should reject a request?
Read More

Announcing WarpStream Schema Validation

Brian Shih
July 18, 2024
WarpStream now has the capability to connect to external schema registries, and verify that records actually conform to the provided schema.
Read More

The Kafka Metric You're Not Using: Stop Counting Messages, Start Measuring Time

Aratz Manterola Lasa
July 16, 2024
Traditional offset-based monitoring can be misleading due to varying message sizes and consumption rates. To address this, you can introduce a time-based metric for a more accurate assessment of consumer group lag.
Read More

Multiple Regions, Single Pane of Glass

Emmanuel Pot
June 20, 2024
How we built support for running WarpStream's control plane and Metadata Store in multiple regions, while still presenting our platform as a single pane of glass.
Read More

Secure by default: How WarpStream’s BYOC deployment model secures the most sensitive workloads

Caleb Grillo
June 10, 2024
WarpStream's Zero Disk / Diskless Architecture enables a BYOC deployment model that is secure by default and does not require any external access to the customer's environment.
Read More

Announcing Bento, the open source fork of the project formerly known as Benthos

Richard Artoul
May 31, 2024
Announcing Bento, the open source fork of the project formerly known as Benthos.
Read More