WarpStream Blog

Goldsky’s mission to stream and index massive volumes of blockchain data quickly ran into the scaling and cost limits of traditional Kafka. With tens of thousands of partitions and petabytes of data, their clusters became expensive, fragile, and hard to operate. By migrating to WarpStream, Goldsky cut costs by over 10x, eliminated performance bottlenecks, and unlocked seamless scaling to 100 PiB and hundreds of thousands of partitions, all without the operational headaches of legacy Kafka deployments.

By switching from open-source Apache Kafka to WarpStream, ShareChat was able to implement zero-ops auto-scaling and saved 60% vs. multi-AZ Kafka. They also shared some best practices for optimizing WarpStream.

"...we needed to ensure WarpStream could also support our scalability needs before settling on it. Given the size of Grafana Cloud Metrics, we knew it needed to handle read and write rates of tens of gigabytes per second."

Character.AI operates at scale, supporting over 20 million monthly active users across our services. Despite being a relatively small company, Character.AI services have significant and complex data storage needs.

‍Pixel Federation is the developer of nearly a dozen highly popular mobile games with players from all over the world. They have millions of monthly active users, and those millions of users generate lots of events. In fact, Pixel Federation uses an event-driven architecture for almost everything: logging, events, billing, tracking game state, etc. Find out how they saved 83% using WarpStream over MSK.

Benchmarking databases – and maintaining fairness and integrity while doing so – is a notoriously difficult task to get right, especially in the data streaming space. Vendors want their systems to produce mouth watering results, and so unnatural configurations divorced from customer realities (AKA “vanity” benchmarks) get tested, and it's ultimately the end-user that is left holding the bag when they realize that their actual TCO is a lot higher than they were led to believe.