Data Governance

Schema Registry, Linking, and Validation in Your Cloud

Store schemas in WarpStream’s Confluent-Compatible BYOC Schema Registry, verify data with Schema Validation, and migrate Confluent-compatible schema registries with Schema Linking.

WarpStream BYOC Overview Video
Data Governance
Hear WarpStream Engineer Brian Shih walk you through an overview of WarpStream Data Governance.

BYOC Confluent-
Compatible Schema Registry

Because WarpStream leverages a stateless, Zero Disk (Diskless) Architecture, it has unique schema features you will not find in other standard Kafka schema products.
Zero Access Data Governance

Schemas are stored in your own cloud account and object storage buckets. Schemas never leave your cloud account.

Zero Ops

WarpStream's Schema Registry Agents run as a stateless, single binary with all durability concerns offloaded to the cloud-native object store.

No Additional Infrastructure

Everything happens in the WarpStream Agent. Enable auto-scaling to seamlessly handle changes in schema-related workloads and use Agent Groups to isolate and scale clusters independently.

Simplified Ops + Resiliency

Agents can read and write – no need to wait for leader election. No more ZooKeeper or backing topics.

Schema Validation

Field-Level Validation

Don’t just validate IDs, validate entire records. Prevent malformed data from being ingested and catch issues like missing fields and incorrect data types.

Plug and Play

Validation works with any Kafka-compatible schema registry (like Confluent Schema Registry) as well as non-Kafka sources like AWS Glue.

Identify Before Rejecting

Use a warning-only configuration property to identify records instead of rejecting them to assist with testing and monitoring during schema migration and validation. No need to leverage dead-letter queues or risk data loss.

Schema Linking

Migrate any Confluent-compatible schema registry into a WarpStream BYOC Schema Registry.
Preserve schemas, schema IDs, and compatibility rules.
Read Replicas

Create scalable, cheap read replicas for your schema registry.

Schema Resilience

Facilitate disaster recovery by having a standby schema registry replica in a different region.

Customizable Architecture

Sync schemas between different regions/cloud providers to enable multi-region architecture.

Get started through a cloud marketplace:

FAQs

Don't see an answer to your question? Check our docs, or contact us directly.

Can I use multiple schema versions with WarpStream Schema Validation and BYOC Schema Registry?

WarpStream supports schema evolution, allowing multiple schema versions to coexist. Users can specify compatibility rules to govern schema updates.

What data formats are supported for WarpStream BYOC Schema Registry?

Avro.

What schema registries are supported for WarpStream Schema Validation?

Any Kafka-compatible schema registries (like Confluent Schema Registry and WarpStream BYOC Schema Registry) and AWS Glue.