WarpStream Tableflow

Request Early Access

Let Me In!

Tableflow EA

Tableflow is the easiest, cheapest, and most flexible way to convert Kafka topic data into Iceberg tables with low latency, and keep them compacted.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Let Me In!
Plug & Play

Attach to any existing Kafka cluster

WarpStream Tableflow works with any Kafka-compatible source (Open-Source Kafka, MSK, Confluent Cloud, WarpStream, etc), and can run in any cloud or even on-premise. Ingest simultaneously from multiple different Kafka clusters to centralize your data in a single lake.
Compatible With
GCP BigQuery
AWS Athena
DuckDB
ClickHouse
AWS Glue
Trino
Give Us A Spec

We’ll Take Care
of the Rest

Define your Iceberg table configuration in a declarative YAML file, then sit back and relax as the WarpStream Agents connect to your Kafka cluster and start creating Iceberg tables to your exacting specification.
tables:
   - source_cluster_name: "benchmark"
     source_topic: "example_json_logs_topic"
     source_format: "json"
     schema_mode: "inline"
     schema:
       fields:
         - { name: environment, type: string, id: 1}
         - { name: service, type: string, id: 2}
         - { name: status, type: string, id: 3}
         - { name: message, type: string, id: 4}
   - source_cluster_name: "benchmark"          
     source_topic: "example_avro_events_topic"
     source_format: "avro"
     schema_mode: "inline"
     schema:
       fields:
           - { name: event_id, id: 1, type: string }
           - { name: user_id, id: 2, type: long }
           - { name: session_id, id: 3, type: string }
           - name: profile
             id: 4
             type: struct
             fields:
               - { name: country, id: 5, type: string }
               - { name: language, id: 6, type: string }