Dataflow flex template for Kafka Protobuf messages to BigQuery¶
This project demonstrates a Dataflow pipeline that reads messages in Protobuf binary format from Kafka and writes them into a BigQuery table with the same schema.
If the schema for the protobuf has evolved, it will also generate a new entry in separate BigQuery table with raw bytes.
Update 2025-12-19:
This project has been archived. You can still access the code by browsing the repository at commit ea7cba2