'Kafka to Cloud Storage or BigQuery
As a beginner and after using successfully Kafka, with Confluent, in the past months loading real-time data into GCP BigQuery. I started to read more about real-time architecture approaches and noticed that there is also an option to move first the Kafka data to GCP Cloud Storage and then batch it into BigQuery.
Let me launch this discussion here - What are the [main] differences in moving Kafka real-time data into a BigQuery dataset against Cloud Storage?
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|