'AWS Glue CatalogTable with changing column type
I am using DataFormatConversionConfiguration in Firehose Delivery Stream to change incoming data into a parquet format. The schema for parquet is defined in a Glue Table. My data has a column called 'description' and is of type struct. However, the key:value pair inside the struct can change.
example:
{name: "description",type: "struct<en:string>"}
or
{name: "description", type: "struct<fr:string>"}
I'm looking if there's a possibility to do something similar to:
{name: "description",type: "struct<en:string> OR struct<fr:string>"}
so that the parquet conversion does not fail.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|
