'AWS Glue CatalogTable with changing column type

I am using DataFormatConversionConfiguration in Firehose Delivery Stream to change incoming data into a parquet format. The schema for parquet is defined in a Glue Table. My data has a column called 'description' and is of type struct. However, the key:value pair inside the struct can change.

example:

{name: "description",type: "struct<en:string>"} or {name: "description", type: "struct<fr:string>"}

I'm looking if there's a possibility to do something similar to:

{name: "description",type: "struct<en:string> OR struct<fr:string>"}

so that the parquet conversion does not fail.



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source