'Is it possible to delete records from Hive external table with AWS S3 bucket as location?

Is it possible to delete records from Hive external table with AWS S3 bucket as location using IICS.

For example : DELETE FROM MY_HIVE_TABLE WHERE COLUMN1='TEST1';



Solution 1:[1]

You can not delete from hive(unless they are kudu).

As per your comment, i think you can add a filter transformation right before target hive S3 table with condition COLUMN1<>'TEST1'

And then overwrite the hive target table in S3 using IICS.

This will overwrite same table with everything but COLUMN1=TEST1 i.e. deleting the data.

Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source
Solution 1