'how to fix the error BatchCreatePartitions failed to create 1 out of 1 partitions?
I'm trying to use the command below to include a new partition in my metadata: spark.sql(f"ALTER TABLE mytable ADD IF NOT EXISTS PARTITION (dt_incl='2022-03-29/') location's3://mybucket/ac/ura/dt_incl=2022-03-29/'")
It includes right, but when the partition already exists, it is giving the following error: ERROR BatchCreatePartitionsHelper: BatchCreatePartitions failed to create 1 out of 1 partitions.
Does anyone know why he is not understanding that the partition already exists?
Obs: In AWS Athena the command does not give an error, via pyspark script yes
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|