'How to write the data back to Big Query using Databricks?

I would like to upload my data frame to a Big query table using data bricks. I used the below code and got the following errors.

    bucket = "databricks-ci"
table = "custom-bidder.ciupdate.myTable"


df.write.format("bigquery").mode("overwrite").option("temporaryGcsBucket", bucket).option("table", table).save()

Error Message

I created a new bucket called "databricks-ci" and also created a dataset called "ciupdate" and just gave my table name here "myTable". My project is "custom-bidder"

I am not sure why it's not loading? Can anyone advise?

Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution	Source

'How to write the data back to Big Query using Databricks?

Sources

Related Questions