'How to pass extra files to Flink runner?

I come from Spark background and trying to write Flink 1.12.6 job using Apache Beam 2.35.0 on YARN. However, when writing a job for Phoenix, I am unable to pass hbase-site.xml to Flink runner. This causes incorrect configuration and my Flink job fails to write to Hbase (1.1.2) using phoenix.

I am looking for option like --files in Spark to pass hbase-site.xml. When I include this file in src/main/resources, it seems to work as expected but I wanted to pick up this file from the cluster nodes from location like /etc/hbase/conf directory.

apache-flinkapache-beamhadoop-yarnflink-streamingflink-batch


Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source

Related Questions

DAG of Spark Sort application spanning two jobs

How to tail yarn logs?

MapReduce Job Failed on MultiNode

yarn error building graylog plugin with mvn package: The "path" argument must be of type string. Received type undefined

yarn command not found after installing via npm

Alias yarn to yarnpkg to avoid conflict with Hadoop Yarn

Spark 3.2.1 fetch HBase data not working with NewAPIHadoopRDD

Issue Brownie setup, not sure if ganache installed properly - chainlink hackathon

Kinesis Analytics SQL query to narrow down the sensors that are not sending data

where's socketTextStream in pyflink

What is the Java version that the Flink can support in 2022?

Flink Missing Events With Windowed Processor(Event Time Windows) and Kafka Source

Apache Flink + CEP - Detect same events

Apache Flink: AWS S3 timeout exception when starting a job from a savepoint

Kafka Client Timeout of 60000ms expired before the position for partition could be determined