Solution for Why running Flink batch program immediately exit after job submitted to Yarn?
is Given Below:
I run a Flink batch program (using v1.13) on yarn cluster with this command
./flink run-application -t yarn-application --class flinkutils.generated.Test3NNLSkewFlink executorflink_2.12-0.1.jar
However, when the job is submitted to Yarn application, my program exit immediately. I didn’t run it on detached mode. In my program I print out some result to console. Where does the print out go? I can’t find it in yarn log too. and when I tried to store some string in HDFS using
reflect.io.File("hdfs:///user/s2124875/output/Test3NNLSkewFlink.json").writeAll(latency) , I got an error
java.io.FileNotFoundException: hdfs:/user/s2124875/output/Test3NNLSkewFlink.json (No such file or directory). How to write text to HDFS in Flink ?