Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cascading-Flink not working with EMR Flink 1.3.2 #72

Open
mehikmat opened this issue Aug 8, 2018 · 0 comments
Open

Cascading-Flink not working with EMR Flink 1.3.2 #72

mehikmat opened this issue Aug 8, 2018 · 0 comments

Comments

@mehikmat
Copy link

mehikmat commented Aug 8, 2018

I am thinking of using flink over EMR YARN. We have some hadoop jobs written in casdcading version 3.2.0 and hadoop 2.7.0.

Today, I tried to use latest cascading flink connector(ver 0.3.0) but got the folloing error while running OVER YARN:

Application application_1533715496882_0002 failed 1 times due to AM Container for appattempt_1533715496882_0002_000001 exited with exitCode: 31
For more detailed output, check application tracking page:http://ip-172-16-15-140.us-east-1.compute.internal:8088/cluster/app/application_1533715496882_0002Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1533715496882_0002_01_000001
Exit code: 31
Stack trace: ExitCodeException exitCode=31:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:582)
at org.apache.hadoop.util.Shell.run(Shell.java:479)

It seems that current version of cascading flink supports only flink 1.0.3 and cascading 3.1.0 but EMR has Flink version 1.3.2.

So are we planing to upgrade flink version and casdcading version in the lastest casdcading flink...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant