flink runtime incompatibility with java 9 or above due to akka version

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

flink runtime incompatibility with java 9 or above due to akka version

Matthieu Bonneviot
Hi
i am working on migrating my flink cluster to 1.7.1 with java 11.
I am facing a runtime error in the taskmanager:
2019-01-24 14:43:37,014 ERROR
akka.remote.Remoting                                          - class [B
cannot be cast to class [C ([B and [C are in module java.base of loader
'bootstrap')
java.lang.ClassCastException: class [B cannot be cast to class [C ([B and
[C are in module java.base of loader 'bootstrap')
        at akka.remote.artery.FastHash$.ofString(LruBoundedCache.scala:18)
        at
akka.remote.serialization.ActorRefResolveCache.hash(ActorRefResolveCache.scala:61)

This error is due to a code optimization done in akka which is not working
anymore from java 9.

I have open an issue for more details:
https://issues.apache.org/jira/browse/FLINK-11431

Are you facing the same issue?

Regards
Matthieu Bonneviot

--
Matthieu Bonneviot
Senior Engineer, DataDome
M +33 7 68 29 79 34  <+33+7+68+29+79+34>
E [hidden email]  <[hidden email]>
W www.datadome.co
<http://www.datadome.co?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature>
<https://www.facebook.com/datadome/?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature>
<https://fr.linkedin.com/company/datadome?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature>
<https://twitter.com/data_dome?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature>

<https://datadome.co/forrester-strong-performer-2018/?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature>
DataDome
ranked 'Strong Performer' in latest Forrester Bot management report
<https://datadome.co/forrester-strong-performer-2018/?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature>
Reply | Threaded
Open this post in threaded view
|

Re: flink runtime incompatibility with java 9 or above due to akka version

Chesnay Schepler-3
Flink only runs on java 8. There were efforts to add support for java 9
in 1.8 but in turned into a massive rabbit hole with rather wide
implications, like the akka version upgrade that you just found.

On 24.01.2019 17:04, Matthieu Bonneviot wrote:

> Hi
> i am working on migrating my flink cluster to 1.7.1 with java 11.
> I am facing a runtime error in the taskmanager:
> 2019-01-24 14:43:37,014 ERROR
> akka.remote.Remoting                                          - class [B
> cannot be cast to class [C ([B and [C are in module java.base of loader
> 'bootstrap')
> java.lang.ClassCastException: class [B cannot be cast to class [C ([B and
> [C are in module java.base of loader 'bootstrap')
>          at akka.remote.artery.FastHash$.ofString(LruBoundedCache.scala:18)
>          at
> akka.remote.serialization.ActorRefResolveCache.hash(ActorRefResolveCache.scala:61)
>
> This error is due to a code optimization done in akka which is not working
> anymore from java 9.
>
> I have open an issue for more details:
> https://issues.apache.org/jira/browse/FLINK-11431
>
> Are you facing the same issue?
>
> Regards
> Matthieu Bonneviot
>

Reply | Threaded
Open this post in threaded view
|

Re: flink runtime incompatibility with java 9 or above due to akka version

Gary Yao-2
In reply to this post by Matthieu Bonneviot
Hi Matthieu,

Flink is not Java 9 compatible at the moment [1]. Although Flink can be
compiled with Java 9, not all tests are currently passing. For a list of
modules that have failing tests, see [2].

The problem that you found persists in Akka versions prior to 2.5.6 [3][4].

Best,
Gary

[1] https://issues.apache.org/jira/browse/FLINK-8033
[2]
https://github.com/apache/flink/blob/700e5a6c2563253791408e8008e421d77b42f3e3/tools/travis/stage.sh#L73
[3] https://akka.io/blog/news/2017/09/28/akka-2.5.6-released
[4] https://github.com/akka/akka/issues/23702

On Thu, Jan 24, 2019 at 5:04 PM Matthieu Bonneviot <
[hidden email]> wrote:

> Hi
> i am working on migrating my flink cluster to 1.7.1 with java 11.
> I am facing a runtime error in the taskmanager:
> 2019-01-24 14:43:37,014 ERROR
> akka.remote.Remoting                                          - class [B
> cannot be cast to class [C ([B and [C are in module java.base of loader
> 'bootstrap')
> java.lang.ClassCastException: class [B cannot be cast to class [C ([B and
> [C are in module java.base of loader 'bootstrap')
>         at akka.remote.artery.FastHash$.ofString(LruBoundedCache.scala:18)
>         at
>
> akka.remote.serialization.ActorRefResolveCache.hash(ActorRefResolveCache.scala:61)
>
> This error is due to a code optimization done in akka which is not working
> anymore from java 9.
>
> I have open an issue for more details:
> https://issues.apache.org/jira/browse/FLINK-11431
>
> Are you facing the same issue?
>
> Regards
> Matthieu Bonneviot
>
> --
> Matthieu Bonneviot
> Senior Engineer, DataDome
> M +33 7 68 29 79 34  <+33+7+68+29+79+34>
> E [hidden email]  <[hidden email]>
> W www.datadome.co
> <
> http://www.datadome.co?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature
> >
> <
> https://www.facebook.com/datadome/?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature
> >
> <
> https://fr.linkedin.com/company/datadome?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature
> >
> <
> https://twitter.com/data_dome?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature
> >
>
> <
> https://datadome.co/forrester-strong-performer-2018/?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature
> >
> DataDome
> ranked 'Strong Performer' in latest Forrester Bot management report
> <
> https://datadome.co/forrester-strong-performer-2018/?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature
> >
>