Can we use ZK as HA for flink JM cluster(deployed in k8s standalone session mode)

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Can we use ZK as HA for flink JM cluster(deployed in k8s standalone session mode)

bhagi@R
Hi Team,

I deployed Flink cluster on Kubernetes Cluster (Session Mode). i tried to
configure JM HA with zookeeper.
but leader election is not happening. JM are restarting and going into
crashloopBackoff mode.

[zk: localhost:2181(CONNECTED) 8] get /leader/resource_manager_lock
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =
NoNode for /leader/resource_manager_lock

04-05-2021_jobmanager.log
<http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/file/t1598/04-05-2021_jobmanager.log>  
04-05-2021_taskmanager.log
<http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/file/t1598/04-05-2021_taskmanager.log>  




--
Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Can we use ZK as HA for flink JM cluster(deployed in k8s standalone session mode)

Yun Gao
Hi,

Logically using zk HA on k8s cluster is supported.

Attaching files is not support by apache mail server, could
you update the files into some file server and paste the
connections ?

Best,
Yun


------------------------------------------------------------------
Sender:bhagi@R<[hidden email]>
Date:2021/05/04 21:08:25
Recipient:<[hidden email]>
Theme:Can we use ZK as HA for flink JM cluster(deployed in k8s standalone session mode)

Hi Team,

I deployed Flink cluster on Kubernetes Cluster (Session Mode). i tried to
configure JM HA with zookeeper.
but leader election is not happening. JM are restarting and going into
crashloopBackoff mode.

[zk: localhost:2181(CONNECTED) 8] get /leader/resource_manager_lock
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =
NoNode for /leader/resource_manager_lock

04-05-2021_jobmanager.log
<http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/file/t1598/04-05-2021_jobmanager.log>  
04-05-2021_taskmanager.log
<http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/file/t1598/04-05-2021_taskmanager.log>  




--
Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/