[jira] [Created] (FLINK-22189) Flink SQL Client Hudi batch write crashes JobManager

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-22189) Flink SQL Client Hudi batch write crashes JobManager

Shang Yuanchun (Jira)
Phil Chen created FLINK-22189:
---------------------------------

             Summary: Flink SQL Client Hudi batch write crashes JobManager
                 Key: FLINK-22189
                 URL: https://issues.apache.org/jira/browse/FLINK-22189
             Project: Flink
          Issue Type: Bug
          Components: Client / Job Submission
    Affects Versions: 1.11.3
            Reporter: Phil Chen
         Attachments: flink-pchen-standalonesession-0-Phils-MBP.fios-router.home.log

Flink SQL> create table t2(

> uuid varchar(20),
> name varchar(10),
> age int,
> ts timestamp(3),
> `partition` varchar(20)
> )
> PARTITIONED BY (`partition`)
> with (
> 'connector' = 'hudi',
> 'path' = 'file:///tmp/hudi/t2'
> );
[INFO] Table has been created.

Flink SQL> insert into t2 values
> ('id1','Danny',23,TIMESTAMP '1970-01-01 00:00:01','par1'),
> ('id2','Stephen',33,TIMESTAMP '1970-01-01 00:00:02','par1'),
> ('id3','Julian',53,TIMESTAMP '1970-01-01 00:00:03','par2'),
> ('id4','Fabian',31,TIMESTAMP '1970-01-01 00:00:04','par2'),
> ('id5','Sophia',18,TIMESTAMP '1970-01-01 00:00:05','par3'),
> ('id6','Emma',20,TIMESTAMP '1970-01-01 00:00:06','par3'),
> ('id7','Bob',44,TIMESTAMP '1970-01-01 00:00:07','par4'),
> ('id8','Han',56,TIMESTAMP '1970-01-01 00:00:08','par4');
[INFO] Submitting SQL update statement to the cluster...
[INFO] Table update statement has been successfully submitted to the cluster:
Job ID: f5828dfb80550b82f9a2f15afe2439a0

 

Check flink dashboard at [http://localhost:8081|http://localhost:8081/]
JM crashed.

 

Hadoop version: 3.2.2

Apache Hudi version:
lib/hudi-flink-bundle_2.11-0.8.0.jar

See attached JobManager log.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)