[jira] [Created] (FLINK-13886) Need to develop flink-connector-elasticsearch7

[Shang Yuanchun (Jira)]

Leonid Ilyevsky created FLINK-13886:
---------------------------------------

             Summary: Need to develop flink-connector-elasticsearch7
                 Key: FLINK-13886
                 URL: https://issues.apache.org/jira/browse/FLINK-13886
             Project: Flink
          Issue Type: Improvement
            Reporter: Leonid Ilyevsky


The flink-connector-elasticsearch6 is not compatible with Elasticsearch 7.x.

If you try to use elasticsearch-rest-high-level-client version 7.x with flink-connector-elasticsearch6 instead of 6.x, you get fatal exception:

{{java.lang.NoSuchMethodError: org.elasticsearch.client.RestHighLevelClient.ping([Lorg/apache/http/Header;)Z}}
{{ at org.apache.flink.streaming.connectors.elasticsearch6.Elasticsearch6ApiCallBridge.createClient(Elasticsearch6ApiCallBridge.java:81)}}

{{......}}

 

Some changes in Elastic 7.x make it necessary to use compatible client library, specifically the deprecated 'type' element in the document structure. 

With 6.x client library the 'type' element is mandatory, so it has to be in each document, but then the 7.x sever will send back a warning for every single document. Workaround: suppress those warnings in the logging configuration.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)