[jira] [Created] (FLINK-11747) Elasticsearch6 - Expose RestHighLevelClient to allow for custom sniffing

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-11747) Elasticsearch6 - Expose RestHighLevelClient to allow for custom sniffing

Shang Yuanchun (Jira)
Samir Desai created FLINK-11747:
-----------------------------------

             Summary: Elasticsearch6 - Expose RestHighLevelClient to allow for custom sniffing
                 Key: FLINK-11747
                 URL: https://issues.apache.org/jira/browse/FLINK-11747
             Project: Flink
          Issue Type: Wish
          Components: ElasticSearch Connector
            Reporter: Samir Desai


In the Elasticsearch6 connector, the [RestClientFactory|https://github.com/apache/flink/blob/release-1.6/flink-connectors/flink-connector-elasticsearch6/src/main/java/org/apache/flink/streaming/connectors/elasticsearch6/RestClientFactory.java#L31] allows users to customize the {{RestClientBuilder}}. However, certain customizations like adding [Sniffing|https://www.elastic.co/guide/en/elasticsearch/client/java-rest/master/_usage.html]
require access to the low-level rest client, which can be obtained through the high level rest client. The {{RestHighLevelClient}} is [instantiated|https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-elasticsearch-base/src/main/java/org/apache/flink/streaming/connectors/elasticsearch/ElasticsearchSinkBase.java#L191] in the api call bridge, and is never exposed to the user.

To my knowledge, the current Elasticsearch6 connector does not utilize sniffing or provide a way to add it in. The Elasticsearch6 connector should expose some type of access to the RestHighLevelClient to allow for custom sniffing.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)