Samir Desai created FLINK-11747:
-----------------------------------
Summary: Elasticsearch6 - Expose RestHighLevelClient to allow for custom sniffing
Key: FLINK-11747
URL:
https://issues.apache.org/jira/browse/FLINK-11747 Project: Flink
Issue Type: Wish
Components: ElasticSearch Connector
Reporter: Samir Desai
In the Elasticsearch6 connector, the [RestClientFactory|
https://github.com/apache/flink/blob/release-1.6/flink-connectors/flink-connector-elasticsearch6/src/main/java/org/apache/flink/streaming/connectors/elasticsearch6/RestClientFactory.java#L31] allows users to customize the {{RestClientBuilder}}. However, certain customizations like adding [Sniffing|
https://www.elastic.co/guide/en/elasticsearch/client/java-rest/master/_usage.html]
require access to the low-level rest client, which can be obtained through the high level rest client. The {{RestHighLevelClient}} is [instantiated|
https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-elasticsearch-base/src/main/java/org/apache/flink/streaming/connectors/elasticsearch/ElasticsearchSinkBase.java#L191] in the api call bridge, and is never exposed to the user.
To my knowledge, the current Elasticsearch6 connector does not utilize sniffing or provide a way to add it in. The Elasticsearch6 connector should expose some type of access to the RestHighLevelClient to allow for custom sniffing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)