[jira] [Created] (FLINK-21643) JDBC sink should be able to execute statements on multiple tables

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-21643) JDBC sink should be able to execute statements on multiple tables

Shang Yuanchun (Jira)
Maciej Obuchowski created FLINK-21643:
-----------------------------------------

             Summary: JDBC sink should be able to execute statements on multiple tables
                 Key: FLINK-21643
                 URL: https://issues.apache.org/jira/browse/FLINK-21643
             Project: Flink
          Issue Type: New Feature
          Components: Connectors / JDBC
    Affects Versions: 1.12.2
            Reporter: Maciej Obuchowski


Currently datastream JDBC sink supports outputting data only to one table - by having to provide SQL template, from which SimpleBatchStatementExecutor creates PreparedStatement. Creating multiple sinks, each of which writes data to one table is impractical for moderate to large number of tables - relational databases don't usually tolerate large number of connections.

I propose adding DynamicBatchStatementExecutor, which will additionally require

1) provided mechanism to create SQL statements based on given object
2) cache for prepared statements
3) mechanism for determining which statement should be used for given object



--
This message was sent by Atlassian Jira
(v8.3.4#803005)