[jira] [Created] (FLINK-19819) SourceReaderBase supports limit push down

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-19819) SourceReaderBase supports limit push down

Shang Yuanchun (Jira)
Jingsong Lee created FLINK-19819:
------------------------------------

             Summary: SourceReaderBase supports limit push down
                 Key: FLINK-19819
                 URL: https://issues.apache.org/jira/browse/FLINK-19819
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / Common
            Reporter: Jingsong Lee
             Fix For: 1.12.0


User requirement:

Users need to look at a few randomĀ pieces of data in a table to see what the data looks like. So users often use the SQL:

"select * from table limit 10"

For a large table, expect to end soon because only a few pieces of data are queried.

For DataStream or BoundedStream, they are push based execution models, so the downstream cannot control the end of source operator.

We need push down limit to source operator, so that source operator canĀ end early.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)