[jira] [Created] (FLINK-10168) support filtering files by modified/created time in StreamExecutionEnvironment.readFile()

[Shang Yuanchun (Jira)]

Bowen Li created FLINK-10168:
--------------------------------

             Summary: support filtering files by modified/created time in StreamExecutionEnvironment.readFile()
                 Key: FLINK-10168
                 URL: https://issues.apache.org/jira/browse/FLINK-10168
             Project: Flink
          Issue Type: Improvement
          Components: DataStream API
    Affects Versions: 1.6.0
            Reporter: Bowen Li
             Fix For: 1.7.0


support filtering files by modified/created time in {{StreamExecutionEnvironment.readFile()}}

for example, in a source dir with lots of file, we only want to read files that is created or modified after a specific time.

This API can expose a generic filter function of files, and let users define filtering rules. Currently Flink only supports filtering files by path.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)