[jira] [Created] (FLINK-22669) Support date format in a path when use filesytem as source

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-22669) Support date format in a path when use filesytem as source

Shang Yuanchun (Jira)
wangqinghuan created FLINK-22669:
------------------------------------

             Summary: Support date format in a path when use filesytem as source
                 Key: FLINK-22669
                 URL: https://issues.apache.org/jira/browse/FLINK-22669
             Project: Flink
          Issue Type: Bug
            Reporter: wangqinghuan


Do we have suggestions to support date format in a file path when using filesystem as source?

For example:

{{CREATE TABLE fs_table (}}

{{...}}

{{)}}{{ WITH (}}

{{  'connector'='filesystem',}}

{{  'path'='ftp:/tmp/\{yyyy-MM-dd}/data',}}

{{'format'='parquet'}}{{}}{{);}}

the \{yyyy-MM-dd} expression in path will be replaced with actual system time.

*Why support this?*

date expression support will be used in some scheduled jobs, such as running a daily job to read  current day data from FTP which will create a new file path using date expression every day.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)