[jira] [Created] (FLINK-20573) Set the function of abnormal event time filter

[Shang Yuanchun (Jira)]

Xiao Cai created FLINK-20573:
--------------------------------

             Summary: Set the function of abnormal event time filter
                 Key: FLINK-20573
                 URL: https://issues.apache.org/jira/browse/FLINK-20573
             Project: Flink
          Issue Type: Improvement
          Components: Table SQL / API
    Affects Versions: 1.11.2
            Reporter: Xiao Cai


Currently, after defining the event time and watermark in flink sql, if abnormal data is received, such as test data, and it happens that the event time of that test data is very large, it will cause the watermark of the whole stream to become large, so that any normal data coming in afterwards will not be processed by the stream.
Is it possible to set a configuration item in 'with' to identify what kind of data is abnormal data that can be automatically filtered, such as event time more than half an hour or more than 2 hours from the current time, will be automatically filtered by the stream; or the event time of an event with a certain value range in the event stream id will not affect the stream's watermark generation.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)