[jira] [Created] (FLINK-21583) Allow comments in CSV format without having to ignore parse errors

[Shang Yuanchun (Jira)]

Nico Kruber created FLINK-21583:
-----------------------------------

             Summary: Allow comments in CSV format without having to ignore parse errors
                 Key: FLINK-21583
                 URL: https://issues.apache.org/jira/browse/FLINK-21583
             Project: Flink
          Issue Type: Improvement
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
    Affects Versions: 1.12.1
            Reporter: Nico Kruber


Currently, when you pass {{'csv.allow-comments' = 'true'}} to a table definition, you also have to set {{'csv.ignore-parse-errors' = 'true'}} to actually skip the commented-out line (and the docs mention this prominently as well). This, however, may mask actual parsing errors that you want to be notified of.

I would like to propose that {{allow-comments}} actually also skips the commented-out lines automatically because these shouldn't be used anyway.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)