[jira] [Created] (FLINK-15223) Csv connector should unescape delimiter parameter character

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-15223) Csv connector should unescape delimiter parameter character

Shang Yuanchun (Jira)
Jark Wu created FLINK-15223:
-------------------------------

             Summary: Csv connector should unescape delimiter parameter character
                 Key: FLINK-15223
                 URL: https://issues.apache.org/jira/browse/FLINK-15223
             Project: Flink
          Issue Type: Bug
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
            Reporter: Jark Wu
             Fix For: 1.10.0


As described in documentation[1], a csv format can use {{'format.line-delimiter' = '\n'}} to specify line delimiter. However, the property value is parsed into two characters "\n" , this result to reading failed. There is no workaround for now, unless fix it. The delimiter should be unescaped, e.g. using {{StringEscapeUtils.unescapeJava}}. Note that both old csv and new csv have the same problem, and both {{field-delimiter}} and {{line-delimiter}}.

[1]: https://ci.apache.org/projects/flink/flink-docs-master/dev/table/connect.html#old-csv-format



--
This message was sent by Atlassian Jira
(v8.3.4#803005)