[jira] [Created] (FLINK-1318) Make quoted String parsing optional and configurable for CSVInputFormats

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-1318) Make quoted String parsing optional and configurable for CSVInputFormats

Shang Yuanchun (Jira)
Fabian Hueske created FLINK-1318:
------------------------------------

             Summary: Make quoted String parsing optional and configurable for CSVInputFormats
                 Key: FLINK-1318
                 URL: https://issues.apache.org/jira/browse/FLINK-1318
             Project: Flink
          Issue Type: Improvement
          Components: Java API, Scala API
    Affects Versions: 0.8-incubating
            Reporter: Fabian Hueske
            Assignee: Fabian Hueske
            Priority: Minor


With the current implementation of the CSVInputFormat, quoted string parsing kicks in, if the first non-whitespace character of a field is a double quote.

I see two issues with this implementation:
1. Quoted String parsing cannot be disabled
2. The quoting character is fixed to double quotes (")

I propose to add parameters to disable quoted String parsing and set the quote character.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)