[jira] [Created] (FLINK-2061) CSVReader: quotedStringParsing and includeFields yields ParseException

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-2061) CSVReader: quotedStringParsing and includeFields yields ParseException

Shang Yuanchun (Jira)
Fabian Hueske created FLINK-2061:
------------------------------------

             Summary: CSVReader: quotedStringParsing and includeFields yields ParseException
                 Key: FLINK-2061
                 URL: https://issues.apache.org/jira/browse/FLINK-2061
             Project: Flink
          Issue Type: Bug
          Components: Core
    Affects Versions: 0.9
            Reporter: Fabian Hueske


Fields in a CSV file with quoted String cannot be skipped.

Parsing a line such as:

{code}
"20:41:52-1-3-2015"|"Re: Taskmanager memory error in Eclipse"|"Stephan Ewen <[hidden email]>"|"bla"|"blubb"
{code}

with a CSVReader configured as:

{code}
DataSet<Tuple2<String, String>> data =
                        env.readCsvFile("/path/to/my/data")
                                .lineDelimiter("\n")
                                .fieldDelimiter("|")
                                .parseQuotedStrings('"')
                                .includeFields("101")
                                .types(String.class, String.class);
{code}

gives a {{ParseException}}.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)