[jira] [Created] (FLINK-2435) Add support for custom CSV field parsers

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-2435) Add support for custom CSV field parsers

Shang Yuanchun (Jira)
Fabian Hueske created FLINK-2435:
------------------------------------

             Summary: Add support for custom CSV field parsers
                 Key: FLINK-2435
                 URL: https://issues.apache.org/jira/browse/FLINK-2435
             Project: Flink
          Issue Type: New Feature
          Components: Java API, Scala API
    Affects Versions: 0.10
            Reporter: Fabian Hueske


The {{CSVInputFormats}} have only {{FieldParsers}} for Java's primitive types (byte, short, int, long, float, double, boolean, String).

It would be good to add support for CSV field parsers for custom data types which can be registered in a {{CSVReader}}.
We could offer two interfaces for field parsers.

1. The regular low-level {{FieldParser}} which operates on a byte array and offsets.
2. A {{StringFieldParser}} which operates on a String that has been extracted by a {{StringParser}} before. This interface will be easier to implement but less efficient.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)