Flavio Pompermaier created FLINK-5907:
-----------------------------------------
Summary: RowCsvInputFormat bug on parsing tsv
Key: FLINK-5907
URL:
https://issues.apache.org/jira/browse/FLINK-5907 Project: Flink
Issue Type: Bug
Components: Table API & SQL
Affects Versions: 1.2.0
Reporter: Flavio Pompermaier
The following snippet reproduce the problem (using the attacched file as input):
{{
char fieldDelim = '\t';
TypeInformation<?>[] fieldTypes = new TypeInformation<?>[51];
for (int i = 0; i < fieldTypes.length; i++) {
fieldTypes[i] = BasicTypeInfo.STRING_TYPE_INFO;
}
int[] fieldMask = new int[fieldTypes.length];
for (int i = 0; i < fieldMask.length; i++) {
fieldMask[i] = i;
}
RowCsvInputFormat csvIF = new RowCsvInputFormat(new Path(testCsv), fieldTypes, "\n", fieldDelim +"",
fieldMask, true);
csvIF.setNestedFileEnumeration(true);
DataSet<Row> csv = env.createInput(csvIF);
csv.print()
}}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)