[jira] [Created] (FLINK-21863) SortPartition should allow chaining of KeySelectors to support different sorting orders for the fields

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-21863) SortPartition should allow chaining of KeySelectors to support different sorting orders for the fields

Shang Yuanchun (Jira)
Etienne Chauchot created FLINK-21863:
----------------------------------------

             Summary: SortPartition should allow chaining of KeySelectors to support different sorting orders for the fields
                 Key: FLINK-21863
                 URL: https://issues.apache.org/jira/browse/FLINK-21863
             Project: Flink
          Issue Type: Improvement
            Reporter: Etienne Chauchot


If we need to sort data in a DataSet using a KeySelector (for example to extract avro fields or when sort using field index or name is not available) we cannot have different sort orders for the fields. We can sort by a list of fields by making the keySelector return a tuple but they will all be sorted in the same order.
 To allow _sort by field 1 ASC, field 2 DESC_ kind of semantics with KeySelectors we need to be able to chain the KeySelectors like this
{code:java}
DataSet.sortPartition(field1KeySelector , Order.ASCENDING)
                .sortPartition(field2KeySelector, Order.DESCENDING)
{code}
which is currently not possible.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)