[jira] [Created] (FLINK-13054) [Java] Support compact fixed-width vectors

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-13054) [Java] Support compact fixed-width vectors

Shang Yuanchun (Jira)
Ji Liu created FLINK-13054:
------------------------------

             Summary: [Java] Support compact fixed-width vectors
                 Key: FLINK-13054
                 URL: https://issues.apache.org/jira/browse/FLINK-13054
             Project: Flink
          Issue Type: New Feature
            Reporter: Ji Liu
            Assignee: Ji Liu


In shuffle stage of some applications, FixedWitdhVectors may have very little non-null data.
In this case, directly serialize vectors is not a good choice, generally we can compact the vector make it only holding non-null value and create a BitVector to trace the indices for non-null values so that it could be deserialized properly.





--
This message was sent by Atlassian JIRA
(v7.6.3#76005)