HadoopInputFormat Custom Partitioning

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

HadoopInputFormat Custom Partitioning

Dominik Wosiński
Hey,
I wanted to ask if the *HadoopInputFormat* does currently support some
custom partitioning scheme ? Say I have 200 files in HDFS each having the
partitioning key in name, can we ATM use HadoopInputFormat to distribute
reading to multiple TaskManagers using the key ??


Best Regards,
Dom.