[jira] [Created] (FLINK-6229) Rework setup&configuration of PythonPlanBinder/operators

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-6229) Rework setup&configuration of PythonPlanBinder/operators

Shang Yuanchun (Jira)
Chesnay Schepler created FLINK-6229:
---------------------------------------

             Summary: Rework setup&configuration of PythonPlanBinder/operators
                 Key: FLINK-6229
                 URL: https://issues.apache.org/jira/browse/FLINK-6229
             Project: Flink
          Issue Type: Improvement
          Components: Python API
    Affects Versions: 1.3.0
            Reporter: Chesnay Schepler
            Assignee: Chesnay Schepler
            Priority: Minor
             Fix For: 1.3.0


The Python API has a few problems in regards to the setup and configuration.

The PythonPlanBinder has several non-final static fields that store critical information; which python version to use, the path for the distributed cache, etc. that are directly accessed by operators instead of passing them on explicitly or storing them in a configuration.

The naming of methods & arguments in the file setup phase (copy to local tmp location, upload to DFS, register at DC) is less readable than it could be.

The binary path configuration can be stream-lined to use a single key instead of one each for python2 and python 3.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)