[jira] [Created] (FLINK-2755) Cluster Execution - /home/user/udfs.jar

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (FLINK-2755) Cluster Execution - /home/user/udfs.jar

Shang Yuanchun (Jira)
dengjie created FLINK-2755:
------------------------------

             Summary: Cluster Execution - /home/user/udfs.jar
                 Key: FLINK-2755
                 URL: https://issues.apache.org/jira/browse/FLINK-2755
             Project: Flink
          Issue Type: Wish
            Reporter: dengjie


public static void main(String[] args) throws Exception {
    ExecutionEnvironment env = ExecutionEnvironment
        .createRemoteEnvironment("flink-master", 6123, "/home/user/udfs.jar");

    DataSet<String> data = env.readTextFile("hdfs://path/to/file");

    data
        .filter(new FilterFunction<String>() {
            public boolean filter(String value) {
                return value.startsWith("http://");
            }
        })
        .writeAsText("hdfs://path/to/result");

    env.execute();
}

How to write the file(udfs.jar),can you give an example?In addition,can this parameter as an option?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)