• 集群执行
    • Command Line Interface
    • Remote Environment
      • Maven Dependency
      • Example

    集群执行

    • Command Line Interface
    • Remote Environment
      • Maven Dependency
      • Example

    Flink programs can run distributed on clusters of many machines. Thereare two ways to send a program to a cluster for execution:

    Command Line Interface

    The command line interface lets you submit packaged programs (JARs) to a cluster(or single machine setup).

    Please refer to the Command Line Interface documentation fordetails.

    Remote Environment

    The remote environment lets you execute Flink Java programs on a clusterdirectly. The remote environment points to the cluster on which you want toexecute the program.

    Maven Dependency

    If you are developing your program as a Maven project, you have to add theflink-clients module using this dependency:

    1. <dependency>
    2.   <groupId>org.apache.flink</groupId>
    3.   <artifactId>flink-clients_2.11</artifactId>
    4.   <version>1.9.0</version>
    5. </dependency>

    Example

    The following illustrates the use of the RemoteEnvironment:

    1. public static void main(String[] args) throws Exception {
    2.     ExecutionEnvironment env = ExecutionEnvironment
    3.         .createRemoteEnvironment("flink-master", 8081, "/home/user/udfs.jar");
    5.     DataSet<String> data = env.readTextFile("hdfs://path/to/file");
    7.     data
    8.         .filter(new FilterFunction<String>() {
    9.             public boolean filter(String value) {
    10.                 return value.startsWith("http://");
    11.             }
    12.         })
    13.         .writeAsText("hdfs://path/to/result");
    15.     env.execute();
    16. }

    Note that the program contains custom user code and hence requires a JAR file withthe classes of the code attached. The constructor of the remote environmenttakes the path(s) to the JAR file(s).