Run scala.App on Cluster

[Felix Neutatz]

Hi,

I try to run this Scala program:
https://github.com/FelixNeutatz/wikiTrends/blob/master/extraction/src/main/scala/io/sanfran/wikiTrends/extraction/flink/DownloadTopKPages.scala
on a cluster.

I tried this command:

/share/flink/flink-0.9-SNAPSHOT/bin/flink run
/home/neutatz/jars/extraction-1.0-SNAPSHOT.jar
io.sanfran.wikiTrends.extraction.flink.DownloadTopKPages

org.apache.flink.client.program.ProgramInvocationException: Neither a
'Main-Class', nor a 'program-class' entry was found in the jar file.
at
org.apache.flink.client.program.PackagedProgram.getEntryPointClassNameFromJar(PackagedProgram.java:501)
at
org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:134)
at
org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:102)
at org.apache.flink.client.CliFrontend.buildProgram(CliFrontend.java:654)
at org.apache.flink.client.CliFrontend.run(CliFrontend.java:256)
at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:880)
at org.apache.flink.client.CliFrontend.main(CliFrontend.java:922)

Do I have to change my Scala program or can I use another command?

Thank you for your help,
Felix

[Andra Lungu]

Hi Felix,

You need to also specify the path to your main class.
For example: ./flink run -p10-v --class
org.apache.flink.graph.example.MusicProfiles then jar and arguments

-p is the desired degree of parallelism and --class needs to be followed by
the path I was talking about,

Beast of luck :)
Andra

On Wed, Jun 10, 2015 at 10:24 PM, Felix Neutatz <[hidden email]>
wrote:

> Hi,
>
> I try to run this Scala program:
>
> https://github.com/FelixNeutatz/wikiTrends/blob/master/extraction/src/main/scala/io/sanfran/wikiTrends/extraction/flink/DownloadTopKPages.scala
> on a cluster.
>
> I tried this command:
>
> /share/flink/flink-0.9-SNAPSHOT/bin/flink run
> /home/neutatz/jars/extraction-1.0-SNAPSHOT.jar
> io.sanfran.wikiTrends.extraction.flink.DownloadTopKPages
>
> org.apache.flink.client.program.ProgramInvocationException: Neither a
> 'Main-Class', nor a 'program-class' entry was found in the jar file.
> at
>
> org.apache.flink.client.program.PackagedProgram.getEntryPointClassNameFromJar(PackagedProgram.java:501)
> at
>
> org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:134)
> at
>
> org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:102)
> at org.apache.flink.client.CliFrontend.buildProgram(CliFrontend.java:654)
> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:256)
> at
> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:880)
> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:922)
>
> Do I have to change my Scala program or can I use another command?
>
> Thank you for your help,
> Felix
>

[Fabian Hueske-2]

Hi,

use ./bin/flink run -c your.MainClass yourJar to specify the Main class.
Check the documentation of the CLI client for details.

Cheers, Fabian
On Jun 10, 2015 22:24, "Felix Neutatz" <[hidden email]> wrote:

> Hi,
>
> I try to run this Scala program:
>
> https://github.com/FelixNeutatz/wikiTrends/blob/master/extraction/src/main/scala/io/sanfran/wikiTrends/extraction/flink/DownloadTopKPages.scala
> on a cluster.
>
> I tried this command:
>
> /share/flink/flink-0.9-SNAPSHOT/bin/flink run
> /home/neutatz/jars/extraction-1.0-SNAPSHOT.jar
> io.sanfran.wikiTrends.extraction.flink.DownloadTopKPages
>
> org.apache.flink.client.program.ProgramInvocationException: Neither a
> 'Main-Class', nor a 'program-class' entry was found in the jar file.
> at
>
> org.apache.flink.client.program.PackagedProgram.getEntryPointClassNameFromJar(PackagedProgram.java:501)
> at
>
> org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:134)
> at
>
> org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:102)
> at org.apache.flink.client.CliFrontend.buildProgram(CliFrontend.java:654)
> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:256)
> at
> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:880)
> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:922)
>
> Do I have to change my Scala program or can I use another command?
>
> Thank you for your help,
> Felix
>

[Felix Neutatz]

Thanks :) works like a charm.

2015-06-10 22:28 GMT+02:00 Fabian Hueske <[hidden email]>:

> Hi,
>
> use ./bin/flink run -c your.MainClass yourJar to specify the Main class.
> Check the documentation of the CLI client for details.
>
> Cheers, Fabian
> On Jun 10, 2015 22:24, "Felix Neutatz" <[hidden email]> wrote:
>
> > Hi,
> >
> > I try to run this Scala program:
> >
> >
> https://github.com/FelixNeutatz/wikiTrends/blob/master/extraction/src/main/scala/io/sanfran/wikiTrends/extraction/flink/DownloadTopKPages.scala
> > on a cluster.
> >
> > I tried this command:
> >
> > /share/flink/flink-0.9-SNAPSHOT/bin/flink run
> > /home/neutatz/jars/extraction-1.0-SNAPSHOT.jar
> > io.sanfran.wikiTrends.extraction.flink.DownloadTopKPages
> >
> > org.apache.flink.client.program.ProgramInvocationException: Neither a
> > 'Main-Class', nor a 'program-class' entry was found in the jar file.
> > at
> >
> >
> org.apache.flink.client.program.PackagedProgram.getEntryPointClassNameFromJar(PackagedProgram.java:501)
> > at
> >
> >
> org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:134)
> > at
> >
> >
> org.apache.flink.client.program.PackagedProgram.<init>(PackagedProgram.java:102)
> > at org.apache.flink.client.CliFrontend.buildProgram(CliFrontend.java:654)
> > at org.apache.flink.client.CliFrontend.run(CliFrontend.java:256)
> > at
> > org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:880)
> > at org.apache.flink.client.CliFrontend.main(CliFrontend.java:922)
> >
> > Do I have to change my Scala program or can I use another command?
> >
> > Thank you for your help,
> > Felix
> >
>