Accessing the Configuration

[Márton Balassi]

Hey,

I was wondering whether there is a way to access the Configuration from an
(Stream)ExecutionEnviroment or a RichFunction. Practically I would like to
set a temporary persist path in the Configuration and access the location
somewhere during the topology.

I have followed the way the streaming checkpointdir is used, but it goes
through the getEnvironment() function of the AbstractInvokable, a path that
is rather low level for my use case.

Thanks,

Marton

[Stephan Ewen]

I think that is not possible currently. Would not be too hard to give
access to the TM config via the RuntimeContext (in a similar way as the
user code classloader, for example).

On Wed, Mar 9, 2016 at 12:38 PM, Márton Balassi <[hidden email]>
wrote:

> Hey,
>
> I was wondering whether there is a way to access the Configuration from an
> (Stream)ExecutionEnviroment or a RichFunction. Practically I would like to
> set a temporary persist path in the Configuration and access the location
> somewhere during the topology.
>
> I have followed the way the streaming checkpointdir is used, but it goes
> through the getEnvironment() function of the AbstractInvokable, a path that
> is rather low level for my use case.
>
> Thanks,
>
> Marton
>

[Márton Balassi]

Thanks for the clarification.

On Wed, Mar 9, 2016 at 2:00 PM, Stephan Ewen <[hidden email]> wrote:

> I think that is not possible currently. Would not be too hard to give
> access to the TM config via the RuntimeContext (in a similar way as the
> user code classloader, for example).
>
> On Wed, Mar 9, 2016 at 12:38 PM, Márton Balassi <[hidden email]>
> wrote:
>
> > Hey,
> >
> > I was wondering whether there is a way to access the Configuration from
> an
> > (Stream)ExecutionEnviroment or a RichFunction. Practically I would like
> to
> > set a temporary persist path in the Configuration and access the location
> > somewhere during the topology.
> >
> > I have followed the way the streaming checkpointdir is used, but it goes
> > through the getEnvironment() function of the AbstractInvokable, a path
> that
> > is rather low level for my use case.
> >
> > Thanks,
> >
> > Marton
> >
>

[Michal Fijolek]

Why not RichFunction.open(Configuration parameters)?

[Michal Fijolek]

Isn't it what RichFunction.open(Configuration parameters) is for?

[Robert Metzger]

No, the RichFunction.open(Configuration) parameter is a feature from the
DataSet API. Its for passing an operator-specific configuration through the
".withParameters(Configuration)" method.

For more infos, just search for "withParameters" here:
https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/index.html

On Sun, Mar 13, 2016 at 12:22 PM, Michal Fijolek <[hidden email]>
wrote:

> Isn't it what RichFunction.open(Configuration parameters) is for?
>
>
>
> --
> View this message in context:
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Accessing-the-Configuration-tp10696p10756.html
> Sent from the Apache Flink Mailing List archive. mailing list archive at
> Nabble.com.
>

[Michal Fijolek]

Oh I see now
thanks!