(DEPRECATED) Apache Flink Mailing List archive.

[DISCUSS] Removing the flink-mapr-fs module

Classic

List

Threaded

15 messages Options

Aljoscha Krettek-2

[DISCUSS] Removing the flink-mapr-fs module

Hi,

Because of recent problems in the dependencies of that module [1] I would suggest that we remove it. If people are using it, they can use the one from Flink 1.8.

What do you think about it? It would a) solve the dependency problem and b) make our build a tiny smidgen more lightweight.

Aljoscha

[1] https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E

Jeff Zhang

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 to remove it.

Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：

> Hi,
>
> Because of recent problems in the dependencies of that module [1] I would
> suggest that we remove it. If people are using it, they can use the one
> from Flink 1.8.
>
> What do you think about it? It would a) solve the dependency problem and
> b) make our build a tiny smidgen more lightweight.
>
> Aljoscha
>
> [1]
> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E

--
Best Regards

Jeff Zhang

Ufuk Celebi-2

Re: [DISCUSS] Removing the flink-mapr-fs module

+1

On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]> wrote:

> +1 to remove it.
>
> Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：
>
> > Hi,
> >
> > Because of recent problems in the dependencies of that module [1] I would
> > suggest that we remove it. If people are using it, they can use the one
> > from Flink 1.8.
> >
> > What do you think about it? It would a) solve the dependency problem and
> > b) make our build a tiny smidgen more lightweight.
> >
> > Aljoscha
> >
> > [1]
> >
> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
>
>
>
> --
> Best Regards
>
> Jeff Zhang
>

Biao Liu

Re: [DISCUSS] Removing the flink-mapr-fs module

Hi Aljoscha,

Does it mean the MapRFileSystem is no longer supported since 1.9.0?

On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi <[hidden email]> wrote:

> +1
>
>
> On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]> wrote:
>
> > +1 to remove it.
> >
> > Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：
> >
> > > Hi,
> > >
> > > Because of recent problems in the dependencies of that module [1] I
> would
> > > suggest that we remove it. If people are using it, they can use the one
> > > from Flink 1.8.
> > >
> > > What do you think about it? It would a) solve the dependency problem
> and
> > > b) make our build a tiny smidgen more lightweight.
> > >
> > > Aljoscha
> > >
> > > [1]
> > >
> >
> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
> >
> >
> >
> > --
> > Best Regards
> >
> > Jeff Zhang
> >
>

Aljoscha Krettek-2

Re: [DISCUSS] Removing the flink-mapr-fs module

If we remove it, that would mean it’s not supported in Flink 1.9.0, yes. Or we only remove it in Flink 1.10.0.

Aljoscha

> On 29. Jul 2019, at 11:35, Biao Liu <[hidden email]> wrote:
>
> Hi Aljoscha,
>
> Does it mean the MapRFileSystem is no longer supported since 1.9.0?
>
> On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi <[hidden email]> wrote:
>
>> +1
>>
>>
>> On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]> wrote:
>>
>>> +1 to remove it.
>>>
>>> Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：
>>>
>>>> Hi,
>>>>
>>>> Because of recent problems in the dependencies of that module [1] I
>> would
>>>> suggest that we remove it. If people are using it, they can use the one
>>>> from Flink 1.8.
>>>>
>>>> What do you think about it? It would a) solve the dependency problem
>> and
>>>> b) make our build a tiny smidgen more lightweight.
>>>>
>>>> Aljoscha
>>>>
>>>> [1]
>>>>
>>>
>> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
>>>
>>>
>>>
>>> --
>>> Best Regards
>>>
>>> Jeff Zhang
>>>
>>

Biao Liu

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 for removing it.

Actually I encountered this issue several times. I thought it might be
blocked by firewall of China :(

BTW, I think it should be included in release notes.

On Mon, Jul 29, 2019 at 5:37 PM Aljoscha Krettek <[hidden email]>
wrote:

> If we remove it, that would mean it’s not supported in Flink 1.9.0, yes.
> Or we only remove it in Flink 1.10.0.
>
> Aljoscha
>
> > On 29. Jul 2019, at 11:35, Biao Liu <[hidden email]> wrote:
> >
> > Hi Aljoscha,
> >
> > Does it mean the MapRFileSystem is no longer supported since 1.9.0?
> >
> > On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi <[hidden email]> wrote:
> >
> >> +1
> >>
> >>
> >> On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]> wrote:
> >>
> >>> +1 to remove it.
> >>>
> >>> Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：
> >>>
> >>>> Hi,
> >>>>
> >>>> Because of recent problems in the dependencies of that module [1] I
> >> would
> >>>> suggest that we remove it. If people are using it, they can use the
> one
> >>>> from Flink 1.8.
> >>>>
> >>>> What do you think about it? It would a) solve the dependency problem
> >> and
> >>>> b) make our build a tiny smidgen more lightweight.
> >>>>
> >>>> Aljoscha
> >>>>
> >>>> [1]
> >>>>
> >>>
> >>
> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
> >>>
> >>>
> >>>
> >>> --
> >>> Best Regards
> >>>
> >>> Jeff Zhang
> >>>
> >>
>
>

JingsongLee-2

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 for removing it. We never run mvn clean test success in China with mapr-fs...
Best, Jingsong Lee

------------------------------------------------------------------
From:Biao Liu <[hidden email]>
Send Time:2019年7月29日(星期一) 12:05
To:dev <[hidden email]>
Subject:Re: [DISCUSS] Removing the flink-mapr-fs module

+1 for removing it.

Actually I encountered this issue several times. I thought it might be
blocked by firewall of China :(

BTW, I think it should be included in release notes.

On Mon, Jul 29, 2019 at 5:37 PM Aljoscha Krettek <[hidden email]>
wrote:

Stephan Ewen

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 to remove it

One should still be able to use MapR in the same way as any other vendor
Hadoop distribution.

On Mon, Jul 29, 2019 at 12:22 PM JingsongLee
<[hidden email]> wrote:

> +1 for removing it. We never run mvn clean test success in China with
> mapr-fs...
> Best, Jingsong Lee
>
>
> ------------------------------------------------------------------
> From:Biao Liu <[hidden email]>
> Send Time:2019年7月29日(星期一) 12:05
> To:dev <[hidden email]>
> Subject:Re: [DISCUSS] Removing the flink-mapr-fs module
>
> +1 for removing it.
>
> Actually I encountered this issue several times. I thought it might be
> blocked by firewall of China :(
>
> BTW, I think it should be included in release notes.
>
>
> On Mon, Jul 29, 2019 at 5:37 PM Aljoscha Krettek <[hidden email]>
> wrote:
>
> > If we remove it, that would mean it’s not supported in Flink 1.9.0, yes.
> > Or we only remove it in Flink 1.10.0.
> >
> > Aljoscha
> >
> > > On 29. Jul 2019, at 11:35, Biao Liu <[hidden email]> wrote:
> > >
> > > Hi Aljoscha,
> > >
> > > Does it mean the MapRFileSystem is no longer supported since 1.9.0?
> > >
> > > On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi <[hidden email]> wrote:
> > >
> > >> +1
> > >>
> > >>
> > >> On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]> wrote:
> > >>
> > >>> +1 to remove it.
> > >>>
> > >>> Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：
> > >>>
> > >>>> Hi,
> > >>>>
> > >>>> Because of recent problems in the dependencies of that module [1] I
> > >> would
> > >>>> suggest that we remove it. If people are using it, they can use the
> > one
> > >>>> from Flink 1.8.
> > >>>>
> > >>>> What do you think about it? It would a) solve the dependency problem
> > >> and
> > >>>> b) make our build a tiny smidgen more lightweight.
> > >>>>
> > >>>> Aljoscha
> > >>>>
> > >>>> [1]
> > >>>>
> > >>>
> > >>
> >
> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
> > >>>
> > >>>
> > >>>
> > >>> --
> > >>> Best Regards
> > >>>
> > >>> Jeff Zhang
> > >>>
> > >>
> >
> >
>

Till Rohrmann

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 to remove it.

On Mon, Jul 29, 2019 at 1:27 PM Stephan Ewen <[hidden email]> wrote:

> +1 to remove it
>
> One should still be able to use MapR in the same way as any other vendor
> Hadoop distribution.
>
> On Mon, Jul 29, 2019 at 12:22 PM JingsongLee
> <[hidden email]> wrote:
>
> > +1 for removing it. We never run mvn clean test success in China with
> > mapr-fs...
> > Best, Jingsong Lee
> >
> >
> > ------------------------------------------------------------------
> > From:Biao Liu <[hidden email]>
> > Send Time:2019年7月29日(星期一) 12:05
> > To:dev <[hidden email]>
> > Subject:Re: [DISCUSS] Removing the flink-mapr-fs module
> >
> > +1 for removing it.
> >
> > Actually I encountered this issue several times. I thought it might be
> > blocked by firewall of China :(
> >
> > BTW, I think it should be included in release notes.
> >
> >
> > On Mon, Jul 29, 2019 at 5:37 PM Aljoscha Krettek <[hidden email]>
> > wrote:
> >
> > > If we remove it, that would mean it’s not supported in Flink 1.9.0,
> yes.
> > > Or we only remove it in Flink 1.10.0.
> > >
> > > Aljoscha
> > >
> > > > On 29. Jul 2019, at 11:35, Biao Liu <[hidden email]> wrote:
> > > >
> > > > Hi Aljoscha,
> > > >
> > > > Does it mean the MapRFileSystem is no longer supported since 1.9.0?
> > > >
> > > > On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi <[hidden email]> wrote:
> > > >
> > > >> +1
> > > >>
> > > >>
> > > >> On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]>
> wrote:
> > > >>
> > > >>> +1 to remove it.
> > > >>>
> > > >>> Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：
> > > >>>
> > > >>>> Hi,
> > > >>>>
> > > >>>> Because of recent problems in the dependencies of that module [1]
> I
> > > >> would
> > > >>>> suggest that we remove it. If people are using it, they can use
> the
> > > one
> > > >>>> from Flink 1.8.
> > > >>>>
> > > >>>> What do you think about it? It would a) solve the dependency
> problem
> > > >> and
> > > >>>> b) make our build a tiny smidgen more lightweight.
> > > >>>>
> > > >>>> Aljoscha
> > > >>>>
> > > >>>> [1]
> > > >>>>
> > > >>>
> > > >>
> > >
> >
> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
> > > >>>
> > > >>>
> > > >>>
> > > >>> --
> > > >>> Best Regards
> > > >>>
> > > >>> Jeff Zhang
> > > >>>
> > > >>
> > >
> > >
> >
>

Simon Su

Re: [DISCUSS] Removing the flink-mapr-fs module

+1 to remove it.

Thanks,
SImon

On 07/29/2019 21:00，Till Rohrmann<[hidden email]> wrote：
+1 to remove it.

On Mon, Jul 29, 2019 at 1:27 PM Stephan Ewen <[hidden email]> wrote:

+1 to remove it

One should still be able to use MapR in the same way as any other vendor
Hadoop distribution.

On Mon, Jul 29, 2019 at 12:22 PM JingsongLee
<[hidden email]> wrote:

+1 for removing it. We never run mvn clean test success in China with
mapr-fs...
Best, Jingsong Lee

------------------------------------------------------------------
From:Biao Liu <[hidden email]>
Send Time:2019年7月29日(星期一) 12:05
To:dev <[hidden email]>
Subject:Re: [DISCUSS] Removing the flink-mapr-fs module

+1 for removing it.

Actually I encountered this issue several times. I thought it might be
blocked by firewall of China :(

BTW, I think it should be included in release notes.

On Mon, Jul 29, 2019 at 5:37 PM Aljoscha Krettek <[hidden email]>
wrote:

If we remove it, that would mean it’s not supported in Flink 1.9.0,
yes.
Or we only remove it in Flink 1.10.0.

Aljoscha

On 29. Jul 2019, at 11:35, Biao Liu <[hidden email]> wrote:

Hi Aljoscha,

Does it mean the MapRFileSystem is no longer supported since 1.9.0?

On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi <[hidden email]> wrote:

+1

On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]>
wrote:

+1 to remove it.

Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：

Hi,

Because of recent problems in the dependencies of that module [1]
I
would
suggest that we remove it. If people are using it, they can use
the
one
from Flink 1.8.

What do you think about it? It would a) solve the dependency
problem
and
b) make our build a tiny smidgen more lightweight.

Aljoscha

[1]

https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E

--
Best Regards

Jeff Zhang

Aljoscha Krettek-2

Re: [DISCUSS] Removing the flink-mapr-fs module

Just FYI, the MapRFileSystem does have some additional code on our (Hadoop)FileSystem class, so it might not be straightforward to use MapR with our vanilla HadoopFileSystem.

(Still staying that we should remove it, though).

Aljoscha

> On 29. Jul 2019, at 15:16, Simon Su <[hidden email]> wrote:
>
> +1 to remove it.
>
>
> Thanks,
> SImon
>
>
> On 07/29/2019 21:00，Till Rohrmann<[hidden email]> wrote：
> +1 to remove it.
>
> On Mon, Jul 29, 2019 at 1:27 PM Stephan Ewen <[hidden email]> wrote:
>
> +1 to remove it
>
> One should still be able to use MapR in the same way as any other vendor
> Hadoop distribution.
>
> On Mon, Jul 29, 2019 at 12:22 PM JingsongLee
> <[hidden email]> wrote:
>
> +1 for removing it. We never run mvn clean test success in China with
> mapr-fs...
> Best, Jingsong Lee
>
>
> ------------------------------------------------------------------
> From:Biao Liu <[hidden email]>
> Send Time:2019年7月29日(星期一) 12:05
> To:dev <[hidden email]>
> Subject:Re: [DISCUSS] Removing the flink-mapr-fs module
>
> +1 for removing it.
>
> Actually I encountered this issue several times. I thought it might be
> blocked by firewall of China :(
>
> BTW, I think it should be included in release notes.
>
>
> On Mon, Jul 29, 2019 at 5:37 PM Aljoscha Krettek <[hidden email]>
> wrote:
>
> If we remove it, that would mean it’s not supported in Flink 1.9.0,
> yes.
> Or we only remove it in Flink 1.10.0.
>
> Aljoscha
>
> On 29. Jul 2019, at 11:35, Biao Liu <[hidden email]> wrote:
>
> Hi Aljoscha,
>
> Does it mean the MapRFileSystem is no longer supported since 1.9.0?
>
> On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi <[hidden email]> wrote:
>
> +1
>
>
> On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]>
> wrote:
>
> +1 to remove it.
>
> Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：
>
> Hi,
>
> Because of recent problems in the dependencies of that module [1]
> I
> would
> suggest that we remove it. If people are using it, they can use
> the
> one
> from Flink 1.8.
>
> What do you think about it? It would a) solve the dependency
> problem
> and
> b) make our build a tiny smidgen more lightweight.
>
> Aljoscha
>
> [1]
>
>
>
>
>
> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
>
>
>
> --
> Best Regards
>
> Jeff Zhang
>
>
>
>
>
>

Stephan Ewen

Re: [DISCUSS] Removing the flink-mapr-fs module

It should be fairly straightforward to rewrite the code to not have a MapR
dependency.
Only one class from the MapR dependency is ever referenced, and we could
dynamically load that class.

That way we can drop the dependency without dropping the support.

On Mon, Jul 29, 2019 at 5:33 PM Aljoscha Krettek <[hidden email]>
wrote:

> Just FYI, the MapRFileSystem does have some additional code on our
> (Hadoop)FileSystem class, so it might not be straightforward to use MapR
> with our vanilla HadoopFileSystem.
>
> (Still staying that we should remove it, though).
>
> Aljoscha
>
> > On 29. Jul 2019, at 15:16, Simon Su <[hidden email]> wrote:
> >
> > +1 to remove it.
> >
> >
> > Thanks,
> > SImon
> >
> >
> > On 07/29/2019 21:00，Till Rohrmann<[hidden email]> wrote：
> > +1 to remove it.
> >
> > On Mon, Jul 29, 2019 at 1:27 PM Stephan Ewen <[hidden email]> wrote:
> >
> > +1 to remove it
> >
> > One should still be able to use MapR in the same way as any other vendor
> > Hadoop distribution.
> >
> > On Mon, Jul 29, 2019 at 12:22 PM JingsongLee
> > <[hidden email]> wrote:
> >
> > +1 for removing it. We never run mvn clean test success in China with
> > mapr-fs...
> > Best, Jingsong Lee
> >
> >
> > ------------------------------------------------------------------
> > From:Biao Liu <[hidden email]>
> > Send Time:2019年7月29日(星期一) 12:05
> > To:dev <[hidden email]>
> > Subject:Re: [DISCUSS] Removing the flink-mapr-fs module
> >
> > +1 for removing it.
> >
> > Actually I encountered this issue several times. I thought it might be
> > blocked by firewall of China :(
> >
> > BTW, I think it should be included in release notes.
> >
> >
> > On Mon, Jul 29, 2019 at 5:37 PM Aljoscha Krettek <[hidden email]>
> > wrote:
> >
> > If we remove it, that would mean it’s not supported in Flink 1.9.0,
> > yes.
> > Or we only remove it in Flink 1.10.0.
> >
> > Aljoscha
> >
> > On 29. Jul 2019, at 11:35, Biao Liu <[hidden email]> wrote:
> >
> > Hi Aljoscha,
> >
> > Does it mean the MapRFileSystem is no longer supported since 1.9.0?
> >
> > On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi <[hidden email]> wrote:
> >
> > +1
> >
> >
> > On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]>
> > wrote:
> >
> > +1 to remove it.
> >
> > Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：
> >
> > Hi,
> >
> > Because of recent problems in the dependencies of that module [1]
> > I
> > would
> > suggest that we remove it. If people are using it, they can use
> > the
> > one
> > from Flink 1.8.
> >
> > What do you think about it? It would a) solve the dependency
> > problem
> > and
> > b) make our build a tiny smidgen more lightweight.
> >
> > Aljoscha
> >
> > [1]
> >
> >
> >
> >
> >
> >
> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
> >
> >
> >
> > --
> > Best Regards
> >
> > Jeff Zhang
> >
> >
> >
> >
> >
> >
>
>

Rong Rong

Re: [DISCUSS] Removing the flink-mapr-fs module

We've also experienced some issues with our internal JFrog artifactory. I
am suspecting some sort of mirroring problem but somehow it only occur to
the mapr-fs module.
So +1 to remove.

On Mon, Jul 29, 2019 at 12:47 PM Stephan Ewen <[hidden email]> wrote:

> It should be fairly straightforward to rewrite the code to not have a MapR
> dependency.
> Only one class from the MapR dependency is ever referenced, and we could
> dynamically load that class.
>
> That way we can drop the dependency without dropping the support.
>
> On Mon, Jul 29, 2019 at 5:33 PM Aljoscha Krettek <[hidden email]>
> wrote:
>
> > Just FYI, the MapRFileSystem does have some additional code on our
> > (Hadoop)FileSystem class, so it might not be straightforward to use MapR
> > with our vanilla HadoopFileSystem.
> >
> > (Still staying that we should remove it, though).
> >
> > Aljoscha
> >
> > > On 29. Jul 2019, at 15:16, Simon Su <[hidden email]> wrote:
> > >
> > > +1 to remove it.
> > >
> > >
> > > Thanks,
> > > SImon
> > >
> > >
> > > On 07/29/2019 21:00，Till Rohrmann<[hidden email]> wrote：
> > > +1 to remove it.
> > >
> > > On Mon, Jul 29, 2019 at 1:27 PM Stephan Ewen <[hidden email]> wrote:
> > >
> > > +1 to remove it
> > >
> > > One should still be able to use MapR in the same way as any other
> vendor
> > > Hadoop distribution.
> > >
> > > On Mon, Jul 29, 2019 at 12:22 PM JingsongLee
> > > <[hidden email]> wrote:
> > >
> > > +1 for removing it. We never run mvn clean test success in China with
> > > mapr-fs...
> > > Best, Jingsong Lee
> > >
> > >
> > > ------------------------------------------------------------------
> > > From:Biao Liu <[hidden email]>
> > > Send Time:2019年7月29日(星期一) 12:05
> > > To:dev <[hidden email]>
> > > Subject:Re: [DISCUSS] Removing the flink-mapr-fs module
> > >
> > > +1 for removing it.
> > >
> > > Actually I encountered this issue several times. I thought it might be
> > > blocked by firewall of China :(
> > >
> > > BTW, I think it should be included in release notes.
> > >
> > >
> > > On Mon, Jul 29, 2019 at 5:37 PM Aljoscha Krettek <[hidden email]>
> > > wrote:
> > >
> > > If we remove it, that would mean it’s not supported in Flink 1.9.0,
> > > yes.
> > > Or we only remove it in Flink 1.10.0.
> > >
> > > Aljoscha
> > >
> > > On 29. Jul 2019, at 11:35, Biao Liu <[hidden email]> wrote:
> > >
> > > Hi Aljoscha,
> > >
> > > Does it mean the MapRFileSystem is no longer supported since 1.9.0?
> > >
> > > On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi <[hidden email]> wrote:
> > >
> > > +1
> > >
> > >
> > > On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]>
> > > wrote:
> > >
> > > +1 to remove it.
> > >
> > > Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：
> > >
> > > Hi,
> > >
> > > Because of recent problems in the dependencies of that module [1]
> > > I
> > > would
> > > suggest that we remove it. If people are using it, they can use
> > > the
> > > one
> > > from Flink 1.8.
> > >
> > > What do you think about it? It would a) solve the dependency
> > > problem
> > > and
> > > b) make our build a tiny smidgen more lightweight.
> > >
> > > Aljoscha
> > >
> > > [1]
> > >
> > >
> > >
> > >
> > >
> > >
> >
> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
> > >
> > >
> > >
> > > --
> > > Best Regards
> > >
> > > Jeff Zhang
> > >
> > >
> > >
> > >
> > >
> > >
> >
> >
>

Stephan Ewen

Re: [DISCUSS] Removing the flink-mapr-fs module

I will open a PR later today, changing the module to use reflection rather
than a hard MapR dependency.

On Tue, Jul 30, 2019 at 6:40 AM Rong Rong <[hidden email]> wrote:

> We've also experienced some issues with our internal JFrog artifactory. I
> am suspecting some sort of mirroring problem but somehow it only occur to
> the mapr-fs module.
> So +1 to remove.
>
> On Mon, Jul 29, 2019 at 12:47 PM Stephan Ewen <[hidden email]> wrote:
>
> > It should be fairly straightforward to rewrite the code to not have a
> MapR
> > dependency.
> > Only one class from the MapR dependency is ever referenced, and we could
> > dynamically load that class.
> >
> > That way we can drop the dependency without dropping the support.
> >
> > On Mon, Jul 29, 2019 at 5:33 PM Aljoscha Krettek <[hidden email]>
> > wrote:
> >
> > > Just FYI, the MapRFileSystem does have some additional code on our
> > > (Hadoop)FileSystem class, so it might not be straightforward to use
> MapR
> > > with our vanilla HadoopFileSystem.
> > >
> > > (Still staying that we should remove it, though).
> > >
> > > Aljoscha
> > >
> > > > On 29. Jul 2019, at 15:16, Simon Su <[hidden email]> wrote:
> > > >
> > > > +1 to remove it.
> > > >
> > > >
> > > > Thanks,
> > > > SImon
> > > >
> > > >
> > > > On 07/29/2019 21:00，Till Rohrmann<[hidden email]> wrote：
> > > > +1 to remove it.
> > > >
> > > > On Mon, Jul 29, 2019 at 1:27 PM Stephan Ewen <[hidden email]>
> wrote:
> > > >
> > > > +1 to remove it
> > > >
> > > > One should still be able to use MapR in the same way as any other
> > vendor
> > > > Hadoop distribution.
> > > >
> > > > On Mon, Jul 29, 2019 at 12:22 PM JingsongLee
> > > > <[hidden email]> wrote:
> > > >
> > > > +1 for removing it. We never run mvn clean test success in China with
> > > > mapr-fs...
> > > > Best, Jingsong Lee
> > > >
> > > >
> > > > ------------------------------------------------------------------
> > > > From:Biao Liu <[hidden email]>
> > > > Send Time:2019年7月29日(星期一) 12:05
> > > > To:dev <[hidden email]>
> > > > Subject:Re: [DISCUSS] Removing the flink-mapr-fs module
> > > >
> > > > +1 for removing it.
> > > >
> > > > Actually I encountered this issue several times. I thought it might
> be
> > > > blocked by firewall of China :(
> > > >
> > > > BTW, I think it should be included in release notes.
> > > >
> > > >
> > > > On Mon, Jul 29, 2019 at 5:37 PM Aljoscha Krettek <
> [hidden email]>
> > > > wrote:
> > > >
> > > > If we remove it, that would mean it’s not supported in Flink 1.9.0,
> > > > yes.
> > > > Or we only remove it in Flink 1.10.0.
> > > >
> > > > Aljoscha
> > > >
> > > > On 29. Jul 2019, at 11:35, Biao Liu <[hidden email]> wrote:
> > > >
> > > > Hi Aljoscha,
> > > >
> > > > Does it mean the MapRFileSystem is no longer supported since 1.9.0?
> > > >
> > > > On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi <[hidden email]> wrote:
> > > >
> > > > +1
> > > >
> > > >
> > > > On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]>
> > > > wrote:
> > > >
> > > > +1 to remove it.
> > > >
> > > > Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：
> > > >
> > > > Hi,
> > > >
> > > > Because of recent problems in the dependencies of that module [1]
> > > > I
> > > > would
> > > > suggest that we remove it. If people are using it, they can use
> > > > the
> > > > one
> > > > from Flink 1.8.
> > > >
> > > > What do you think about it? It would a) solve the dependency
> > > > problem
> > > > and
> > > > b) make our build a tiny smidgen more lightweight.
> > > >
> > > > Aljoscha
> > > >
> > > > [1]
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > >
> >
> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
> > > >
> > > >
> > > >
> > > > --
> > > > Best Regards
> > > >
> > > > Jeff Zhang
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
>

Stephan Ewen

Re: [DISCUSS] Removing the flink-mapr-fs module

This has been fixed in master and 1.9, see
https://issues.apache.org/jira/browse/FLINK-13499

On Tue, Jul 30, 2019 at 3:28 PM Stephan Ewen <[hidden email]> wrote:

> I will open a PR later today, changing the module to use reflection rather
> than a hard MapR dependency.
>
> On Tue, Jul 30, 2019 at 6:40 AM Rong Rong <[hidden email]> wrote:
>
>> We've also experienced some issues with our internal JFrog artifactory. I
>> am suspecting some sort of mirroring problem but somehow it only occur to
>> the mapr-fs module.
>> So +1 to remove.
>>
>> On Mon, Jul 29, 2019 at 12:47 PM Stephan Ewen <[hidden email]> wrote:
>>
>> > It should be fairly straightforward to rewrite the code to not have a
>> MapR
>> > dependency.
>> > Only one class from the MapR dependency is ever referenced, and we could
>> > dynamically load that class.
>> >
>> > That way we can drop the dependency without dropping the support.
>> >
>> > On Mon, Jul 29, 2019 at 5:33 PM Aljoscha Krettek <[hidden email]>
>> > wrote:
>> >
>> > > Just FYI, the MapRFileSystem does have some additional code on our
>> > > (Hadoop)FileSystem class, so it might not be straightforward to use
>> MapR
>> > > with our vanilla HadoopFileSystem.
>> > >
>> > > (Still staying that we should remove it, though).
>> > >
>> > > Aljoscha
>> > >
>> > > > On 29. Jul 2019, at 15:16, Simon Su <[hidden email]> wrote:
>> > > >
>> > > > +1 to remove it.
>> > > >
>> > > >
>> > > > Thanks,
>> > > > SImon
>> > > >
>> > > >
>> > > > On 07/29/2019 21:00，Till Rohrmann<[hidden email]> wrote：
>> > > > +1 to remove it.
>> > > >
>> > > > On Mon, Jul 29, 2019 at 1:27 PM Stephan Ewen <[hidden email]>
>> wrote:
>> > > >
>> > > > +1 to remove it
>> > > >
>> > > > One should still be able to use MapR in the same way as any other
>> > vendor
>> > > > Hadoop distribution.
>> > > >
>> > > > On Mon, Jul 29, 2019 at 12:22 PM JingsongLee
>> > > > <[hidden email]> wrote:
>> > > >
>> > > > +1 for removing it. We never run mvn clean test success in China
>> with
>> > > > mapr-fs...
>> > > > Best, Jingsong Lee
>> > > >
>> > > >
>> > > > ------------------------------------------------------------------
>> > > > From:Biao Liu <[hidden email]>
>> > > > Send Time:2019年7月29日(星期一) 12:05
>> > > > To:dev <[hidden email]>
>> > > > Subject:Re: [DISCUSS] Removing the flink-mapr-fs module
>> > > >
>> > > > +1 for removing it.
>> > > >
>> > > > Actually I encountered this issue several times. I thought it might
>> be
>> > > > blocked by firewall of China :(
>> > > >
>> > > > BTW, I think it should be included in release notes.
>> > > >
>> > > >
>> > > > On Mon, Jul 29, 2019 at 5:37 PM Aljoscha Krettek <
>> [hidden email]>
>> > > > wrote:
>> > > >
>> > > > If we remove it, that would mean it’s not supported in Flink 1.9.0,
>> > > > yes.
>> > > > Or we only remove it in Flink 1.10.0.
>> > > >
>> > > > Aljoscha
>> > > >
>> > > > On 29. Jul 2019, at 11:35, Biao Liu <[hidden email]> wrote:
>> > > >
>> > > > Hi Aljoscha,
>> > > >
>> > > > Does it mean the MapRFileSystem is no longer supported since 1.9.0?
>> > > >
>> > > > On Mon, Jul 29, 2019 at 5:19 PM Ufuk Celebi <[hidden email]> wrote:
>> > > >
>> > > > +1
>> > > >
>> > > >
>> > > > On Mon, Jul 29, 2019 at 11:06 AM Jeff Zhang <[hidden email]>
>> > > > wrote:
>> > > >
>> > > > +1 to remove it.
>> > > >
>> > > > Aljoscha Krettek <[hidden email]> 于2019年7月29日周一下午5:01写道：
>> > > >
>> > > > Hi,
>> > > >
>> > > > Because of recent problems in the dependencies of that module [1]
>> > > > I
>> > > > would
>> > > > suggest that we remove it. If people are using it, they can use
>> > > > the
>> > > > one
>> > > > from Flink 1.8.
>> > > >
>> > > > What do you think about it? It would a) solve the dependency
>> > > > problem
>> > > > and
>> > > > b) make our build a tiny smidgen more lightweight.
>> > > >
>> > > > Aljoscha
>> > > >
>> > > > [1]
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > >
>> >
>> https://lists.apache.org/thread.html/16c16db8f4b94dc47e638f059fd53be936d5da423376a8c1092eaad1@%3Cdev.flink.apache.org%3E
>> > > >
>> > > >
>> > > >
>> > > > --
>> > > > Best Regards
>> > > >
>> > > > Jeff Zhang
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > >
>> > >
>> >
>>
>