Flink GZip support

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink GZip support

Karim Alaa
Hi All,

I’m currently working with Flink 0.8.0 and I would like to know if there is or will be any support for handling Gzipped files

Thanks!
Reply | Threaded
Open this post in threaded view
|

Re: Flink GZip support

Felix Neutatz
Hi Karim,

you can use a Hadoop Input Format and read the files
using flink-hadoop-compatibility classes like here:
http://flink.apache.org/docs/0.7-incubating/hadoop_compatibility.html

Have a nice Sunday,

Felix

2015-02-22 10:02 GMT+01:00 Karim Alaa <[hidden email]>:

> Hi All,
>
> I’m currently working with Flink 0.8.0 and I would like to know if there
> is or will be any support for handling Gzipped files
>
> Thanks!
Reply | Threaded
Open this post in threaded view
|

Re: Flink GZip support

Robert Metzger
Hi Karim,

also have a look at this old discussion from the user@ list:
http://apache-flink-incubator-user-mailing-list-archive.2336050.n4.nabble.com/read-gz-files-td760.html



On Sun, Feb 22, 2015 at 10:33 AM, Felix Neutatz <[hidden email]>
wrote:

> Hi Karim,
>
> you can use a Hadoop Input Format and read the files
> using flink-hadoop-compatibility classes like here:
> http://flink.apache.org/docs/0.7-incubating/hadoop_compatibility.html
>
> Have a nice Sunday,
>
> Felix
>
> 2015-02-22 10:02 GMT+01:00 Karim Alaa <[hidden email]>:
>
> > Hi All,
> >
> > I’m currently working with Flink 0.8.0 and I would like to know if there
> > is or will be any support for handling Gzipped files
> >
> > Thanks!
>