Apache Flink transactions

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Apache Flink transactions

hawin
Hi  Admin

 

Do we have insert, update and remove operations on Apache Flink?

For example:  I have 10 million records in my test file.  I want to add one
record, update one record and remove one record from this test file.

How to implement it by Flink?

Thanks.

 

 

 

 

Best regards

Email: [hidden email]

Reply | Threaded
Open this post in threaded view
|

RE: Apache Flink transactions

hawin
Hi  Admin

 

Do we have insert, update and remove operations on Apache Flink?

For example:  I have 10 million records in my test file.  I want to add one
record, update one record and remove one record from this test file.

How to implement it by Flink?

Thanks.

 

 

 

 

Best regards

Email: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: Apache Flink transactions

Stephan Ewen
To run operations like Insert, Update, Delete on persistent files, you have
to have support from the storage engine.

The Apache ORC data format recently added support for transactional
inserts, updates, deletes. http://orc.apache.org/

ORC has a Hadoop input format, and you can use that one with Flink through
the Hadoop wrappers.



 ORC

On Thu, Jun 4, 2015 at 9:45 AM, Hawin Jiang <[hidden email]> wrote:

> Hi  Admin
>
>
>
> Do we have insert, update and remove operations on Apache Flink?
>
> For example:  I have 10 million records in my test file.  I want to add one
> record, update one record and remove one record from this test file.
>
> How to implement it by Flink?
>
> Thanks.
>
>
>
>
>
>
>
>
>
> Best regards
>
> Email: [hidden email]
>
>