Functions in Flick

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Functions in Flick

david david
Hi,
I want to use Stateful Functions in Flick.
Could you please clarify on the below?

1. To use  the stateful function in a serverless kubernetes , what I need to install in serverless and kubernetes env.?
Looks like I have many options and looking for some detailed info.

2. How much data (or how big the file size must be) can a stateful function can process? Is there any limit that the fuction can hold or process?

Thanks in advance!
Reply | Threaded
Open this post in threaded view
|

Re: Functions in Flick

Robert Metzger
Hi David,

1. Here's an example on how to deploy Stateful Functions on Kubernetes:
https://github.com/apache/flink-statefun/tree/master/statefun-examples/statefun-python-k8s-example
You don't need to install anything in a serverless environment for using it.

2. Since the underlying processing happens on the Flink framework, you can
process a lot of data with StateFun. How much data you can process depends
on the hardware you are using (network speed, memory, disk, network speeds
...). The functions can process messages as large as a few megabytes, and
for the state size, the same restrictions as with Flink apply: With
RocksDB, you can store hundreds of GB of state per machine.

Best,
Robert


On Sat, Jul 11, 2020 at 10:43 AM david david <[hidden email]> wrote:

> Hi,
> I want to use Stateful Functions in Flick.
> Could you please clarify on the below?
>
> 1. To use  the stateful function in a serverless kubernetes , what I need
> to install in serverless and kubernetes env.?
> Looks like I have many options and looking for some detailed info.
>
> 2. How much data (or how big the file size must be) can a stateful
> function can process? Is there any limit that the fuction can hold or
> process?
>
> Thanks in advance!
>