Investigating flinK

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Investigating flinK

Diana El-Masri
Hi,

I am starting my PhD at "Ecole Polytechnique of Montreal" on IoT log  
management. I am considering using Flink for my edge layer processing.  
Could please advise if there is a possibility to write a flink plugin  
that intercepts and modify the logs before they are sent to the  
user/cloud. if yes, what is the best way to achieve this with Flink?
Thanks

Reply | Threaded
Open this post in threaded view
|

Re: Investigating flinK

Chesnay Schepler-3
Are you referring to the log files of Flink?

On 11/5/2020 7:01 PM, Diana El-Masri wrote:

> Hi,
>
> I am starting my PhD at "Ecole Polytechnique of Montreal" on IoT log
> management. I am considering using Flink for my edge layer processing.
> Could please advise if there is a possibility to write a flink plugin
> that intercepts and modify the logs before they are sent to the
> user/cloud. if yes, what is the best way to achieve this with Flink?
> Thanks
>
>

Reply | Threaded
Open this post in threaded view
|

Re: Investigating flinK

Diana El-Masri
Hi,

No the logs of the sources connected to flink.

Thanks

Chesnay Schepler <[hidden email]> a écrit :

> Are you referring to the log files of Flink?
>
> On 11/5/2020 7:01 PM, Diana El-Masri wrote:
>> Hi,
>>
>> I am starting my PhD at "Ecole Polytechnique of Montreal" on IoT  
>> log management. I am considering using Flink for my edge layer  
>> processing. Could please advise if there is a possibility to write  
>> a flink plugin that intercepts and modify the logs before they are  
>> sent to the user/cloud. if yes, what is the best way to achieve  
>> this with Flink?
>> Thanks
>>
>>



Reply | Threaded
Open this post in threaded view
|

Re: Investigating flinK

Kaibo Zhou
Hi, you can write a custom log appender that modifies the logs before they
are sent.

Thanks.

Diana El-Masri <[hidden email]> 于2020年11月6日周五 上午7:47写道:

> Hi,
>
> No the logs of the sources connected to flink.
>
> Thanks
>
> Chesnay Schepler <[hidden email]> a écrit :
>
> > Are you referring to the log files of Flink?
> >
> > On 11/5/2020 7:01 PM, Diana El-Masri wrote:
> >> Hi,
> >>
> >> I am starting my PhD at "Ecole Polytechnique of Montreal" on IoT
> >> log management. I am considering using Flink for my edge layer
> >> processing. Could please advise if there is a possibility to write
> >> a flink plugin that intercepts and modify the logs before they are
> >> sent to the user/cloud. if yes, what is the best way to achieve
> >> this with Flink?
> >> Thanks
> >>
> >>
>
>
>
>