question about SlidingPreReducer.java

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

question about SlidingPreReducer.java

Ma GuoWei
hi guysThere is a function updateCurrent() in this class(SlidingPreReducer).I think there is no chance to run the following code in this function:currentReduced = reducer.reduce(serializer.copy(currentReduced), element);Can any one give me a example that can run this code.  (I have already see all the test case)thanks a lot
     
Reply | Threaded
Open this post in threaded view
|

Re: question about SlidingPreReducer.java

till.rohrmann
Hi MaGuoWei,

do you mean that the branch of the if statement (line 130) is never
executed? Or are you looking for an example which uses the SlidingPreReducer
?

Cheers,
Till


On Thu, Jul 30, 2015 at 11:33 AM, MaGuoWei <[hidden email]> wrote:

> hi guysThere is a function updateCurrent() in this
> class(SlidingPreReducer).I think there is no chance to run the following
> code in this function:currentReduced =
> reducer.reduce(serializer.copy(currentReduced), element);Can any one give
> me a example that can run this code.  (I have already see all the test
> case)thanks a lot
>
Reply | Threaded
Open this post in threaded view
|

Re: question about SlidingPreReducer.java

Ma GuoWei
hi till
I mean the branch of the if statement is never execute.
thanks

发自我的 iPhone

> 在 2015年7月30日,下午5:51,Till Rohrmann <[hidden email]> 写道:
>
> Hi MaGuoWei,
>
> do you mean that the branch of the if statement (line 130) is never
> executed? Or are you looking for an example which uses the SlidingPreReducer
> ?
>
> Cheers,
> Till
> ​
>
>> On Thu, Jul 30, 2015 at 11:33 AM, MaGuoWei <[hidden email]> wrote:
>>
>> hi guysThere is a function updateCurrent() in this
>> class(SlidingPreReducer).I think there is no chance to run the following
>> code in this function:currentReduced =
>> reducer.reduce(serializer.copy(currentReduced), element);Can any one give
>> me a example that can run this code.  (I have already see all the test
>> case)thanks a lot
>>
Reply | Threaded
Open this post in threaded view
|

Re: question about SlidingPreReducer.java

till.rohrmann
But if the updateCurrent method is called at least twice with a value
different from null, then the else branch should be executed if I’m not
mistaken. In the first call currentReduced will be sets to something other
than null (if branch) and in the second call the reducer will be called
with the next element (else branch).


On Thu, Jul 30, 2015 at 11:54 AM, MaGuoWei <[hidden email]> wrote:

> hi till
> I mean the branch of the if statement is never execute.
> thanks
>
> 发自我的 iPhone
>
> > 在 2015年7月30日,下午5:51,Till Rohrmann <[hidden email]> 写道:
> >
> > Hi MaGuoWei,
> >
> > do you mean that the branch of the if statement (line 130) is never
> > executed? Or are you looking for an example which uses the
> SlidingPreReducer
> > ?
> >
> > Cheers,
> > Till
> > ​
> >
> >> On Thu, Jul 30, 2015 at 11:33 AM, MaGuoWei <[hidden email]>
> wrote:
> >>
> >> hi guysThere is a function updateCurrent() in this
> >> class(SlidingPreReducer).I think there is no chance to run the following
> >> code in this function:currentReduced =
> >> reducer.reduce(serializer.copy(currentReduced), element);Can any one
> give
> >> me a example that can run this code.  (I have already see all the test
> >> case)thanks a lot
> >>
>
Reply | Threaded
Open this post in threaded view
|

Re: question about SlidingPreReducer.java

Aljoscha Krettek-2
In reply to this post by Ma GuoWei
Hi,
I also had this suspicion in the past. The sliding pre reducers are
horribly slow. For example, this code:

ds.window(...).every(...).mapWindow(new MyWindowMapReducer())

is a lot faster than this:

ds.window(...).every(...).reduceWindow(new MyWindowReducer())

We are currently working on this for the next release (0.10).

On Thu, 30 Jul 2015 at 11:54 MaGuoWei <[hidden email]> wrote:

> hi till
> I mean the branch of the if statement is never execute.
> thanks
>
> 发自我的 iPhone
>
> > 在 2015年7月30日,下午5:51,Till Rohrmann <[hidden email]> 写道:
> >
> > Hi MaGuoWei,
> >
> > do you mean that the branch of the if statement (line 130) is never
> > executed? Or are you looking for an example which uses the
> SlidingPreReducer
> > ?
> >
> > Cheers,
> > Till
> > ​
> >
> >> On Thu, Jul 30, 2015 at 11:33 AM, MaGuoWei <[hidden email]>
> wrote:
> >>
> >> hi guysThere is a function updateCurrent() in this
> >> class(SlidingPreReducer).I think there is no chance to run the following
> >> code in this function:currentReduced =
> >> reducer.reduce(serializer.copy(currentReduced), element);Can any one
> give
> >> me a example that can run this code.  (I have already see all the test
> >> case)thanks a lot
> >>
>
Reply | Threaded
Open this post in threaded view
|

RE: question about SlidingPreReducer.java

Ma GuoWei
In reply to this post by till.rohrmann
I find function addToBufferIfEligible always resets currentReduced to null so that branch can never be reached.  (SlidingCountPreReducer.java)
 

> Date: Thu, 30 Jul 2015 12:06:54 +0200
> Subject: Re: question about SlidingPreReducer.java
> From: [hidden email]
> To: [hidden email]
>
> But if the updateCurrent method is called at least twice with a value
> different from null, then the else branch should be executed if I’m not
> mistaken. In the first call currentReduced will be sets to something other
> than null (if branch) and in the second call the reducer will be called
> with the next element (else branch).
> ​
>
> On Thu, Jul 30, 2015 at 11:54 AM, MaGuoWei <[hidden email]> wrote:
>
> > hi till
> > I mean the branch of the if statement is never execute.
> > thanks
> >
> > 发自我的 iPhone
> >
> > > 在 2015年7月30日,下午5:51,Till Rohrmann <[hidden email]> 写道:
> > >
> > > Hi MaGuoWei,
> > >
> > > do you mean that the branch of the if statement (line 130) is never
> > > executed? Or are you looking for an example which uses the
> > SlidingPreReducer
> > > ?
> > >
> > > Cheers,
> > > Till
> > > ​
> > >
> > >> On Thu, Jul 30, 2015 at 11:33 AM, MaGuoWei <[hidden email]>
> > wrote:
> > >>
> > >> hi guysThere is a function updateCurrent() in this
> > >> class(SlidingPreReducer).I think there is no chance to run the following
> > >> code in this function:currentReduced =
> > >> reducer.reduce(serializer.copy(currentReduced), element);Can any one
> > give
> > >> me a example that can run this code.  (I have already see all the test
> > >> case)thanks a lot
> > >>
> >
     
Reply | Threaded
Open this post in threaded view
|

Re: question about SlidingPreReducer.java

Aljoscha Krettek-2
Yes, this is also what I figured.

On Thu, 30 Jul 2015 at 12:21 MaGuoWei <[hidden email]> wrote:

> I find function addToBufferIfEligible always resets currentReduced to null
> so that branch can never be reached.  (SlidingCountPreReducer.java)
>
>
> > Date: Thu, 30 Jul 2015 12:06:54 +0200
> > Subject: Re: question about SlidingPreReducer.java
> > From: [hidden email]
> > To: [hidden email]
> >
> > But if the updateCurrent method is called at least twice with a value
> > different from null, then the else branch should be executed if I’m not
> > mistaken. In the first call currentReduced will be sets to something
> other
> > than null (if branch) and in the second call the reducer will be called
> > with the next element (else branch).
> > ​
> >
> > On Thu, Jul 30, 2015 at 11:54 AM, MaGuoWei <[hidden email]> wrote:
> >
> > > hi till
> > > I mean the branch of the if statement is never execute.
> > > thanks
> > >
> > > 发自我的 iPhone
> > >
> > > > 在 2015年7月30日,下午5:51,Till Rohrmann <[hidden email]> 写道:
> > > >
> > > > Hi MaGuoWei,
> > > >
> > > > do you mean that the branch of the if statement (line 130) is never
> > > > executed? Or are you looking for an example which uses the
> > > SlidingPreReducer
> > > > ?
> > > >
> > > > Cheers,
> > > > Till
> > > > ​
> > > >
> > > >> On Thu, Jul 30, 2015 at 11:33 AM, MaGuoWei <[hidden email]>
> > > wrote:
> > > >>
> > > >> hi guysThere is a function updateCurrent() in this
> > > >> class(SlidingPreReducer).I think there is no chance to run the
> following
> > > >> code in this function:currentReduced =
> > > >> reducer.reduce(serializer.copy(currentReduced), element);Can any one
> > > give
> > > >> me a example that can run this code.  (I have already see all the
> test
> > > >> case)thanks a lot
> > > >>
> > >
>