[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]


On 7 Aug 2018, at 06:51, Timo Walther <twalthr@xxxxxxxxxx> wrote:

Hi Esa,

the SQL/CEP integration might be part of Flink 1.7. The discussion has just been started again [1].


[1] https://issues.apache.org/jira/browse/FLINK-6935

Am 07.08.18 um 15:36 schrieb Esa Heikkinen:

There was one good example of pattern query in the paper made by SASE+ language (in attachment).


Could you easily say how to do that FlickCEP with Scala ? Or is it possible ?


That SQL and CEP would also be very interesting, but when it is ready to use ?


BR Esa


From: vino yang <yanghua1127@xxxxxxxxx>
Sent: Monday, July 23, 2018 3:00 PM
To: Esa Heikkinen <esa.heikkinen@xxxxxxxxxxxxxx>
Cc: Till Rohrmann <trohrmann@xxxxxxxxxx>; Chesnay Schepler <chesnay@xxxxxxxxxx>; user <user@xxxxxxxxxxxxxxxx>
Subject: Re: FlinkCEP and scientific papers ?


Hi Esa,


I think the core implementation pattern is still based that paper, there is a package named "nfa"[1] contains the main thought.


The latest CEP module added more features and enhanced the old versio. What's more, there is a FLIP-20 which has been accepted, it described how to integrate with SQL and CEP.[2] 


I think there is no newer paper related to current Flink CEP.



Thanks, vino.



2018-07-23 16:05 GMT+08:00 Esa Heikkinen <esa.heikkinen@xxxxxxxxxxxxxx>:



Thank you. This was very good paper for me J


How much current FlinkCEP works like this (the paper was written 2008) ?


Are there exist newer papers related to current FlinkCEP ?


BR Esa


From: Till Rohrmann <trohrmann@xxxxxxxxxx>
Sent: Wednesday, July 18, 2018 9:38 AM
To: vino yang <yanghua1127@xxxxxxxxx>
Cc: Esa Heikkinen <esa.heikkinen@xxxxxxxxxxxxxx>; Chesnay Schepler <chesnay@xxxxxxxxxx>; user <user@xxxxxxxxxxxxxxxx>
Subject: Re: FlinkCEP and scientific papers ?


You are right Vino,


the initial implementation was based on the above mentioned paper.





On Tue, Jul 17, 2018 at 5:34 PM vino yang <yanghua1127@xxxxxxxxx> wrote:

Hi Esa,


AFAIK, the earlier Flink CEP refers to the Paper Efficient Pattern Matching over Event Streams[1]. Flink absorbed  two major idea from this paper:


1. NFA-b model on event stream

2. a shared versioned match buffer which is a optimized data structure


To Till and Chesnay:


Did I missed anything when as time goes on and the development of Flink? If yes, please give your additional remarks.



Thanks, vino.


2018-07-17 22:01 GMT+08:00 Esa Heikkinen <esa.heikkinen@xxxxxxxxxxxxxx>:



I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?


I know Flink is based to Stratosphere, but how is it FlinkCEP ?


BR Esa