[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
Re: Sharing state between subtasks
Kafka Streams handles this problem, time alignment, by processing records
from the partitions with the lowest timestamp in a best effort basis.
See KIP-353 for the details. The same could be done within the Kafka
source and multiple input stream operators. I opened FLINK-4558
<https://issues.apache.org/jira/browse/FLINK-4558> a while ago regarding
this topic.
On Mon, Oct 8, 2018 at 3:41 PM Jamie Grier <jgrier@xxxxxxxx.invalid> wrote:
> I'd be very curious to hear others' thoughts on this.. I would expect many
> people to have run into similar issues. I also wonder if anybody has
> already been working on similar issues. It seems there is room for some
> core Flink changes to address this as well and I'm guessing people have
> already thought about it.
>