osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (FLINK-10887) Add source watermarking tracking to the JobMaster


Jamie Grier created FLINK-10887:
-----------------------------------

             Summary: Add source watermarking tracking to the JobMaster
                 Key: FLINK-10887
                 URL: https://issues.apache.org/jira/browse/FLINK-10887
             Project: Flink
          Issue Type: Sub-task
          Components: JobManager
            Reporter: Jamie Grier
            Assignee: Jamie Grier


We need to add a new RPC to the JobMaster such that the current watermark for every source sub-task can be reported and the current global minimum/maximum watermark can be retrieved so that each source can adjust their partition read rates in an attempt to keep sources roughly aligned in event time.

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)