[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (FLINK-10432) Introduce bulk/group-aware scheduling

Stefan Richter created FLINK-10432:

             Summary: Introduce bulk/group-aware scheduling
                 Key: FLINK-10432
                 URL: https://issues.apache.org/jira/browse/FLINK-10432
             Project: Flink
          Issue Type: Sub-task
          Components: Distributed Coordination
    Affects Versions: 1.7.0
            Reporter: Stefan Richter
            Assignee: Stefan Richter

In this step, we change our new Scheduler to support reasoning over a bulk of Executions before interacting with the SlotPool instead of requesting slots on a per-execution basis. This gives us the opportunity to group and schedule tasks together as one unit and to apply scheduling algorithms that require a more holistic view on the tasks at hand. For now, this step will probably mainly address streaming / EAGER scheduling. After this step, we expect that we can support the use-case of local recovery.

This message was sent by Atlassian JIRA