osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Flink 1.5 job distribution over cluster nodes


Hi,

We have 4 jobs with parallelism 3 that are running over 3 task manager with
4 slots per each , each task manager runs on a different VM ,

On Flink 1.3.2 the jobs were evenly distributed per node each job took one
task slot of each task manager .

 After upgrading to flink 1.5 , each job is running on a single task
manager (with a carry over to another if there are no slots left)

The jobs are not evenly by load which cause some task managers  to consume
more resources (CPU/memory) than other task managers.

Is there a way to return to an even distribution?

Thanks,

Shachar