osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[ANNOUNCE] Weekly community update #47


Dear community,

this is the weekly community update thread #47. Please post any news and
updates you want to share with the community to this thread.

# Updates on sharing state between subtasks

Jamie opened a first PR to add a first version of sharing state between
tasks. It works by using the JobMaster as the point of synchronization [1].

# Refactor source interface

There is a lively discussion about refactoring Flink's source interface to
make it future proof [2]. Join the discussion if you want to learn more.

# Task speculative execution for batch jobs

Tao Yangyu started a discussion about executing batch tasks speculatively
in order to mitigate the straggler problem [3]. If you have good ideas for
this problem, then please chime in.

# 2nd release candidate for Flink 1.7.0

The community just published the second release candidate for Flink 1.7.0
[4]. Please help the community by testing the latest release candidate and
report any encountered problems. Thanks a lot!

# Embracing Table API in Flink ML

Weihua kicked off a discussion about how to build Flink's next Machine
Learning pipelines [5]. He drafted a design document with his proposal.
Join the discussion to learn more about and share your opinion.

# Support for interactive programming in Flink Table API

Jiangjie started a discussion about interactive programming with Flink's
Table API [6]. The idea is to make results of previous jobs accessible to
successive Flink jobs to better support a REPL like job execution.

[1]
https://lists.apache.org/thread.html/b6eca694eaf7ee19386f4fb407098ae4b58df788b539e0666e28c37c@%3Cdev.flink.apache.org%3E
[2]
https://lists.apache.org/thread.html/70484d6aa4b8e7121181ed8d5857a94bfb7d5a76334b9c8fcc59700c@%3Cdev.flink.apache.org%3E
[3]
https://lists.apache.org/thread.html/54514523379d3768159312a6f25071547e7e63f3b9bf9e19eb4f3937@%3Cdev.flink.apache.org%3E
[4]
https://lists.apache.org/thread.html/10913c242452d018840ba541d29323314732e4498777f77b002e30ad@%3Cdev.flink.apache.org%3E
[5]
https://lists.apache.org/thread.html/cf83aea5bb5ff7a719fe4dc082325469969e5cfc49786646ffc0c8f2@%3Cdev.flink.apache.org%3E
[6]
https://lists.apache.org/thread.html/8a93d331f69ed9aa2c30dbc7793a3e8803155aa08fdaec71681aa92a@%3Cdev.flink.apache.org%3E

Cheers,
Till