osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Metrics Pusher support on Dataflow


Hi all

As we already discussed, it would be good to support Metrics Pusher [1] in Dataflow (in other runners also, of course). Today, only Spark and Flink support it. It requires a modification in C++ Dataflow code, so only Google friends can do it.

Is someone interested in doing it ? 

Here is the ticket https://issues.apache.org/jira/browse/BEAM-3926

Besides, I wonder if this feature should be added to the capability matrix.

[1] https://cwiki.apache.org/confluence/display/BEAM/Metrics+architecture+inside+the+runners

Thanks
Etienne