osdir.com

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Sink Multiple Stream Elastic search


Hi,

I'm not aware that multiple Flink operators can share transport connections. They usually perform independent communication with the target system. If the pressure is too high for Elasticsearch, have you thought about reducing the parallelism of the sink. Also the buffering options could help [1].

Regards,
Timo

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/connectors/elasticsearch.html#configuring-the-internal-bulk-processor

Am 02.08.18 um 13:51 schrieb shashank734:
Hello,

I am using Elastic search5 Connector. Can I use same connection while
sinking multiple streams to Elastic search? Currently, I think it creates a
different transport connection for each sink. I think it's creating a lot of
connections with the cluster. Cause I am sinking 5-6 streams.




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/