osdir.com


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (FLINK-9794) JDBCOutputFormat does not consider idle connection and multithreads synchronization


wangsan created FLINK-9794:
------------------------------

             Summary: JDBCOutputFormat does not consider idle connection and multithreads synchronization
                 Key: FLINK-9794
                 URL: https://issues.apache.org/jira/browse/FLINK-9794
             Project: Flink
          Issue Type: Bug
          Components: Streaming Connectors
    Affects Versions: 1.5.0, 1.4.0
            Reporter: wangsan


Current implementation of  JDBCOutputFormat has two potential problems: 

1. The Connection was established when JDBCOutputFormat is opened, and will be used all the time. But if this connection lies idle for a long time, the database will force close the connection, thus errors may occur.
2. The flush() method is called when batchCount exceeds the threshold, but it is also called while snapshotting state. So two threads may modify upload and batchCount, but without synchronization.

We need fix these two problems to make JDBCOutputFormat more reliable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)