[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (FLINK-9797) Separate state serializers from network serializers

Nico Kruber created FLINK-9797:

             Summary: Separate state serializers from network serializers
                 Key: FLINK-9797
                 URL: https://issues.apache.org/jira/browse/FLINK-9797
             Project: Flink
          Issue Type: Improvement
          Components: Type Serialization System
            Reporter: Nico Kruber

State serializers need to maintain backwards compatibility and therefore the format cannot be changed that easily and this is honoured by the classes around {{TypeInformation}}. However, currently the same {{TypeInformation}} is being used in the network stack where data is serialized between two operators during shuffles and so. There, however, we do not need backwards compatibility and could easily change the format and have more performant code, e.g. use custom serializers for Java collections (not going through Kryo), etc.

I propose to separate these two (this is probably a bigger task since it is quite invasive).

This message was sent by Atlassian JIRA