[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (FLINK-9513) Wrap state binder with TTL logic

Andrey Zagrebin created FLINK-9513:

             Summary: Wrap state binder with TTL logic
                 Key: FLINK-9513
                 URL: https://issues.apache.org/jira/browse/FLINK-9513
             Project: Flink
          Issue Type: Sub-task
          Components: State Backends, Checkpointing
    Affects Versions: 1.6.0
            Reporter: Andrey Zagrebin
             Fix For: 1.6.0

The main idea is to wrap user state value with a class holding the value and the expiration timestamp (maybe meta data in future) and use the new object as a value in the existing implementations:
class TtlValue<V> {
  V value;
  long expirationTimestamp;
The original state binder factory is wrapped with TtlStateBinder if TTL is enabled:
state = ttlConfig.updateType == DISABLED ?
 bind(binder) : bind(new TtlStateBinder(binder, timerService));
TtlStateBinder decorates the states produced by the original binder with TTL logic wrappers and adds TtlValue serialisation logic:
TtlStateBinder {
    StateBinder binder;
    ProcessingTimeProvier timeProvider; // System.currentTimeMillis()
    <V> TtlValueState<V> createValueState(valueDesc) {
         serializer = new TtlValueSerializer(valueDesc.getSerializer);
         ttlValueDesc = new ValueDesc(serializer, ...);
         // or implement custom TypeInfo
         originalStateWithTtl = binder.createValueState(valueDesc);
         return new TtlValueState(originalStateWithTtl, timeProvider);

      // List, Map, ...
| |
| |

TTL serializer should add expiration timestamp

This message was sent by Atlassian JIRA