OSDir


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Continue batch job with streaming job


Is there a way to make a checkpoint/savepoint after the batch job has finished and then run the job in a streaming mode with state that has been initialized in batch mode?

Or more generally speaking, what are the battle-tested solutions to "job initialization" problem, especially when there are terabytes of data that have to be processed before the job can be turned into streaming mode? Do any examples exist?