public abstract class MapWithStateDStream<KeyType,ValueType,StateType,MappedType> extends DStream<MappedType>
mapWithState operation on a
pair DStream.
Additionally, it also gives access to the stream of state snapshots, that is, the state data of
all keys after a batch has updated them.
| Constructor and Description |
|---|
MapWithStateDStream(StreamingContext ssc,
scala.reflect.ClassTag<MappedType> evidence$1) |
| Modifier and Type | Method and Description |
|---|---|
abstract DStream<scala.Tuple2<KeyType,StateType>> |
stateSnapshots()
Return a pair DStream where each RDD is the snapshot of the state of all the keys.
|
baseScope, cache, checkpoint, checkpointData, checkpointDuration, compute, context, count, countByValue, countByValueAndWindow, countByWindow, createRDDWithLocalProperties, creationSite, dependencies, filter, flatMap, foreach, foreach, foreachRDD, foreachRDD, generatedRDDs, glom, graph, map, mapPartitions, mustCheckpoint, persist, persist, print, print, reduce, reduceByWindow, reduceByWindow, rememberDuration, repartition, saveAsObjectFiles, saveAsTextFiles, slice, slice, slideDuration, ssc, storageLevel, toPairDStreamFunctions, transform, transform, transformWith, transformWith, union, window, window, zeroTimeclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitinitializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarningpublic MapWithStateDStream(StreamingContext ssc, scala.reflect.ClassTag<MappedType> evidence$1)