org.apache.spark.streaming.scheduler

Class BatchInfo

Object

org.apache.spark.streaming.scheduler.BatchInfo

All Implemented Interfaces:

java.io.Serializable, scala.Equals, scala.Product

public class BatchInfo
extends Object
implements scala.Product, scala.Serializable

:: DeveloperApi :: Class having information on completed batches. param: batchTime Time of the batch param: streamIdToInputInfo A map of input stream id to its input info param: submissionTime Clock time of when jobs of this batch was submitted to the streaming scheduler queue param: processingStartTime Clock time of when the first job of this batch started processing param: processingEndTime Clock time of when the last job of this batch finished processing param: outputOperationInfos The output operations in this batch

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
BatchInfo(Time batchTime, scala.collection.immutable.Map<Object,StreamInputInfo> streamIdToInputInfo, long submissionTime, scala.Option<Object> processingStartTime, scala.Option<Object> processingEndTime, scala.collection.immutable.Map<Object,OutputOperationInfo> outputOperationInfos)

Method Summary

Methods

Modifier and Type	Method and Description
Time	batchTime()
long	numRecords() The number of recorders received by the receivers in this batch.
scala.collection.immutable.Map<Object,OutputOperationInfo>	outputOperationInfos()
scala.Option<Object>	processingDelay() Time taken for the all jobs of this batch to finish processing from the time they started processing.
scala.Option<Object>	processingEndTime()
scala.Option<Object>	processingStartTime()
scala.Option<Object>	schedulingDelay() Time taken for the first job of this batch to start processing from the time this batch was submitted to the streaming scheduler.
scala.collection.immutable.Map<Object,StreamInputInfo>	streamIdToInputInfo()
scala.collection.immutable.Map<Object,Object>	streamIdToNumRecords()
long	submissionTime()
scala.Option<Object>	totalDelay() Time taken for all the jobs of this batch to finish processing from the time they were submitted.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Constructor Detail

BatchInfo

public BatchInfo(Time batchTime,
         scala.collection.immutable.Map<Object,StreamInputInfo> streamIdToInputInfo,
         long submissionTime,
         scala.Option<Object> processingStartTime,
         scala.Option<Object> processingEndTime,
         scala.collection.immutable.Map<Object,OutputOperationInfo> outputOperationInfos)

Method Detail

batchTime

public Time batchTime()

streamIdToInputInfo

public scala.collection.immutable.Map<Object,StreamInputInfo> streamIdToInputInfo()

submissionTime

public long submissionTime()

processingStartTime

public scala.Option<Object> processingStartTime()

processingEndTime

public scala.Option<Object> processingEndTime()

outputOperationInfos

public scala.collection.immutable.Map<Object,OutputOperationInfo> outputOperationInfos()

streamIdToNumRecords

public scala.collection.immutable.Map<Object,Object> streamIdToNumRecords()

schedulingDelay

public scala.Option<Object> schedulingDelay()

Time taken for the first job of this batch to start processing from the time this batch was submitted to the streaming scheduler. Essentially, it is processingStartTime - submissionTime.

Returns:

(undocumented)

processingDelay

public scala.Option<Object> processingDelay()

Time taken for the all jobs of this batch to finish processing from the time they started processing. Essentially, it is processingEndTime - processingStartTime.

Returns:

(undocumented)

totalDelay

public scala.Option<Object> totalDelay()

Time taken for all the jobs of this batch to finish processing from the time they were submitted. Essentially, it is processingDelay + schedulingDelay.

Returns:

(undocumented)

numRecords

public long numRecords()

The number of recorders received by the receivers in this batch.

Returns:

(undocumented)