org.apache.spark.sql.streaming

Class SourceProgress

Object

org.apache.spark.sql.streaming.SourceProgress

All Implemented Interfaces:

java.io.Serializable

public class SourceProgress
extends Object
implements scala.Serializable

:: Experimental :: Information about progress made for a source in the execution of a StreamingQuery during a trigger. See StreamingQueryProgress for more information.

param: description Description of the source. param: startOffset The starting offset for data being read. param: endOffset The ending offset for data being read. param: numInputRows The number of records read from this source. param: inputRowsPerSecond The rate at which data is arriving from this source. param: processedRowsPerSecond The rate at which data from this source is being procressed by Spark.

Since:

2.1.0

See Also:

Serialized Form

Method Summary

Methods

Modifier and Type	Method and Description
String	description()
String	endOffset()
double	inputRowsPerSecond()
String	json() The compact JSON representation of this progress.
long	numInputRows()
String	prettyJson() The pretty (i.e.
double	processedRowsPerSecond()
String	startOffset()
String	toString()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Detail

description

public String description()

startOffset

public String startOffset()

endOffset

public String endOffset()

numInputRows

public long numInputRows()

inputRowsPerSecond

public double inputRowsPerSecond()

processedRowsPerSecond

public double processedRowsPerSecond()

json

public String json()

The compact JSON representation of this progress.

prettyJson

public String prettyJson()

The pretty (i.e. indented) JSON representation of this progress.

toString

public String toString()

Overrides:

toString in class Object