Interface | Description |
---|---|
StreamingQuery | Experimental
A handle to a query that is executing continuously in the background as new data arrives.
|
StreamingQueryListener.Event | Experimental
Base type of
StreamingQueryListener events |
Trigger | Experimental
Used to indicate how often results should be produced by a
StreamingQuery . |
Class | Description |
---|---|
DataStreamReader |
Interface used to load a streaming
Dataset from external storage systems (e.g. |
DataStreamWriter<T> | Experimental
Interface used to write a streaming
Dataset to external storage systems (e.g. |
OutputMode | Experimental
OutputMode is used to what data will be written to a streaming sink when there is
new data available in a streaming DataFrame/Dataset.
|
ProcessingTime | Experimental
A trigger that runs a query periodically based on the processing time.
|
SinkProgress | Experimental
Information about progress made for a sink in the execution of a
StreamingQuery
during a trigger. |
SourceProgress | Experimental
Information about progress made for a source in the execution of a
StreamingQuery
during a trigger. |
StateOperatorProgress | Experimental
Information about updates made to stateful operators in a
StreamingQuery during a trigger. |
StreamingQueryListener | Experimental
Interface for listening to events related to
StreamingQueries . |
StreamingQueryListener.QueryProgressEvent | Experimental
Event representing any progress updates in a query.
|
StreamingQueryListener.QueryStartedEvent | Experimental
Event representing the start of a query
param: id An unique query id that persists across restarts.
|
StreamingQueryListener.QueryTerminatedEvent | Experimental
Event representing that termination of a query.
|
StreamingQueryManager | Experimental
A class to manage all the
StreamingQuery active on a SparkSession . |
StreamingQueryProgress | Experimental
Information about progress made in the execution of a
StreamingQuery during
a trigger. |
StreamingQueryStatus | Experimental
Reports information about the instantaneous status of a streaming query.
|
Exception | Description |
---|---|
StreamingQueryException | Experimental
Exception that stopped a
StreamingQuery . |