TaskContext
Related Docs:
object TaskContext
| package spark
Adds a (Java friendly) listener to be executed on task completion.
Adds a (Java friendly) listener to be executed on task completion. This will be called in all situation - success, failure, or cancellation. An example use is for HadoopRDD to register a callback to close the input stream.
Exceptions thrown by the listener will result in failure of the task.
Adds a listener to be executed on task failure.
Adds a listener to be executed on task failure.
Operations defined here must be idempotent, as onTaskFailure can be called multiple times.
How many times this task has been attempted.
How many times this task has been attempted. The first task attempt will be assigned attemptNumber = 0, and subsequent attempts will have increasing attempt numbers.
Get a local property set upstream in the driver, or null if it is missing.
Get a local property set upstream in the driver, or null if it is missing. See also org.apache.spark.SparkContext.setLocalProperty.
::DeveloperApi:: Returns all metrics sources with the given name which are associated with the instance which runs the task.
::DeveloperApi:: Returns all metrics sources with the given name which are associated with the instance which runs the task. For more information see org.apache.spark.metrics.MetricsSystem!.
Returns true if the task has completed.
Returns true if the task has been killed.
The ID of the RDD partition that is computed by this task.
The ID of the stage that this task belong to.
An ID that is unique to this task attempt (within the same SparkContext, no two task attempts will share the same attempt ID).
An ID that is unique to this task attempt (within the same SparkContext, no two task attempts will share the same attempt ID). This is roughly equivalent to Hadoop's TaskAttemptID.
Returns true if the task is running locally in the driver program.
Returns true if the task is running locally in the driver program.
false
(Since version 2.0.0) Local execution was removed, so this always returns false
Adds a listener in the form of a Scala closure to be executed on task completion.
Adds a listener in the form of a Scala closure to be executed on task completion. This will be called in all situations - success, failure, or cancellation. An example use is for HadoopRDD to register a callback to close the input stream.
Exceptions thrown by the listener will result in failure of the task.
Adds a listener to be executed on task failure.
Adds a listener to be executed on task failure.
Operations defined here must be idempotent, as onTaskFailure can be called multiple times.
Contextual information about a task which can be read or mutated during execution. To access the TaskContext for a running task, use: