org.apache.spark.sql.execution

Class Aggregate

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.execution.Aggregate

All Implemented Interfaces:

java.io.Serializable, Logging, scala.Equals, scala.Product

public class Aggregate
extends SparkPlan
implements scala.Product, scala.Serializable

:: DeveloperApi :: Groups input data by groupingExpressions and computes the aggregateExpressions for each group.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	Aggregate.ComputedAggregate An aggregate that needs to be computed for each row in a group.
class	Aggregate.ComputedAggregate$

Constructor Summary

Constructors

Constructor and Description
Aggregate(boolean partial, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> groupingExpressions, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression> aggregateExpressions, SparkPlan child)

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression>	aggregateExpressions()
SparkPlan	child()
RDD<org.apache.spark.sql.catalyst.expressions.Row>	execute() Substituted version of aggregateExpressions expressions which are used to compute final output rows given a group and the result of all aggregate computations.
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	groupingExpressions()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	output()
org.apache.spark.sql.catalyst.plans.physical.Partitioning	outputPartitioning()
boolean	partial()
scala.collection.Seq<org.apache.spark.sql.catalyst.plans.physical.Distribution>	requiredChildDistribution() Specifies any partition requirements on the input data for this operator.

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

codegenEnabled, executeCollect, makeCopy, outputPartitioning

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, printSchema, schema, schemaString, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, id, map, mapChildren, nextId, nodeName, numberedTreeString, otherCopyArgs, sameInstance, simpleString, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.catalyst.trees.UnaryNode

children

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.Logging

initialized, initializeIfNecessary, initializeLogging, initLock, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

Aggregate

public Aggregate(boolean partial,
         scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> groupingExpressions,
         scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression> aggregateExpressions,
         SparkPlan child)

Method Detail

partial

public boolean partial()

groupingExpressions

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> groupingExpressions()

aggregateExpressions

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression> aggregateExpressions()

child

public SparkPlan child()

requiredChildDistribution

public scala.collection.Seq<org.apache.spark.sql.catalyst.plans.physical.Distribution> requiredChildDistribution()

Description copied from class: SparkPlan

Specifies any partition requirements on the input data for this operator.

Overrides:

requiredChildDistribution in class SparkPlan

output

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output()

Specified by:

output in class org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

execute

public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()

Substituted version of aggregateExpressions expressions which are used to compute final output rows given a group and the result of all aggregate computations.

Specified by:

execute in class SparkPlan

outputPartitioning

public org.apache.spark.sql.catalyst.plans.physical.Partitioning outputPartitioning()