org.apache.spark.sql.execution

Class ShuffledHashJoin

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.execution.ShuffledHashJoin

All Implemented Interfaces:

java.io.Serializable, Logging, HashJoin, scala.Equals, scala.Product

public class ShuffledHashJoin
extends SparkPlan
implements HashJoin, scala.Product, scala.Serializable

:: DeveloperApi :: Performs an inner hash join of two child relations by first shuffling the data using the join keys.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
ShuffledHashJoin(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys, BuildSide buildSide, SparkPlan left, SparkPlan right)

Method Summary

Methods

Modifier and Type	Method and Description
BuildSide	buildSide()
RDD<org.apache.spark.sql.catalyst.expressions.Row>	execute() Runs this query returning the result as an RDD.
SparkPlan	left()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	leftKeys()
org.apache.spark.sql.catalyst.plans.physical.Partitioning	outputPartitioning() Specifies how data is partitioned across different nodes in the cluster.
scala.collection.immutable.List<org.apache.spark.sql.catalyst.plans.physical.ClusteredDistribution>	requiredChildDistribution()
SparkPlan	right()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	rightKeys()

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

codegenEnabled, executeCollect, makeCopy

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, output, outputSet, printSchema, schema, schemaString, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, id, map, mapChildren, nextId, nodeName, numberedTreeString, otherCopyArgs, sameInstance, simpleString, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.catalyst.trees.BinaryNode

children

Methods inherited from interface org.apache.spark.sql.execution.HashJoin

buildKeys, buildPlan, buildSideKeyGenerator, joinIterators, output, streamedKeys, streamedPlan, streamSideKeyGenerator

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.Logging

initialized, initializeIfNecessary, initializeLogging, initLock, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

ShuffledHashJoin

public ShuffledHashJoin(scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys,
                scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys,
                BuildSide buildSide,
                SparkPlan left,
                SparkPlan right)

Method Detail

leftKeys

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> leftKeys()

Specified by:

leftKeys in interface HashJoin

rightKeys

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> rightKeys()

Specified by:

rightKeys in interface HashJoin

buildSide

public BuildSide buildSide()

Specified by:

buildSide in interface HashJoin

left

public SparkPlan left()

Specified by:

left in interface HashJoin

right

public SparkPlan right()

Specified by:

right in interface HashJoin

outputPartitioning

public org.apache.spark.sql.catalyst.plans.physical.Partitioning outputPartitioning()

Description copied from class: SparkPlan

Specifies how data is partitioned across different nodes in the cluster.

Overrides:

outputPartitioning in class SparkPlan

requiredChildDistribution

public scala.collection.immutable.List<org.apache.spark.sql.catalyst.plans.physical.ClusteredDistribution> requiredChildDistribution()

execute

public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()

Description copied from class: SparkPlan

Runs this query returning the result as an RDD.

Specified by:

execute in class SparkPlan