org.apache.spark.storage

Class RandomBlockReplicationPolicy

Object

org.apache.spark.storage.RandomBlockReplicationPolicy

All Implemented Interfaces:

BlockReplicationPolicy

public class RandomBlockReplicationPolicy
extends Object
implements BlockReplicationPolicy

Constructor Summary

Constructors

Constructor and Description
RandomBlockReplicationPolicy()

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.immutable.List<BlockManagerId>	prioritize(BlockManagerId blockManagerId, scala.collection.Seq<BlockManagerId> peers, scala.collection.mutable.HashSet<BlockManagerId> peersReplicatedTo, BlockId blockId, int numReplicas) Method to prioritize a bunch of candidate peers of a block.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RandomBlockReplicationPolicy

public RandomBlockReplicationPolicy()

Method Detail

prioritize

public scala.collection.immutable.List<BlockManagerId> prioritize(BlockManagerId blockManagerId,
                                                         scala.collection.Seq<BlockManagerId> peers,
                                                         scala.collection.mutable.HashSet<BlockManagerId> peersReplicatedTo,
                                                         BlockId blockId,
                                                         int numReplicas)

Method to prioritize a bunch of candidate peers of a block. This is a basic implementation, that just makes sure we put blocks on different hosts, if possible

Specified by:

prioritize in interface BlockReplicationPolicy

Parameters:

blockManagerId - Id of the current BlockManager for self identification

peers - A list of peers of a BlockManager

peersReplicatedTo - Set of peers already replicated to

blockId - BlockId of the block being replicated. This can be used as a source of randomness if needed.

numReplicas - (undocumented)

Returns:

A prioritized list of peers. Lower the index of a peer, higher its priority