StorageStatus
Related Doc:
package storage
Create a storage status with an initial set of blocks, leaving the source unmodified.
Return the blocks stored in this block manager.
Return the blocks stored in this block manager.
Note that this is somewhat expensive, as it involves cloning the underlying maps and then concatenating them together. Much faster alternatives exist for common operations such as contains, get, and size.
Return the memory used by caching RDDs
Return whether the given block is stored in this block manager in O(1) time.
Return whether the given block is stored in this block manager in O(1) time.
Note that this is much faster than this.blocks.contains, which is O(blocks) time.
Return the disk space used by this block manager.
Return the disk space used by the given RDD in this block manager in O(1) time.
Return the given block stored in this block manager in O(1) time.
Return the given block stored in this block manager in O(1) time.
Note that this is much faster than this.blocks.get, which is O(blocks) time.
Return the memory remaining in this block manager.
Return the memory used by this block manager.
Return the memory used by the given RDD in this block manager in O(1) time.
Return the number of blocks stored in this block manager in O(RDDs) time.
Return the number of blocks stored in this block manager in O(RDDs) time.
Note that this is much faster than this.blocks.size, which is O(blocks) time.
Return the number of RDD blocks stored in this block manager in O(RDDs) time.
Return the number of RDD blocks stored in this block manager in O(RDDs) time.
Note that this is much faster than this.rddBlocks.size, which is O(RDD blocks) time.
Return the number of blocks that belong to the given RDD in O(1) time.
Return the number of blocks that belong to the given RDD in O(1) time.
Note that this is much faster than this.rddBlocksById(rddId).size, which is
O(blocks in this RDD) time.
Return the RDD blocks stored in this block manager.
Return the RDD blocks stored in this block manager.
Note that this is somewhat expensive, as it involves cloning the underlying maps and then concatenating them together. Much faster alternatives exist for common operations such as getting the memory, disk, and off-heap memory sizes occupied by this RDD.
Return the blocks that belong to the given RDD stored in this block manager.
Return the storage level, if any, used by the given RDD in this block manager.
:: DeveloperApi :: Storage information for each BlockManager.
This class assumes BlockId and BlockStatus are immutable, such that the consumers of this class cannot mutate the source of the information. Accesses are not thread-safe.