package shuffle
Type Members
- case class ContinuousShuffleReadPartition(index: Int, endpointName: String, queueSize: Int, numShuffleWriters: Int, epochIntervalMs: Long) extends Partition with Product with Serializable
-
class
ContinuousShuffleReadRDD extends RDD[UnsafeRow]
RDD at the map side of each continuous processing shuffle task.
RDD at the map side of each continuous processing shuffle task. Upstream tasks send their shuffle output to the wrapped receivers in partitions of this RDD; each of the RDD's tasks poll from their receiver until an epoch marker is sent.
-
trait
ContinuousShuffleReader extends AnyRef
Trait for reading from a continuous processing shuffle.
-
trait
ContinuousShuffleWriter extends AnyRef
Trait for writing to a continuous processing shuffle.
-
class
RPCContinuousShuffleWriter extends ContinuousShuffleWriter
A ContinuousShuffleWriter sending data to RPCContinuousShuffleReader instances.