alluxio.job.plan.replicate

Class DefaultReplicationHandler

java.lang.Object

alluxio.job.plan.replicate.DefaultReplicationHandler

All Implemented Interfaces:

ReplicationHandler

@ThreadSafe
public final class DefaultReplicationHandler
extends java.lang.Object
implements ReplicationHandler

The implementation of ReplicationHandler that utilizes job service.

Constructor Summary

Constructors

Constructor and Description
DefaultReplicationHandler(JobMasterClientPool jobMasterClientPool) Creates a new instance of DefaultReplicationHandler.

Method Summary

Modifier and Type	Method and Description
long	evict(AlluxioURI uri, long blockId, int numReplicas) Decreases the block replication level by a target number of replicas.
java.util.List<java.lang.Long>	findJobs(java.lang.String jobName, java.util.Set<Status> status)
Status	getJobStatus(long jobId)
long	migrate(AlluxioURI uri, long blockId, java.lang.String workerHost, java.lang.String mediumType) Migrate blocks to the correctly pinned locations.
long	replicate(AlluxioURI uri, long blockId, int numReplicas) Increases the block replication level by a target number of replicas.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DefaultReplicationHandler

public DefaultReplicationHandler(JobMasterClientPool jobMasterClientPool)

Creates a new instance of DefaultReplicationHandler.

Parameters:

jobMasterClientPool - job master client pool

Method Detail

getJobStatus

public Status getJobStatus(long jobId)
                    throws java.io.IOException

Specified by:

getJobStatus in interface ReplicationHandler

Parameters:

jobId - the job id returned by evict, replicate, or migrate

Returns:

the job status (running, completed, failed, etc.)

Throws:

java.io.IOException - if a non-Alluxio error is encountered

findJobs

public java.util.List<java.lang.Long> findJobs(java.lang.String jobName,
                                               java.util.Set<Status> status)
                                        throws java.io.IOException

Specified by:

findJobs in interface ReplicationHandler

Parameters:

jobName - name of the job

status - job status

Returns:

a list of job ids that match the criteria

Throws:

java.io.IOException - if a non-Alluxio error is encountered

evict

public long evict(AlluxioURI uri,
                  long blockId,
                  int numReplicas)
           throws AlluxioException,
                  java.io.IOException

Description copied from interface: ReplicationHandler

Decreases the block replication level by a target number of replicas.

Specified by:

evict in interface ReplicationHandler

Parameters:

uri - URI of the file the block belongs to

blockId - ID of the block

numReplicas - how many replicas to remove

Returns:

the ID of the replicate job

Throws:

AlluxioException - if an Alluxio error is encountered

java.io.IOException - if a non-Alluxio error is encountered

replicate

public long replicate(AlluxioURI uri,
                      long blockId,
                      int numReplicas)
               throws AlluxioException,
                      java.io.IOException

Description copied from interface: ReplicationHandler

Increases the block replication level by a target number of replicas.

Specified by:

replicate in interface ReplicationHandler

Parameters:

uri - URI of the file the block belongs to

blockId - ID of the block

numReplicas - how many replicas to add

Returns:

the ID of the replicate job

Throws:

AlluxioException - if an Alluxio error is encountered

java.io.IOException - if a non-Alluxio error is encountered

migrate

public long migrate(AlluxioURI uri,
                    long blockId,
                    java.lang.String workerHost,
                    java.lang.String mediumType)
             throws AlluxioException,
                    java.io.IOException

Description copied from interface: ReplicationHandler

Migrate blocks to the correctly pinned locations.

Specified by:

migrate in interface ReplicationHandler

Parameters:

uri - URI of the file the block belongs to

blockId - ID of the block

workerHost - worker host this block is located at

mediumType - medium type to migrate this block to

Returns:

the ID of the replicate job

Throws:

AlluxioException - if an Alluxio error is encountered

java.io.IOException - if a non-Alluxio error is encountered