org.apache.hadoop.tools.mapred

Class RetriableFileCopyCommand

java.lang.Object

org.apache.hadoop.tools.util.RetriableCommand

org.apache.hadoop.tools.mapred.RetriableFileCopyCommand

public class RetriableFileCopyCommand
extends RetriableCommand

This class extends RetriableCommand to implement the copy of files, with retries on failure.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	RetriableFileCopyCommand.CopyReadException Special subclass of IOException.

Field Summary

Fields inherited from class org.apache.hadoop.tools.util.RetriableCommand

description

Constructor Summary

Constructors

Constructor and Description
RetriableFileCopyCommand(boolean skipCrc, String description, org.apache.hadoop.tools.mapred.CopyMapper.FileAction action) Create a RetriableFileCopyCommand.
RetriableFileCopyCommand(boolean skipCrc, String description, org.apache.hadoop.tools.mapred.CopyMapper.FileAction action, boolean directWrite) Create a RetriableFileCopyCommand.
RetriableFileCopyCommand(String description, org.apache.hadoop.tools.mapred.CopyMapper.FileAction action) Constructor, taking a description of the action.

Method Summary

Modifier and Type	Method and Description
protected Object	doExecute(Object... arguments) Implementation of RetriableCommand::doExecute().

Methods inherited from class org.apache.hadoop.tools.util.RetriableCommand

execute, setRetryPolicy

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RetriableFileCopyCommand

public RetriableFileCopyCommand(String description,
                                org.apache.hadoop.tools.mapred.CopyMapper.FileAction action)

Constructor, taking a description of the action.

Parameters:

description - Verbose description of the copy operation.

RetriableFileCopyCommand

public RetriableFileCopyCommand(boolean skipCrc,
                                String description,
                                org.apache.hadoop.tools.mapred.CopyMapper.FileAction action)

Create a RetriableFileCopyCommand.

Parameters:

skipCrc - Whether to skip the crc check.

description - A verbose description of the copy operation.

action - We should overwrite the target file or append new data to it.

RetriableFileCopyCommand

public RetriableFileCopyCommand(boolean skipCrc,
                                String description,
                                org.apache.hadoop.tools.mapred.CopyMapper.FileAction action,
                                boolean directWrite)

Create a RetriableFileCopyCommand.

Parameters:

skipCrc - Whether to skip the crc check.

description - A verbose description of the copy operation.

action - We should overwrite the target file or append new data to it.

directWrite - Whether to write directly to the target path, avoiding a temporary file rename.

Method Detail

doExecute

protected Object doExecute(Object... arguments)
                    throws Exception

Implementation of RetriableCommand::doExecute(). This is the actual copy-implementation.

Specified by:

doExecute in class RetriableCommand

Parameters:

arguments - Argument-list to the command.

Returns:

Number of bytes copied.

Throws:

Exception