org.apache.hadoop.tools.mapred

Class CopyMapper

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.Text,CopyListingFileStatus,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

org.apache.hadoop.tools.mapred.CopyMapper

public class CopyMapper
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.Text,CopyListingFileStatus,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Mapper class that executes the DistCp copy operation. Implements the o.a.h.mapreduce.Mapper interface.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CopyMapper.Counter Hadoop counters for the DistCp CopyMapper.

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Constructor Summary

Constructors

Constructor and Description
CopyMapper()

Method Summary

Modifier and Type	Method and Description
protected void	cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)
void	map(org.apache.hadoop.io.Text relPath, CopyListingFileStatus sourceFileStatus, org.apache.hadoop.mapreduce.Mapper.Context context) Implementation of the Mapper::map().
void	setup(org.apache.hadoop.mapreduce.Mapper.Context context) Implementation of the Mapper::setup() method.

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CopyMapper

public CopyMapper()

Method Detail

setup

public void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
           throws IOException,
                  InterruptedException

Implementation of the Mapper::setup() method. This extracts the DistCp- options specified in the Job's configuration, to set up the Job.

Overrides:

setup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.Text,CopyListingFileStatus,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Parameters:

context - Mapper's context.

Throws:

IOException - On IO failure.

InterruptedException - If the job is interrupted.

map

public void map(org.apache.hadoop.io.Text relPath,
                CopyListingFileStatus sourceFileStatus,
                org.apache.hadoop.mapreduce.Mapper.Context context)
         throws IOException,
                InterruptedException

Implementation of the Mapper::map(). Does the copy.

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.Text,CopyListingFileStatus,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Parameters:

relPath - The target path.

sourceFileStatus - The source path.

Throws:

IOException

InterruptedException

cleanup

protected void cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)
                throws IOException,
                       InterruptedException

Overrides:

cleanup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.Text,CopyListingFileStatus,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

IOException

InterruptedException