| Package | Description |
|---|---|
| org.apache.hadoop.tools |
DistCp is a tool for replicating data using MapReduce jobs for concurrent
copy operations.
|
| org.apache.hadoop.tools.util |
| Modifier and Type | Method and Description |
|---|---|
protected DistCpContext |
DistCp.getContext()
Returns the context.
|
| Modifier and Type | Method and Description |
|---|---|
void |
CopyListing.buildListing(org.apache.hadoop.fs.Path pathToListFile,
DistCpContext distCpContext)
Build listing function creates the input listing that distcp uses to
perform the copy.
|
void |
GlobbedCopyListing.doBuildListing(org.apache.hadoop.fs.Path pathToListingFile,
DistCpContext context)
Implementation of CopyListing::buildListing().
|
protected void |
SimpleCopyListing.doBuildListing(org.apache.hadoop.fs.Path pathToListingFile,
DistCpContext context) |
void |
FileBasedCopyListing.doBuildListing(org.apache.hadoop.fs.Path pathToListFile,
DistCpContext context)
Implementation of CopyListing::buildListing().
|
protected abstract void |
CopyListing.doBuildListing(org.apache.hadoop.fs.Path pathToListFile,
DistCpContext distCpContext)
The interface to be implemented by sub-classes, to create the source/target file listing.
|
protected void |
SimpleCopyListing.doBuildListing(org.apache.hadoop.io.SequenceFile.Writer fileListWriter,
DistCpContext context)
Collect the list of
<sourceRelativePath, sourceFileStatus>
to be copied and write to the sequence file.
|
protected void |
SimpleCopyListing.doBuildListingWithSnapshotDiff(org.apache.hadoop.io.SequenceFile.Writer fileListWriter,
DistCpContext context)
Build a copy list based on the snapshot diff report.
|
static CopyListing |
CopyListing.getCopyListing(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.security.Credentials credentials,
DistCpContext context)
Public Factory method with which the appropriate CopyListing implementation may be retrieved.
|
protected void |
GlobbedCopyListing.validatePaths(DistCpContext context)
Validate input and output paths
|
protected void |
SimpleCopyListing.validatePaths(DistCpContext context) |
protected void |
FileBasedCopyListing.validatePaths(DistCpContext context)
Validate input and output paths
|
protected abstract void |
CopyListing.validatePaths(DistCpContext distCpContext)
Validate input and output paths
|
| Modifier and Type | Method and Description |
|---|---|
static Class<? extends org.apache.hadoop.mapreduce.InputFormat> |
DistCpUtils.getStrategy(org.apache.hadoop.conf.Configuration conf,
DistCpContext context)
Returns the class that implements a copy strategy.
|
Copyright © 2008–2020 Apache Software Foundation. All rights reserved.