| Package | Description |
|---|---|
| org.apache.hadoop.tools |
DistCp is a tool for replicating data using MapReduce jobs for concurrent
copy operations.
|
| org.apache.hadoop.tools.mapred | |
| org.apache.hadoop.tools.util |
| Modifier and Type | Method and Description |
|---|---|
protected CopyListingFileStatus |
CopyListing.getFileListingValue(CopyListingFileStatus fileStatus)
Returns the value for an entry in the copy listing sequence file.
|
| Modifier and Type | Method and Description |
|---|---|
protected org.apache.hadoop.io.Text |
CopyListing.getFileListingKey(org.apache.hadoop.fs.Path sourcePathRoot,
CopyListingFileStatus fileStatus)
Returns the key for an entry in the copy listing sequence file.
|
protected CopyListingFileStatus |
CopyListing.getFileListingValue(CopyListingFileStatus fileStatus)
Returns the value for an entry in the copy listing sequence file.
|
| Constructor and Description |
|---|
CopyListingFileStatus(CopyListingFileStatus other) |
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,CopyListingFileStatus> |
UniformSizeInputFormat.createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
org.apache.hadoop.mapreduce.TaskAttemptContext context)
Implementation of InputFormat::createRecordReader().
|
| Modifier and Type | Method and Description |
|---|---|
void |
CopyMapper.map(org.apache.hadoop.io.Text relPath,
CopyListingFileStatus sourceFileStatus,
org.apache.hadoop.mapreduce.Mapper.Context context)
Implementation of the Mapper::map().
|
| Modifier and Type | Method and Description |
|---|---|
static CopyListingFileStatus |
DistCpUtils.toCopyListingFileStatusHelper(org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.FileStatus fileStatus,
boolean preserveAcls,
boolean preserveXAttrs,
boolean preserveRawXAttrs,
long chunkOffset,
long chunkLength)
Converts a FileStatus to a CopyListingFileStatus.
|
| Modifier and Type | Method and Description |
|---|---|
static LinkedList<CopyListingFileStatus> |
DistCpUtils.toCopyListingFileStatus(org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.FileStatus fileStatus,
boolean preserveAcls,
boolean preserveXAttrs,
boolean preserveRawXAttrs,
int blocksPerChunk)
Converts FileStatus to a list of CopyListingFileStatus.
|
| Modifier and Type | Method and Description |
|---|---|
static org.apache.hadoop.fs.Path |
DistCpUtils.getSplitChunkPath(org.apache.hadoop.fs.Path targetFile,
CopyListingFileStatus srcFileStatus) |
static void |
DistCpUtils.preserve(org.apache.hadoop.fs.FileSystem targetFS,
org.apache.hadoop.fs.Path path,
CopyListingFileStatus srcFileStatus,
EnumSet<DistCpOptions.FileAttribute> attributes,
boolean preserveRawXattrs)
Preserve attribute on file matching that of the file status being sent
as argument.
|
Copyright © 2008–2020 Apache Software Foundation. All rights reserved.