org.apache.hadoop.hbase.regionserver

Class SecureBulkLoadManager

java.lang.Object

org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager

@InterfaceAudience.Private
public class SecureBulkLoadManager
extends Object

Bulk loads in secure mode. This service addresses two issues:

1. Moving files in a secure filesystem wherein the HBase Client and HBase Server are different filesystem users.
2. Does moving in a secure manner. Assuming that the filesystem is POSIX compliant.

The algorithm is as follows:

1. Create an hbase owned staging directory which is world traversable (711): /hbase/staging
2. A user writes out data to his secure output directory: /user/foo/data
3. A call is made to hbase to create a secret staging directory which globally rwx (777): /user/staging/averylongandrandomdirectoryname
4. The user moves the data into the random staging directory, then calls bulkLoadHFiles()

Like delegation tokens the strength of the security lies in the length and randomness of the secret directory.

Field Summary

Fields

Modifier and Type	Field and Description
static long	VERSION

Method Summary

Modifier and Type	Method and Description
void	cleanupBulkLoad(HRegion region, ClientProtos.CleanupBulkLoadRequest request)
String	prepareBulkLoad(HRegion region, ClientProtos.PrepareBulkLoadRequest request)
Map<byte[],List<org.apache.hadoop.fs.Path>>	secureBulkLoadHFiles(HRegion region, ClientProtos.BulkLoadHFileRequest request)
Map<byte[],List<org.apache.hadoop.fs.Path>>	secureBulkLoadHFiles(HRegion region, ClientProtos.BulkLoadHFileRequest request, List<String> clusterIds)
void	start()
void	stop()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

VERSION

public static final long VERSION

See Also:

Constant Field Values

Method Detail

start

public void start()
           throws IOException

Throws:

IOException

stop

public void stop()
          throws IOException

Throws:

IOException

prepareBulkLoad

public String prepareBulkLoad(HRegion region,
                              ClientProtos.PrepareBulkLoadRequest request)
                       throws IOException

Throws:

IOException

cleanupBulkLoad

public void cleanupBulkLoad(HRegion region,
                            ClientProtos.CleanupBulkLoadRequest request)
                     throws IOException

Throws:

IOException

secureBulkLoadHFiles

public Map<byte[],List<org.apache.hadoop.fs.Path>> secureBulkLoadHFiles(HRegion region,
                                                                        ClientProtos.BulkLoadHFileRequest request)
                                                                 throws IOException

Throws:

IOException

secureBulkLoadHFiles

public Map<byte[],List<org.apache.hadoop.fs.Path>> secureBulkLoadHFiles(HRegion region,
                                                                        ClientProtos.BulkLoadHFileRequest request,
                                                                        List<String> clusterIds)
                                                                 throws IOException

Throws:

IOException