alluxio.underfs.gcs

Class GCSUnderFileSystem

java.lang.Object

alluxio.underfs.BaseUnderFileSystem

alluxio.underfs.ObjectUnderFileSystem

alluxio.underfs.gcs.GCSUnderFileSystem

All Implemented Interfaces:

UnderFileSystem

@ThreadSafe
public class GCSUnderFileSystem
extends ObjectUnderFileSystem

GCS FS UnderFileSystem implementation based on the jets3t library.

Nested Class Summary

Nested classes/interfaces inherited from class alluxio.underfs.ObjectUnderFileSystem

ObjectUnderFileSystem.ObjectListingChunk, ObjectUnderFileSystem.ObjectStatus

Nested classes/interfaces inherited from interface alluxio.underfs.UnderFileSystem

UnderFileSystem.Factory, UnderFileSystem.SpaceType

Field Summary

Fields inherited from class alluxio.underfs.ObjectUnderFileSystem

PATH_SEPARATOR, PATH_SEPARATOR_CHAR

Fields inherited from class alluxio.underfs.BaseUnderFileSystem

mProperties, mUri

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	GCSUnderFileSystem(AlluxioURI uri, org.jets3t.service.impl.rest.httpclient.GoogleStorageService googleStorageService, String bucketName, short bucketMode, String accountOwner) Constructor for GCSUnderFileSystem.

Method Summary

Methods

Modifier and Type	Method and Description
protected boolean	copyObject(String src, String dst)
protected boolean	createEmptyObject(String key)
static GCSUnderFileSystem	createInstance(AlluxioURI uri) Constructs a new instance of GCSUnderFileSystem.
protected OutputStream	createObject(String key)
protected boolean	deleteObject(String key)
protected String	getFolderSuffix()
String	getGroup(String path)
short	getMode(String path)
protected ObjectUnderFileSystem.ObjectListingChunk	getObjectListingChunk(String key, boolean recursive)
protected ObjectUnderFileSystem.ObjectStatus	getObjectStatus(String key)
String	getOwner(String path)
protected String	getRootKey()
String	getUnderFSType()
protected InputStream	openObject(String key, OpenOptions options)
void	setMode(String path, short mode)
void	setOwner(String path, String user, String group)

Methods inherited from class alluxio.underfs.ObjectUnderFileSystem

close, connectFromMaster, connectFromWorker, convertToFolderName, create, deleteDirectory, deleteFile, getBlockSizeByte, getChildName, getConf, getFileLocations, getFileLocations, getFileSize, getListingChunkLength, getListingChunkLengthMax, getModificationTimeMs, getObjectListingChunkAndCreateNonEmpty, getParentPath, getSpace, isDirectory, isFile, isRoot, listInternal, listStatus, listStatus, mkdirs, mkdirsInternal, open, parentExists, renameDirectory, renameFile, setConf, supportsFlush

Methods inherited from class alluxio.underfs.BaseUnderFileSystem

configureProperties, create, deleteDirectory, exists, getProperties, mkdirs, open, resolveUri, setProperties, validatePath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GCSUnderFileSystem

protected GCSUnderFileSystem(AlluxioURI uri,
                  org.jets3t.service.impl.rest.httpclient.GoogleStorageService googleStorageService,
                  String bucketName,
                  short bucketMode,
                  String accountOwner)

Constructor for GCSUnderFileSystem.

Parameters:

uri - the AlluxioURI for this UFS

googleStorageService - the Jets3t GCS client

bucketName - bucket name of user's configured Alluxio bucket

bucketMode - the permission mode that the account owner has to the bucket

accountOwner - the name of the account owner

Method Detail

createInstance

public static GCSUnderFileSystem createInstance(AlluxioURI uri)
                                         throws org.jets3t.service.ServiceException

Constructs a new instance of GCSUnderFileSystem.

Parameters:

uri - the AlluxioURI for this UFS

Returns:

the created GCSUnderFileSystem instance

Throws:

org.jets3t.service.ServiceException - when a connection to GCS could not be created

getUnderFSType

public String getUnderFSType()

setOwner

public void setOwner(String path,
            String user,
            String group)

setMode

public void setMode(String path,
           short mode)
             throws IOException

Throws:

IOException

getOwner

public String getOwner(String path)
                throws IOException

Throws:

IOException

getGroup

public String getGroup(String path)
                throws IOException

Throws:

IOException

getMode

public short getMode(String path)
              throws IOException

Throws:

IOException

copyObject

protected boolean copyObject(String src,
                 String dst)

Specified by:

copyObject in class ObjectUnderFileSystem

createEmptyObject

protected boolean createEmptyObject(String key)

Specified by:

createEmptyObject in class ObjectUnderFileSystem

createObject

protected OutputStream createObject(String key)
                             throws IOException

Specified by:

createObject in class ObjectUnderFileSystem

Throws:

IOException

deleteObject

protected boolean deleteObject(String key)
                        throws IOException

Specified by:

deleteObject in class ObjectUnderFileSystem

Throws:

IOException

getFolderSuffix

protected String getFolderSuffix()

Specified by:

getFolderSuffix in class ObjectUnderFileSystem

getObjectListingChunk

protected ObjectUnderFileSystem.ObjectListingChunk getObjectListingChunk(String key,
                                                             boolean recursive)
                                                                  throws IOException

Specified by:

getObjectListingChunk in class ObjectUnderFileSystem

Throws:

IOException

getObjectStatus

protected ObjectUnderFileSystem.ObjectStatus getObjectStatus(String key)

Specified by:

getObjectStatus in class ObjectUnderFileSystem

getRootKey

protected String getRootKey()

Specified by:

getRootKey in class ObjectUnderFileSystem

openObject

protected InputStream openObject(String key,
                     OpenOptions options)
                          throws IOException

Specified by:

openObject in class ObjectUnderFileSystem

Throws:

IOException