alluxio.underfs.wasb

Class WasbUnderFileSystem

java.lang.Object

alluxio.underfs.BaseUnderFileSystem

alluxio.underfs.ConsistentUnderFileSystem

alluxio.underfs.hdfs.HdfsUnderFileSystem

alluxio.underfs.wasb.WasbUnderFileSystem

All Implemented Interfaces:

AtomicFileOutputStreamCallback, UnderFileSystem, java.io.Closeable, java.lang.AutoCloseable

@ThreadSafe
public class WasbUnderFileSystem
extends HdfsUnderFileSystem

An UnderFileSystem uses the Microsoft Azure Blob Storage.

Nested Class Summary

Nested classes/interfaces inherited from interface alluxio.underfs.UnderFileSystem

UnderFileSystem.Factory, UnderFileSystem.SpaceType

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	SCHEME_INSECURE Constant for the wasb URI scheme.
static java.lang.String	SCHEME_SECURE Constant for the wasbs URI scheme.

Fields inherited from class alluxio.underfs.BaseUnderFileSystem

mUfsConf, mUri

Constructor Summary

Constructors

Constructor and Description
WasbUnderFileSystem(AlluxioURI ufsUri, UnderFileSystemConfiguration conf, org.apache.hadoop.conf.Configuration wasbConf) Constructs a new Wasb UnderFileSystem.

Method Summary

Modifier and Type	Method and Description
static org.apache.hadoop.conf.Configuration	createConfiguration(UnderFileSystemConfiguration conf, java.lang.Boolean isSecure) Prepares the configuration for this Wasb as an HDFS configuration.
static WasbUnderFileSystem	createInstance(AlluxioURI uri, UnderFileSystemConfiguration conf) Factory method to construct a new Wasb UnderFileSystem.
long	getBlockSizeByte(java.lang.String path)
java.util.List<java.lang.String>	getFileLocations(java.lang.String path)
java.util.List<java.lang.String>	getFileLocations(java.lang.String path, FileLocationOptions options)
java.lang.String	getUnderFSType()

Methods inherited from class alluxio.underfs.hdfs.HdfsUnderFileSystem

cleanup, close, connectFromMaster, connectFromWorker, create, createConfiguration, createDirect, deleteDirectory, deleteFile, exists, getAclPair, getActiveSyncInfo, getDirectoryStatus, getFileStatus, getSpace, getStatus, isDirectory, isFile, isSeekable, listStatus, mkdirs, open, renameDirectory, renameFile, setAclEntries, setMode, setOwner, startActiveSyncPolling, startSync, stopActiveSyncPolling, stopSync, supportsActiveSync, supportsFlush

Methods inherited from class alluxio.underfs.ConsistentUnderFileSystem

createNonexistingFile, createNonexistingFile, deleteExistingDirectory, deleteExistingDirectory, deleteExistingFile, getExistingDirectoryStatus, getExistingFileStatus, getExistingStatus, isExistingDirectory, openExistingFile, openExistingFile, renameRenamableDirectory, renameRenamableFile

Methods inherited from class alluxio.underfs.BaseUnderFileSystem

create, deleteDirectory, getFingerprint, getOperationMode, getPhysicalStores, isObjectStorage, listStatus, mkdirs, open, resolveUri, validatePath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface alluxio.underfs.UnderFileSystem

create, createNonexistingFile, createNonexistingFile, deleteDirectory, deleteExistingDirectory, deleteExistingDirectory, deleteExistingFile, getExistingDirectoryStatus, getExistingFileStatus, getExistingStatus, getFingerprint, getOperationMode, getPhysicalStores, isExistingDirectory, isObjectStorage, listStatus, mkdirs, open, openExistingFile, openExistingFile, renameRenamableDirectory, renameRenamableFile, resolveUri

Field Detail

SCHEME_INSECURE

public static final java.lang.String SCHEME_INSECURE

Constant for the wasb URI scheme.

See Also:

Constant Field Values

SCHEME_SECURE

public static final java.lang.String SCHEME_SECURE

Constant for the wasbs URI scheme.

See Also:

Constant Field Values

Constructor Detail

WasbUnderFileSystem

public WasbUnderFileSystem(AlluxioURI ufsUri,
                           UnderFileSystemConfiguration conf,
                           org.apache.hadoop.conf.Configuration wasbConf)

Constructs a new Wasb UnderFileSystem.

Parameters:

ufsUri - the AlluxioURI for this UFS

conf - the configuration for this UFS

wasbConf - the configuration for this Wasb UFS

Method Detail

createConfiguration

public static org.apache.hadoop.conf.Configuration createConfiguration(UnderFileSystemConfiguration conf,
                                                                       java.lang.Boolean isSecure)

Prepares the configuration for this Wasb as an HDFS configuration.

Parameters:

conf - the configuration for this UFS

isSecure - whether blob storage is using https

Returns:

the created configuration

createInstance

public static WasbUnderFileSystem createInstance(AlluxioURI uri,
                                                 UnderFileSystemConfiguration conf)

Factory method to construct a new Wasb UnderFileSystem.

Parameters:

uri - the AlluxioURI for this UFS

conf - the configuration for this UFS

Returns:

a new Wasb UnderFileSystem instance

getUnderFSType

public java.lang.String getUnderFSType()

Specified by:

getUnderFSType in interface UnderFileSystem

Overrides:

getUnderFSType in class HdfsUnderFileSystem

getBlockSizeByte

public long getBlockSizeByte(java.lang.String path)
                      throws java.io.IOException

Specified by:

getBlockSizeByte in interface UnderFileSystem

Overrides:

getBlockSizeByte in class HdfsUnderFileSystem

Throws:

java.io.IOException

getFileLocations

public java.util.List<java.lang.String> getFileLocations(java.lang.String path)
                                                  throws java.io.IOException

Specified by:

getFileLocations in interface UnderFileSystem

Overrides:

getFileLocations in class HdfsUnderFileSystem

Throws:

java.io.IOException

getFileLocations

public java.util.List<java.lang.String> getFileLocations(java.lang.String path,
                                                         FileLocationOptions options)
                                                  throws java.io.IOException

Specified by:

getFileLocations in interface UnderFileSystem

Overrides:

getFileLocations in class HdfsUnderFileSystem

Throws:

java.io.IOException