Package alluxio.underfs.wasb

Class WasbUnderFileSystem

  • All Implemented Interfaces:
    alluxio.underfs.AtomicFileOutputStreamCallback, alluxio.underfs.UnderFileSystem, java.io.Closeable, java.lang.AutoCloseable
    @ThreadSafe
public class WasbUnderFileSystem
extends alluxio.underfs.hdfs.HdfsUnderFileSystem
    An UnderFileSystem uses the Microsoft Azure Blob Storage.

    • Nested Class Summary

      • Nested classes/interfaces inherited from interface alluxio.underfs.UnderFileSystem

        alluxio.underfs.UnderFileSystem.Factory, alluxio.underfs.UnderFileSystem.SpaceType

    • Field Summary

      • Fields inherited from class alluxio.underfs.BaseUnderFileSystem

        EMPTY_ACL, mUfsConf, mUri

    • Constructor Summary

      Constructors 
      Constructor Description
      WasbUnderFileSystem​(alluxio.AlluxioURI ufsUri, alluxio.underfs.UnderFileSystemConfiguration conf, org.apache.hadoop.conf.Configuration wasbConf)
      Constructs a new Wasb UnderFileSystem.

    • Method Summary

      All Methods Static Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      static org.apache.hadoop.conf.Configuration createConfiguration​(alluxio.underfs.UnderFileSystemConfiguration conf, java.lang.Boolean isSecure)
      Prepares the configuration for this Wasb as an HDFS configuration.
      static WasbUnderFileSystem createInstance​(alluxio.AlluxioURI uri, alluxio.underfs.UnderFileSystemConfiguration conf)
      Factory method to construct a new Wasb UnderFileSystem.
      long getBlockSizeByte​(java.lang.String path)  
      java.util.List<java.lang.String> getFileLocations​(java.lang.String path)  
      java.util.List<java.lang.String> getFileLocations​(java.lang.String path, alluxio.underfs.options.FileLocationOptions options)  
      alluxio.underfs.UfsStatus getStatus​(java.lang.String path, alluxio.underfs.options.GetStatusOptions options)  
      java.lang.String getUnderFSType()  

      • Methods inherited from class alluxio.underfs.hdfs.HdfsUnderFileSystem

        cleanup, close, connectFromMaster, connectFromWorker, create, createConfiguration, createDirect, deleteDirectory, deleteFile, exists, getAclPair, getActiveSyncInfo, getDirectoryStatus, getFileStatus, getSpace, isDirectory, isFile, isSeekable, listStatus, mkdirs, open, openPositionRead, renameDirectory, renameFile, setAclEntries, setMode, setOwner, startActiveSyncPolling, startSync, stopActiveSyncPolling, stopSync, supportsActiveSync, supportsFlush

      • Methods inherited from class alluxio.underfs.ConsistentUnderFileSystem

        createNonexistingFile, createNonexistingFile, deleteExistingDirectory, deleteExistingDirectory, deleteExistingFile, getExistingDirectoryStatus, getExistingFileStatus, getExistingStatus, isExistingDirectory, openExistingFile, openExistingFile, renameRenamableDirectory, renameRenamableFile

      • Methods inherited from class alluxio.underfs.BaseUnderFileSystem

        create, deleteDirectory, getConfiguration, getFingerprint, getOperationMode, getParsedFingerprint, getParsedFingerprint, getPhysicalStores, isObjectStorage, listStatus, mkdirs, open, resolveUri, validatePath

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

      • Methods inherited from interface alluxio.underfs.UnderFileSystem

        create, createNonexistingFile, createNonexistingFile, deleteDirectory, deleteExistingDirectory, deleteExistingDirectory, deleteExistingFile, getConfiguration, getExistingDirectoryStatus, getExistingFileStatus, getExistingStatus, getFileStatus, getFingerprint, getOperationMode, getParsedFingerprint, getParsedFingerprint, getPhysicalStores, getStatus, isExistingDirectory, isObjectStorage, listStatus, listStatuses, mkdirs, open, openExistingFile, openExistingFile, renameRenamableDirectory, renameRenamableFile, resolveUri

    • Constructor Detail

      • WasbUnderFileSystem

        public WasbUnderFileSystem​(alluxio.AlluxioURI ufsUri,
                           alluxio.underfs.UnderFileSystemConfiguration conf,
                           org.apache.hadoop.conf.Configuration wasbConf)
        Constructs a new Wasb UnderFileSystem.
        Parameters:
        ufsUri - the AlluxioURI for this UFS
        conf - the configuration for this UFS
        wasbConf - the configuration for this Wasb UFS

    • Method Detail

      • createConfiguration

        public static org.apache.hadoop.conf.Configuration createConfiguration​(alluxio.underfs.UnderFileSystemConfiguration conf,
                                                                       java.lang.Boolean isSecure)
        Prepares the configuration for this Wasb as an HDFS configuration.
        Parameters:
        conf - the configuration for this UFS
        isSecure - whether blob storage is using https
        Returns:
        the created configuration

      • createInstance

        public static WasbUnderFileSystem createInstance​(alluxio.AlluxioURI uri,
                                                 alluxio.underfs.UnderFileSystemConfiguration conf)
        Factory method to construct a new Wasb UnderFileSystem.
        Parameters:
        uri - the AlluxioURI for this UFS
        conf - the configuration for this UFS
        Returns:
        a new Wasb UnderFileSystem instance

      • getUnderFSType

        public java.lang.String getUnderFSType()
        Specified by:
        getUnderFSType in interface alluxio.underfs.UnderFileSystem
        Overrides:
        getUnderFSType in class alluxio.underfs.hdfs.HdfsUnderFileSystem

      • getBlockSizeByte

        public long getBlockSizeByte​(java.lang.String path)
                      throws java.io.IOException
        Specified by:
        getBlockSizeByte in interface alluxio.underfs.UnderFileSystem
        Overrides:
        getBlockSizeByte in class alluxio.underfs.hdfs.HdfsUnderFileSystem
        Throws:
        java.io.IOException

      • getStatus

        public alluxio.underfs.UfsStatus getStatus​(java.lang.String path,
                                           alluxio.underfs.options.GetStatusOptions options)
                                    throws java.io.IOException
        Specified by:
        getStatus in interface alluxio.underfs.UnderFileSystem
        Overrides:
        getStatus in class alluxio.underfs.hdfs.HdfsUnderFileSystem
        Throws:
        java.io.IOException

      • getFileLocations

        public java.util.List<java.lang.String> getFileLocations​(java.lang.String path)
                                                  throws java.io.IOException
        Specified by:
        getFileLocations in interface alluxio.underfs.UnderFileSystem
        Overrides:
        getFileLocations in class alluxio.underfs.hdfs.HdfsUnderFileSystem
        Throws:
        java.io.IOException

      • getFileLocations

        public java.util.List<java.lang.String> getFileLocations​(java.lang.String path,
                                                         alluxio.underfs.options.FileLocationOptions options)
                                                  throws java.io.IOException
        Specified by:
        getFileLocations in interface alluxio.underfs.UnderFileSystem
        Overrides:
        getFileLocations in class alluxio.underfs.hdfs.HdfsUnderFileSystem
        Throws:
        java.io.IOException