alluxio.underfs.tos

Class TOSLowLevelOutputStream

java.lang.Object

java.io.OutputStream

alluxio.underfs.ObjectLowLevelOutputStream

alluxio.underfs.tos.TOSLowLevelOutputStream

All Implemented Interfaces:

ContentHashable, java.io.Closeable, java.io.Flushable, java.lang.AutoCloseable

@NotThreadSafe
public class TOSLowLevelOutputStream
extends ObjectLowLevelOutputStream

Object storage low output stream for TOS.

Field Summary

Fields

Modifier and Type	Field and Description
protected com.volcengine.tos.TOSV2	mClient The TOS client to interact with TOS.
protected java.lang.String	mUploadId The upload id of this multipart upload.

Fields inherited from class alluxio.underfs.ObjectLowLevelOutputStream

mBucketName, mClosed, mFile, mHash, mKey, mLocalOutputStream, mPartitionOffset, mPartitionSize, mRetryPolicy, mSingleCharWrite, mTmpDirs, UPLOAD_THRESHOLD

Constructor Summary

Constructors

Constructor and Description
TOSLowLevelOutputStream(java.lang.String bucketName, java.lang.String key, com.volcengine.tos.TOSV2 tosClient, com.google.common.util.concurrent.ListeningExecutorService executor, AlluxioConfiguration ufsConf) Constructs a new stream for writing a file.

Method Summary

Modifier and Type	Method and Description
protected void	abortMultiPartUploadInternal()
protected void	completeMultiPartUploadInternal()
protected void	createEmptyObject(java.lang.String key)
protected com.volcengine.tos.TOSV2	getClient()
java.util.Optional<java.lang.String>	getContentHash()
protected void	initMultiPartUploadInternal()
protected void	putObject(java.lang.String key, java.io.File file, java.lang.String md5)
protected void	uploadPartInternal(java.io.File file, int partNumber, boolean isLastPart, java.lang.String md5)

Methods inherited from class alluxio.underfs.ObjectLowLevelOutputStream

abortMultiPartUpload, close, flush, getPartNumber, uploadPart, uploadPart, waitForAllPartsUpload, write, write, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

mClient

protected com.volcengine.tos.TOSV2 mClient

The TOS client to interact with TOS.

mUploadId

protected volatile java.lang.String mUploadId

The upload id of this multipart upload.

Constructor Detail

TOSLowLevelOutputStream

public TOSLowLevelOutputStream(java.lang.String bucketName,
                               java.lang.String key,
                               com.volcengine.tos.TOSV2 tosClient,
                               com.google.common.util.concurrent.ListeningExecutorService executor,
                               AlluxioConfiguration ufsConf)

Constructs a new stream for writing a file.

Parameters:

bucketName - the name of the bucket

key - the key of the file

tosClient - the TOS client to upload the file with

executor - a thread pool executor

ufsConf - the object store under file system configuration

Method Detail

abortMultiPartUploadInternal

protected void abortMultiPartUploadInternal()
                                     throws java.io.IOException

Specified by:

abortMultiPartUploadInternal in class ObjectLowLevelOutputStream

Throws:

java.io.IOException

uploadPartInternal

protected void uploadPartInternal(java.io.File file,
                                  int partNumber,
                                  boolean isLastPart,
                                  @Nullable
                                  java.lang.String md5)
                           throws java.io.IOException

Specified by:

uploadPartInternal in class ObjectLowLevelOutputStream

Throws:

java.io.IOException

initMultiPartUploadInternal

protected void initMultiPartUploadInternal()
                                    throws java.io.IOException

Specified by:

initMultiPartUploadInternal in class ObjectLowLevelOutputStream

Throws:

java.io.IOException

completeMultiPartUploadInternal

protected void completeMultiPartUploadInternal()

Specified by:

completeMultiPartUploadInternal in class ObjectLowLevelOutputStream

createEmptyObject

protected void createEmptyObject(java.lang.String key)

Specified by:

createEmptyObject in class ObjectLowLevelOutputStream

putObject

protected void putObject(java.lang.String key,
                         java.io.File file,
                         @Nullable
                         java.lang.String md5)
                  throws java.io.IOException

Specified by:

putObject in class ObjectLowLevelOutputStream

Throws:

java.io.IOException

getContentHash

public java.util.Optional<java.lang.String> getContentHash()

getClient

protected com.volcengine.tos.TOSV2 getClient()