A B C D E F G L O P R S W X
All Classes All Packages

A

ACL_PUBLIC_READ - Static variable in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

available() - Method in class org.pipecraft.infra.storage.google_cs.GSInputStream

B

buildFullyQualifiedPath(String...) - Static method in class org.pipecraft.infra.storage.google_cs.GoogleStorage

Creates a fully qualified path consisting of parts that compose the path.

C

close() - Method in class org.pipecraft.infra.storage.google_cs.GSInputStream

close() - Method in class org.pipecraft.infra.storage.google_cs.GSOutputStream

close() - Method in class org.pipecraft.infra.storage.google_cs.SliceTransferJobDetails

compose(List<String>, String, boolean) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

copyToAnotherBucket(String, String, String) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

D

delete(Blob) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

deleteAllByMetaInterruptibly(Collection<Blob>, int, int, int, double) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

doneSliceProcessing() - Method in class org.pipecraft.infra.storage.google_cs.SlicedTransferFileHandler

Call this method each time a slice download for this file is complete.

E

exists(String) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

F

flush() - Method in class org.pipecraft.infra.storage.google_cs.GSOutputStream

G

generateReadOnlyUrl(String, int) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

generateResumableSignedUrlForUpload(String, String, int, Long, boolean) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

generateSignedUrl(String, String, int, boolean) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

get(Blob, File) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

get(ExecutorService, String, File) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

Downloads a file from Google Storage, using sliced download

get(ExecutorService, String, File, int) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

Downloads a file from Google Storage, using sliced download.

getAllRegularFilesByMetaInterruptibly(Collection<Blob>, File, Function<String, String>, int, int, int, double) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

Retrieves a set of files from different paths, in an efficient manner.

getAsStream(Blob, int) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

getBucket(String) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorage

returns a Google Storage bucket

getFromJson(String, Class<C>) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

getLastUpdated(Blob) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

getLength() - Method in class org.pipecraft.infra.storage.google_cs.SliceTransferJobDetails

getLength(Blob) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

getObjectMetadata(String) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

getObjectMetadata(Collection<String>) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

getOutputStream(String, int) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

getPath(Blob) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

getPosition() - Method in class org.pipecraft.infra.storage.google_cs.SliceTransferJobDetails

getProtocol() - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorage

getReadChannel() - Method in class org.pipecraft.infra.storage.google_cs.SliceTransferJobDetails

getSliced(String, File) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

Deprecated.

Use the other get(ExecutorService ..) or getSliced(..) methods, as they handles better interrupted exceptions

getSliced(String, File, int) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

Downloads a file from Google Storage, using sliced download.

getTargetFileHandler() - Method in class org.pipecraft.infra.storage.google_cs.SliceTransferJobDetails

getWriter() - Method in class org.pipecraft.infra.storage.google_cs.SlicedTransferFileHandler

GoogleStorage - Class in org.pipecraft.infra.storage.google_cs

Adapter for Google Storage client.

GoogleStorage() - Constructor for class org.pipecraft.infra.storage.google_cs.GoogleStorage

Google Storage Adapter constructor that uses environment variables.

GoogleStorageBucket - Class in org.pipecraft.infra.storage.google_cs

A storage bucket implementation based on Google Storage.

GSInputStream - Class in org.pipecraft.infra.storage.google_cs

A simple InputStream wrapper, that converts StorageExceptions to IOExceptions, as expected.

GSMultiTxtFileReaderPipe - Class in org.pipecraft.pipes.source.google_cs

Reads data from multiple files in Google-Storage under some folder, as if they were concatenated using some predefined order.

GSMultiTxtFileReaderPipe(GoogleStorage, String, String) - Constructor for class org.pipecraft.pipes.source.google_cs.GSMultiTxtFileReaderPipe

Constructor Scans the remote files in lexicographic name order.

GSMultiTxtFileReaderPipe(GoogleStorage, String, String, Charset, int, String, Comparator<Blob>) - Constructor for class org.pipecraft.pipes.source.google_cs.GSMultiTxtFileReaderPipe

Constructor

GSMultiTxtFileReaderPipe(GoogleStorage, String, String, Comparator<Blob>) - Constructor for class org.pipecraft.pipes.source.google_cs.GSMultiTxtFileReaderPipe

Constructor Assumes UTF8 encoding of all files, and doesn't apply any filter on files to read from.

GSOutputStream - Class in org.pipecraft.infra.storage.google_cs

A simple OutputStream wrapper, that converts StorageExceptions to IOExceptions, as expected.

GSTxtFileFetcherReaderPipe - Class in org.pipecraft.pipes.source.google_cs

A source pipe providing the lines of a text file from Google-Storage.

GSTxtFileFetcherReaderPipe(GoogleStorage, String, String, File) - Constructor for class org.pipecraft.pipes.source.google_cs.GSTxtFileFetcherReaderPipe

Constructor Uses the default read chunk size and default read options, and assumes UTF8

GSTxtFileFetcherReaderPipe(GoogleStorage, String, String, Charset, int, FileReadOptions, File) - Constructor for class org.pipecraft.pipes.source.google_cs.GSTxtFileFetcherReaderPipe

Constructor

GSTxtFileFetcherReaderPipe(GoogleStorage, String, String, Charset, File) - Constructor for class org.pipecraft.pipes.source.google_cs.GSTxtFileFetcherReaderPipe

Constructor Uses the default read chunk size and default read options

GSTxtFileFetcherReaderPipe(GoogleStorage, String, String, FileReadOptions, File) - Constructor for class org.pipecraft.pipes.source.google_cs.GSTxtFileFetcherReaderPipe

Constructor Uses the default read chunk size and assumes UTF8

GSTxtFileReaderPipe - Class in org.pipecraft.pipes.source.google_cs

A source pipe providing the lines of a text file in some Storage, in a streaming manner.

GSTxtFileReaderPipe(GoogleStorage, String, String) - Constructor for class org.pipecraft.pipes.source.google_cs.GSTxtFileReaderPipe

Constructor Uses the default read chunk size and default read options, and assumes UTF8

GSTxtFileReaderPipe(GoogleStorage, String, String, Charset) - Constructor for class org.pipecraft.pipes.source.google_cs.GSTxtFileReaderPipe

Constructor Uses the default read chunk size and default read options

GSTxtFileReaderPipe(GoogleStorage, String, String, Charset, int, FileReadOptions) - Constructor for class org.pipecraft.pipes.source.google_cs.GSTxtFileReaderPipe

Constructor

GSTxtFileReaderPipe(GoogleStorage, String, String, FileReadOptions) - Constructor for class org.pipecraft.pipes.source.google_cs.GSTxtFileReaderPipe

Constructor Uses the default read chunk size and assumes UTF8

GSTxtFileWriterPipe - Class in org.pipecraft.pipes.terminal.google_cs

A terminal pipe writing text lines from the input pipe into a remote GoogleStorage file.

GSTxtFileWriterPipe(Pipe<String>, GoogleStorage, String, String) - Constructor for class org.pipecraft.pipes.terminal.google_cs.GSTxtFileWriterPipe

Constructor Uses default write options and chunk size, and assumes UTF8

GSTxtFileWriterPipe(Pipe<String>, GoogleStorage, String, String, Charset) - Constructor for class org.pipecraft.pipes.terminal.google_cs.GSTxtFileWriterPipe

Constructor Uses the default write options and chunk size

GSTxtFileWriterPipe(Pipe<String>, GoogleStorage, String, String, Charset, int, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.google_cs.GSTxtFileWriterPipe

Constructor

GSTxtFileWriterPipe(Pipe<String>, GoogleStorage, String, String, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.google_cs.GSTxtFileWriterPipe

Constructor Uses default chunk size and UTF8

L

listObjects(String, boolean) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

O

org.pipecraft.infra.storage.google_cs - package org.pipecraft.infra.storage.google_cs

org.pipecraft.pipes.source.google_cs - package org.pipecraft.pipes.source.google_cs

org.pipecraft.pipes.terminal.google_cs - package org.pipecraft.pipes.terminal.google_cs

P

put(String, InputStream, long, String, boolean, boolean) - Method in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

R

read() - Method in class org.pipecraft.infra.storage.google_cs.GSInputStream

read(byte[], int, int) - Method in class org.pipecraft.infra.storage.google_cs.GSInputStream

reset() - Method in class org.pipecraft.infra.storage.google_cs.GSInputStream

S

skip(long) - Method in class org.pipecraft.infra.storage.google_cs.GSInputStream

SlicedTransferFileHandler - Class in org.pipecraft.infra.storage.google_cs

Takes part in sliced transfer, making sure that: 1) The local file writer is created lazilly, only when we start downloading a slice belonging to the file 2) The local file's writer is closed immediately after writing the last slice of the file

SlicedTransferFileHandler(File, int) - Constructor for class org.pipecraft.infra.storage.google_cs.SlicedTransferFileHandler

Constructor

SliceTransferJobDetails - Class in org.pipecraft.infra.storage.google_cs

Contains the details of a specific slice to be transferred, including the read/write handles.

SliceTransferJobDetails(Blob, int, SlicedTransferFileHandler, long, long) - Constructor for class org.pipecraft.infra.storage.google_cs.SliceTransferJobDetails

W

write(int) - Method in class org.pipecraft.infra.storage.google_cs.GSOutputStream

X

X_GOOG_ACL_HEADER - Static variable in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

X_GOOG_CONTENT_LENGTH_RANGE - Static variable in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

X_GOOG_RESUMABLE_HEADER - Static variable in class org.pipecraft.infra.storage.google_cs.GoogleStorageBucket

A B C D E F G L O P R S W X
All Classes All Packages