A B C D E F G H I J L M N O P Q R S T U V W Z 
All Classes All Packages

A

AbstractActionStatsCollector<E extends Enum<E>> - Class in org.pipecraft.infra.monitoring.collectors
A baseline for statistics collector implementations.
AbstractActionStatsCollector(Class<E>) - Constructor for class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
Constructor
AbstractCheckedFuture<V,​E extends Exception> - Class in org.pipecraft.infra.concurrent
An abstract decorator on ListenableFuture which adds checkedGet() methods which simplify Future's error handling.
AbstractCheckedFuture(ListenableFuture<V>) - Constructor for class org.pipecraft.infra.concurrent.AbstractCheckedFuture
Constructor
AbstractInputStreamItemDecoder<T> - Class in org.pipecraft.pipes.serialization
A base class for item decoders whose pre-processing on the input streams consists only on buffering and decompression, providing the transformed input stream for the decode method to work on.
AbstractInputStreamItemDecoder(InputStream, FileReadOptions) - Constructor for class org.pipecraft.pipes.serialization.AbstractInputStreamItemDecoder
Constructor
AbstractOutputStreamItemEncoder<T> - Class in org.pipecraft.pipes.serialization
A base class for item encoders whose pre-processing on the output streams consists only on buffering and compression, providing the transformed output stream for the encode method to work on.
AbstractOutputStreamItemEncoder(OutputStream, FileWriteOptions) - Constructor for class org.pipecraft.pipes.serialization.AbstractOutputStreamItemEncoder
Constructor
accept() - Method in class org.pipecraft.infra.sets.StreamSampler
To be called per visited item.
accept(A, B) - Method in interface org.pipecraft.infra.concurrent.FailableBiConsumer
Performs this operation on the given arguments.
accept(Integer) - Method in class org.pipecraft.pipes.utils.ProgressTransformer
 
accept(T) - Method in interface org.pipecraft.infra.concurrent.FailableConsumer
Performs this operation on the given argument.
accept(T) - Method in interface org.pipecraft.infra.concurrent.FailableInterruptibleConsumer
Performs this operation on the given argument.
ActionStats - Class in org.pipecraft.infra.monitoring.collectors
Simple action statistics bean referring to a specific action type.
ActionStats(long, long) - Constructor for class org.pipecraft.infra.monitoring.collectors.ActionStats
Constructor
ActionStatsCollector<E extends Enum<E>> - Interface in org.pipecraft.infra.monitoring.collectors
A common interface to all action statistics collectors.
ActionStatsMap<E extends Enum<E>> - Class in org.pipecraft.infra.monitoring.collectors
A collection of simple statistics gathered on multiple categories.
ActionStatsMap(Class<E>) - Constructor for class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
Constructor
add(double) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
Add an unweighted sample to this estimator.
add(double, int) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
Add a weighted sample.
add(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Add a weighted sample.
add(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Adds a weighted sample to the digest.
add(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Add a weighted sample.
add(List<QuantileDigest>) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Merge a list of QuantileDigest into this digest.
add(EventStatsMap<E>) - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
Adds the counts from the other collector.
add(QuantileDigest) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Merge another QuantileDigest into this digest.
addListener(Runnable, Executor) - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
 
addListener(Runnable, Executor) - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
 
addRoot(String, JsonMonitorable) - Method in class org.pipecraft.infra.monitoring.MonitoringTree
Registers a new top level monitored entity.
aggregationLogic(FailableBiConsumer<G, I, PipeException>) - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
 
aggregatorCreator(Function<F, G>) - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
 
ALL - Static variable in class org.pipecraft.pipes.utils.ShardSpecifier
 
and(FailablePredicate<? super T, ? extends E>) - Method in interface org.pipecraft.infra.concurrent.FailablePredicate
Returns a composed predicate that represents a short-circuiting logical AND of this predicate and another.
andFilter(String) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
andFilter(String) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
andFilter(Predicate<B>) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
andFilter(Predicate<File>) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
andPathFilter(Predicate<String>) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
andThen(FailableBiConsumer<? super A, ? super B, ? extends E>) - Method in interface org.pipecraft.infra.concurrent.FailableBiConsumer
Similar to andThen method of Consumer
andThen(FailableConsumer<? super T, ? extends E>) - Method in interface org.pipecraft.infra.concurrent.FailableConsumer
Similar to andThen method of Consumer
andThen(FailableFunction<? super R, ? extends V, E>) - Method in interface org.pipecraft.infra.concurrent.FailableFunction
Similar to Function.andThen(..), but works with FailableFunction
andThen(FailableInterruptibleConsumer<? super T, ? extends E>) - Method in interface org.pipecraft.infra.concurrent.FailableInterruptibleConsumer
Similar to andThen method of Consumer
append() - Method in class org.pipecraft.infra.io.FileWriteOptions
Sets the append flag (by default it's false)
apply(T) - Method in interface org.pipecraft.infra.concurrent.FailableFunction
Applies the function
areIdentical(File, File) - Static method in class org.pipecraft.infra.io.FileUtils
Compares two given files
ArithmeticUtils - Class in org.pipecraft.infra.math
Arithmetics and math utilities
asReadOnlyBuffer() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Serialize this object to a read-only ByteBuffer.
AsyncCallbackPipe<T> - Class in org.pipecraft.pipes.async.inter
A no-op async pipe that "spies" on data passing through it.
AsyncCallbackPipe(AsyncPipe<T>, FailableConsumer<? super T, ? extends PipeException>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncCallbackPipe
Constructor
AsyncCollectionWriterPipe<T> - Class in org.pipecraft.pipes.terminal
A terminal async pipe writing all contents from an input pipe into a given collection.
AsyncCollectionWriterPipe(AsyncPipe<T>) - Constructor for class org.pipecraft.pipes.terminal.AsyncCollectionWriterPipe
Constructor Collects items into a thread safe List created internally.
AsyncCollectionWriterPipe(AsyncPipe<T>, Collection<T>) - Constructor for class org.pipecraft.pipes.terminal.AsyncCollectionWriterPipe
Constructor
AsyncCompoundPipe<T> - Class in org.pipecraft.pipes.async.inter
A pipe encapsulating a pipeline.
AsyncCompoundPipe() - Constructor for class org.pipecraft.pipes.async.inter.AsyncCompoundPipe
 
AsyncConsumerPipe<T> - Class in org.pipecraft.pipes.terminal
Consumes the contents of an AsyncPipe, blocking in the start() method until all data is read.
AsyncConsumerPipe(AsyncPipe<T>) - Constructor for class org.pipecraft.pipes.terminal.AsyncConsumerPipe
Constructor
AsyncConsumerPipe(AsyncPipe<T>, FailableConsumer<? super T, PipeException>) - Constructor for class org.pipecraft.pipes.terminal.AsyncConsumerPipe
Constructor
AsyncConsumerPipe(AsyncPipe<T>, FailableConsumer<? super T, PipeException>, Runnable) - Constructor for class org.pipecraft.pipes.terminal.AsyncConsumerPipe
Constructor
AsyncEmptyPipe<T> - Class in org.pipecraft.pipes.async.source
An async source pipe returning no data.
AsyncEmptyPipe() - Constructor for class org.pipecraft.pipes.async.source.AsyncEmptyPipe
 
AsyncEnqueuingSharderPipe<T> - Class in org.pipecraft.pipes.terminal
A terminal pipe that receives an async pipe as input, and shards the contents of the input pipe into multiple queues according to some sharding criteria based on item values.
AsyncEnqueuingSharderPipe(AsyncPipe<T>, List<? extends BlockingQueue<T>>, Function<? super T, Integer>, T, T) - Constructor for class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
Constructor
AsyncEnqueuingSharderPipe(AsyncPipe<T>, List<? extends BlockingQueue<T>>, T, T) - Constructor for class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
Constructor Uses hash based sharding into queues
AsyncFilterPipe<T> - Class in org.pipecraft.pipes.async.inter
An async version of the filter pipe (See FilterPipe.
AsyncFilterPipe(AsyncPipe<T>, Predicate<? super T>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncFilterPipe
constructor
AsyncFlexibleMapPipe<S,​T> - Class in org.pipecraft.pipes.async.inter
An async version of the flexible mapper pipe (See FlexibleMapPipe.
AsyncFlexibleMapPipe(AsyncPipe<S>, PipeFactory<S, ? extends T>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncFlexibleMapPipe
constructor
AsyncHeadPipe<T> - Class in org.pipecraft.pipes.async.inter
An async version of the head pipe (See HeadPipe.
AsyncHeadPipe(AsyncPipe<T>, int) - Constructor for class org.pipecraft.pipes.async.inter.AsyncHeadPipe
constructor
AsyncMapPipe<S,​T> - Class in org.pipecraft.pipes.async.inter
An async version of the mapper pipe (See MapPipe.
AsyncMapPipe(AsyncPipe<S>, FailableFunction<? super S, T, PipeException>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncMapPipe
constructor
AsyncMultiFileReaderPipe<T> - Class in org.pipecraft.pipes.async.source
An async source pipe reading multiple local binary files.
AsyncMultiFileReaderPipe(LocalMultiFileReaderConfig<T>) - Constructor for class org.pipecraft.pipes.async.source.AsyncMultiFileReaderPipe
Constructor
AsyncPipe<T> - Class in org.pipecraft.pipes.async
A pipe that produces items asynchronously.
AsyncPipe() - Constructor for class org.pipecraft.pipes.async.AsyncPipe
 
AsyncPipe.Status - Enum in org.pipecraft.pipes.async
 
AsyncPipeListener<T> - Interface in org.pipecraft.pipes.async
A listener to be attached to AsyncPipes.
AsyncProgressPipe<T> - Class in org.pipecraft.pipes.async.inter
A no-op async pipe that reports progress.
AsyncProgressPipe(AsyncPipe<T>, int, Consumer<Integer>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncProgressPipe
Constructor
AsyncSeqGenPipe<T> - Class in org.pipecraft.pipes.async.source
An async source pipe, producing a fixed number of items using a fixed number of threads.
AsyncSeqGenPipe(long, Function<Long, T>, int) - Constructor for class org.pipecraft.pipes.async.source.AsyncSeqGenPipe
Constructor
AsyncSharderByHashPipe<T> - Class in org.pipecraft.pipes.terminal
An async sharder pipe, writing items to files based on the hash value of individual items.
AsyncSharderByHashPipe(AsyncPipe<T>, EncoderFactory<? super T>, int, File) - Constructor for class org.pipecraft.pipes.terminal.AsyncSharderByHashPipe
Constructor Uses default file write options.
AsyncSharderByHashPipe(AsyncPipe<T>, EncoderFactory<? super T>, int, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.AsyncSharderByHashPipe
Constructor
AsyncSharderPipe<T> - Class in org.pipecraft.pipes.terminal
A terminal pipe that receives an async pipe as input, and splits the contents of the input pipe into multiple files according to some sharding criteria based on individual items.
AsyncSharderPipe(AsyncPipe<T>, EncoderFactory<? super T>, Function<? super T, String>, File) - Constructor for class org.pipecraft.pipes.terminal.AsyncSharderPipe
Constructor Uses default file write options
AsyncSharderPipe(AsyncPipe<T>, EncoderFactory<? super T>, Function<? super T, String>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.AsyncSharderPipe
Constructor
asyncStart() - Method in class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
A special async version of the standard start() method.
AsyncStorageMultiFileReaderPipe<T,​B> - Class in org.pipecraft.pipes.async.source
An async source pipe reading multiple remote binary files from the cloud.
AsyncStorageMultiFileReaderPipe(StorageMultiFileReaderConfig<T, B>) - Constructor for class org.pipecraft.pipes.async.source.AsyncStorageMultiFileReaderPipe
Constructor
AsyncTimeoutPipe<T> - Class in org.pipecraft.pipes.async.inter
An async pipe enforcing a timeout on completion of its async input pipe.
AsyncTimeoutPipe(AsyncPipe<T>, Duration, ScheduledExecutorService) - Constructor for class org.pipecraft.pipes.async.inter.AsyncTimeoutPipe
constructor
AsyncToSyncPipe<T> - Class in org.pipecraft.pipes.sync.inter
A pipe which acts as a converter from async pipe/s to a sync pipe.
AsyncToSyncPipe(AsyncPipe<T>, int, Supplier<T>) - Constructor for class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
Constructor Uses a LinkedBlockingQueue with the given capacity
AsyncToSyncPipe(AsyncPipe<T>, BlockingQueue<T>, Supplier<T>) - Constructor for class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
Constructor
AsyncUnionPipe<T> - Class in org.pipecraft.pipes.async.inter
An intermediate async pipe fed by a set of other async pipes.
AsyncUnionPipe(Collection<AsyncPipe<T>>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncUnionPipe
Constructor
AverageSlidingWindow - Class in org.pipecraft.infra.monitoring.sliding
A sliding window used for calculating the average of a stream of numbers, in a given time frame
AverageSlidingWindow(int, int, TimeUnit, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
Constructor
AvroCodecFactory<T> - Class in org.pipecraft.pipes.serialization
A codec factory for AVRO format.
AvroCodecFactory(Class<T>) - Constructor for class org.pipecraft.pipes.serialization.AvroCodecFactory
Constructor
AvroDecoder<T> - Class in org.pipecraft.pipes.serialization
An ItemDecoder that decodes objects encoded in avro format.
AvroDecoder(Class<T>, InputStream) - Constructor for class org.pipecraft.pipes.serialization.AvroDecoder
Constructor.
AvroEncoder<T> - Class in org.pipecraft.pipes.serialization
An ItemEncoder that encode any java class to bytes using avro.
AvroEncoder(Class<T>, OutputStream) - Constructor for class org.pipecraft.pipes.serialization.AvroEncoder
Constructor

B

BasePipe - Interface in org.pipecraft.pipes
A base interface containing minimal API for sync, async and terminal pipes
BinFileWriterPipe<T> - Class in org.pipecraft.pipes.terminal
A terminal pipe writing items to a local file in a binary format.
BinFileWriterPipe(Pipe<T>, File, FileWriteOptions, EncoderFactory<? super T>) - Constructor for class org.pipecraft.pipes.terminal.BinFileWriterPipe
Constructor
BinFileWriterPipe(Pipe<T>, File, EncoderFactory<? super T>) - Constructor for class org.pipecraft.pipes.terminal.BinFileWriterPipe
Constructor Uses default file write settings (see @{FileWriteOptions})
BinInputReaderPipe<T> - Class in org.pipecraft.pipes.sync.source
A source pipe reading items from a given binary input (file or input stream).
BinInputReaderPipe(File, FileReadOptions, DecoderFactory<T>) - Constructor for class org.pipecraft.pipes.sync.source.BinInputReaderPipe
Constructor
BinInputReaderPipe(File, DecoderFactory<T>) - Constructor for class org.pipecraft.pipes.sync.source.BinInputReaderPipe
Constructor
BinInputReaderPipe(InputStream, DecoderFactory<T>, int, long, Compression) - Constructor for class org.pipecraft.pipes.sync.source.BinInputReaderPipe
Constructor
BinInputReaderPipe(FailableInterruptibleSupplier<SizedInputStream, IOException>, DecoderFactory<T>, int, Compression) - Constructor for class org.pipecraft.pipes.sync.source.BinInputReaderPipe
Constructor
BinInputReaderPipe(SizedInputStream, DecoderFactory<T>, FileReadOptions) - Constructor for class org.pipecraft.pipes.sync.source.BinInputReaderPipe
Constructor
BlockingActionStatsCollector<E extends Enum<E>> - Class in org.pipecraft.infra.monitoring.collectors
A statistics collector which uses synchronization locks for guaranteeing data consistency.
BlockingActionStatsCollector(Class<E>) - Constructor for class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
Constructor
BlockingSampler<T> - Class in org.pipecraft.infra.monitoring.sampling
A utility for sampling of recent values, using a blocking approach for guaranteeing k latest events in a FIFO order.
BlockingSampler(int) - Constructor for class org.pipecraft.infra.monitoring.sampling.BlockingSampler
Constructor
BlockingSampler(int, SampleTextualizer<T>) - Constructor for class org.pipecraft.infra.monitoring.sampling.BlockingSampler
Constructor
bucket(Bucket<B>) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
bucket(Storage<?, B>, String) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
Bucket<T> - Class in org.pipecraft.infra.storage
A base class for a storage bucket implementations.
Bucket(String) - Constructor for class org.pipecraft.infra.storage.Bucket
Constructor
buffer(int) - Method in class org.pipecraft.infra.io.FileReadOptions
Sets the buffer size (default = 8192)
buffer(int) - Method in class org.pipecraft.infra.io.FileWriteOptions
Sets the buffer size (default = 8192)
build() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
 
build() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
 
build() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
build() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
builder() - Static method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
 
builder() - Static method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig
 
builder(DecoderFactory<T>) - Static method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
Creates a builder set up with the given file data decoder and additional defaults.
builder(DecoderFactory<T>) - Static method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
Creates a builder set up with the given file data decoder and additional defaults.
builder(DecoderFactory<T>, FileReadOptions) - Static method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
Creates a builder set up with the given file data decoder and additional defaults.
builder(DecoderFactory<T>, FileReadOptions) - Static method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
Creates a builder set up with the given file data decoder and additional defaults.
builder(PipeReaderSupplier<T, B>) - Static method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
Creates a builder set up with the given pipe supplier and additional defaults.
builder(PipeReaderSupplier<T, File>) - Static method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
Creates a builder set up with the given pipe supplier and additional defaults.
buildFullPath(String, String...) - Static method in class org.pipecraft.infra.storage.PathUtils
Builds a full cloud path from the given parts.
buildPath(boolean, String...) - Static method in class org.pipecraft.infra.storage.PathUtils
Builds a cloud path from the given parts (not including protocol) Handles normalization of the path by eliminating consecutive separators, using separators between paths.
buildPath(String...) - Static method in class org.pipecraft.infra.storage.PathUtils
Builds a path from the given parts (not including protocol) Handles normalization of the path by eliminating consecutive separators, using separators between paths.
buildPath(String, boolean, String...) - Static method in class org.pipecraft.infra.storage.PathUtils
Builds a full cloud path from the given parts.
ByteArrayCodec<T> - Interface in org.pipecraft.pipes.serialization
An interface for byte array encoder and decoder
ByteArrayDecoder<T> - Interface in org.pipecraft.pipes.serialization
A functional interface for decoders working on byte arrays representing single items.
ByteArrayEncoder<T> - Interface in org.pipecraft.pipes.serialization
A functional interface for encoders producing byte arrays representing single items.
byteSize() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Returns the byte size of the wrapped MergingDigest.

C

CallbackPipe<T> - Class in org.pipecraft.pipes.sync.inter
A pipe invoking a callback method per item passed through it.
CallbackPipe(Pipe<T>, FailableConsumer<? super T, ? extends PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CallbackPipe
Constructor
CallbackPipe(Pipe<T>, FailableConsumer<? super T, ? extends PipeException>, FailableRunnable<? extends PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CallbackPipe
Constructor
CallbackPipe(Pipe<T>, FailableRunnable<? extends PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CallbackPipe
Constructor
cancel(boolean) - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
 
cancel(boolean) - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
 
canEarlyExit(BitSet, int) - Method in enum org.pipecraft.pipes.sync.inter.join.JoinMode
 
canTerminate(BitSet) - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
Called whenever one of the input pipes terminated.
canTerminate(BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedIntersectionPipe
 
canTerminate(BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedSubtractionPipe
 
canTerminate(BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedUnionPipe
 
categoriesEnumClass - Variable in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
 
cdf(double) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
Get an estimate for the cdf of the distribution at x.
cdf(double) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Get an estimate for the cdf of the distribution at x.
cdf(double) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Get an estimate for the cdf of the distribution at x.
cdf(double) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Get an estimate for the cdf of the distribution at x.
cdf(List<Double>) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
Get an estimate for the cdf of the distribution at every coordinate of input list.
cdf(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Get an estimate for the cdf of the distribution at every coordinate of input list.
cdf(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Get an estimate for the cdf of the distribution at every coordinate of input list.
cdf(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Get an estimate for the cdf of the distribution at every coordinate of input list.
CheckedFuture<V,​E extends Exception> - Interface in org.pipecraft.infra.concurrent
Extends ListenableFuture and adds checkedGet() methods which simplify Future's error handling.
CheckedFutureTransformer<S,​T,​E extends Exception> - Class in org.pipecraft.infra.concurrent
A CheckedFuture decorator converting a checked future with value type S to a checked future with value type T.
CheckedFutureTransformer(AbstractCheckedFuture<S, E>, Function<S, T>) - Constructor for class org.pipecraft.infra.concurrent.CheckedFutureTransformer
Constructor
checkedGet() - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
A simplified version of Future.get() which maps ExecutionException to a more indicative exception type
checkedGet() - Method in interface org.pipecraft.infra.concurrent.CheckedFuture
A simplified version of Future.get() which maps ExecutionException to a more indicative exception type
checkedGet() - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
A simplified version of Future.get() which maps ExecutionException to a more indicative exception type
checkedGet(long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
A simplified version of Future.get(long, TimeUnit) which maps ExecutionException to a more indicative exception type
checkedGet(long, TimeUnit) - Method in interface org.pipecraft.infra.concurrent.CheckedFuture
A simplified version of Future.get(long, TimeUnit) which maps ExecutionException to a more indicative exception type
checkedGet(long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
A simplified version of Future.get(long, TimeUnit) which maps ExecutionException to a more indicative exception type
clear() - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
Clears all statistics.
clear() - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
 
clear() - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
Clears all counters.
clear() - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
 
clearRecord(AtomicInteger) - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
 
clearRecord(SlotRecord) - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
 
clearRecord(R) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
clears a given record by resetting its data.
close() - Method in class org.pipecraft.pipes.async.AsyncPipe
 
close() - Method in class org.pipecraft.pipes.async.inter.AsyncCallbackPipe
 
close() - Method in class org.pipecraft.pipes.async.inter.AsyncCompoundPipe
 
close() - Method in class org.pipecraft.pipes.async.inter.AsyncFilterPipe
 
close() - Method in class org.pipecraft.pipes.async.inter.AsyncFlexibleMapPipe
 
close() - Method in class org.pipecraft.pipes.async.inter.AsyncHeadPipe
 
close() - Method in class org.pipecraft.pipes.async.inter.AsyncMapPipe
 
close() - Method in class org.pipecraft.pipes.async.inter.AsyncProgressPipe
 
close() - Method in class org.pipecraft.pipes.async.inter.AsyncTimeoutPipe
 
close() - Method in class org.pipecraft.pipes.async.inter.AsyncUnionPipe
 
close() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerPipe
 
close() - Method in class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
 
close() - Method in class org.pipecraft.pipes.async.source.AsyncSeqGenPipe
 
close() - Method in class org.pipecraft.pipes.serialization.AbstractInputStreamItemDecoder
 
close() - Method in class org.pipecraft.pipes.serialization.AbstractOutputStreamItemEncoder
 
close() - Method in class org.pipecraft.pipes.serialization.AvroDecoder
 
close() - Method in class org.pipecraft.pipes.serialization.AvroEncoder
 
close() - Method in class org.pipecraft.pipes.serialization.CSVDecoder
 
close() - Method in class org.pipecraft.pipes.serialization.CSVEncoder
 
close() - Method in interface org.pipecraft.pipes.serialization.ItemDecoder
 
close() - Method in class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.ConcatPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.CountPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.HeadPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.IntermediateBinFileWriterPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.join.HashJoinPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.MapPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.OrderValidationPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.ProgressPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.reduct.HashReductorPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.SkipPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.SortedMergePipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.SortPipe
 
close() - Method in class org.pipecraft.pipes.sync.inter.TopKPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.EmptyPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.ErrorPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.IteratorReaderPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.ReaderPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.SeqGenPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
 
close() - Method in class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
 
close() - Method in class org.pipecraft.pipes.terminal.AsyncCollectionWriterPipe
 
close() - Method in class org.pipecraft.pipes.terminal.AsyncConsumerPipe
 
close() - Method in class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
 
close() - Method in class org.pipecraft.pipes.terminal.AsyncSharderPipe
 
close() - Method in class org.pipecraft.pipes.terminal.CollectionWriterPipe
 
close() - Method in class org.pipecraft.pipes.terminal.CompoundTerminalPipe
 
close() - Method in class org.pipecraft.pipes.terminal.ConsumerPipe
 
close() - Method in class org.pipecraft.pipes.terminal.ParallelConsumerPipe
 
close() - Method in class org.pipecraft.pipes.terminal.PercentilePipe
 
close() - Method in class org.pipecraft.pipes.terminal.QueueWriterPipe
 
close() - Method in class org.pipecraft.pipes.terminal.SharderByItemPipe
 
close() - Method in class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
 
close() - Method in class org.pipecraft.pipes.terminal.TxtFileWriterPipe
 
close() - Method in class org.pipecraft.pipes.terminal.WriterPipe
 
close(Closeable) - Static method in class org.pipecraft.infra.io.FileUtils
Closes the closeable.
close(Closeable...) - Static method in class org.pipecraft.infra.io.FileUtils
Closes the resources in the order they are provided.
close(Collection<? extends Closeable>) - Static method in class org.pipecraft.infra.io.FileUtils
Closes the resources in the order they are provided.
close(Collection<? extends BasePipe>) - Static method in class org.pipecraft.pipes.utils.PipeUtils
Closes the given pipes, ignoring errors.
close(BasePipe...) - Static method in class org.pipecraft.pipes.utils.PipeUtils
Closes the given pipes, ignoring errors.
CLOSED - org.pipecraft.pipes.async.AsyncPipe.Status
 
closeSilently(Closeable...) - Static method in class org.pipecraft.infra.io.FileUtils
Closes the given closeables, in a silent manner (ignoring IOExceptions)
closeSilently(Collection<? extends Closeable>) - Static method in class org.pipecraft.infra.io.FileUtils
Closes the given closeables, in a silent manner (ignoring IOExceptions)
codec(ByteArrayCodec<T>) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
 
CodecFactory<T> - Interface in org.pipecraft.pipes.serialization
A factory of both encoders and decoders
Coding - Class in org.pipecraft.infra.io
General encoding/decoding utility functions
Coding() - Constructor for class org.pipecraft.infra.io.Coding
 
CollectionReaderPipe<T> - Class in org.pipecraft.pipes.sync.source
A pipe based on a given collection of items.
CollectionReaderPipe(Collection<T>) - Constructor for class org.pipecraft.pipes.sync.source.CollectionReaderPipe
Constructor
CollectionReaderPipe(T...) - Constructor for class org.pipecraft.pipes.sync.source.CollectionReaderPipe
Constructor
CollectionWriterPipe<T> - Class in org.pipecraft.pipes.terminal
A terminal pipe writing all contents from an input pipe into a given collection.
CollectionWriterPipe(Pipe<T>) - Constructor for class org.pipecraft.pipes.terminal.CollectionWriterPipe
Constructor Collects items into an ArrayList
CollectionWriterPipe(Pipe<T>, Collection<T>) - Constructor for class org.pipecraft.pipes.terminal.CollectionWriterPipe
Constructor
compareTo(HostPort) - Method in class org.pipecraft.infra.net.HostPort
 
compose(List<String>, String, boolean) - Method in class org.pipecraft.infra.storage.Bucket
Composes (concats) remote files.
compose(List<String>, String, boolean) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
compose(FailableFunction<? super V, ? extends T, E>) - Method in interface org.pipecraft.infra.concurrent.FailableFunction
Similar to Function.compose(..), but works with FailableFunction
CompoundPipe<T> - Class in org.pipecraft.pipes.sync.inter
A pipe encapsulating a pipeline.
CompoundPipe() - Constructor for class org.pipecraft.pipes.sync.inter.CompoundPipe
 
CompoundTerminalPipe - Class in org.pipecraft.pipes.terminal
A terminal pipe encapsulating a pipeline.
CompoundTerminalPipe() - Constructor for class org.pipecraft.pipes.terminal.CompoundTerminalPipe
 
compress(File, Compression) - Static method in class org.pipecraft.infra.io.FileUtils
Compresses a given file, leaving the original.
compress(File, Compression, int) - Static method in class org.pipecraft.infra.io.FileUtils
Compresses a given file, leaving the original
compressAll(File, Compression, int) - Static method in class org.pipecraft.infra.io.FileUtils
Compresses all files in the given folder, deleting the originals Original file names are appended the corresponding compression suffix (.gz/.zst).
compressAll(File, Compression, int, int) - Static method in class org.pipecraft.infra.io.FileUtils
Compresses all files in the given folder, deleting the originals Original file names are appended the corresponding compression suffix (.gz/.zst).
compression() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Compression factor of this digest.
Compression - Enum in org.pipecraft.infra.io
Supported compression types
computeVarint32Size(int) - Static method in class org.pipecraft.infra.io.Coding
Compute the number of bytes that would be needed to encode a varint.
ConcatPipe<T> - Class in org.pipecraft.pipes.sync.inter
An intermediate pipe consisting of concatenating the contents of a series of pipes
ConcatPipe(List<PipeSupplier<T>>) - Constructor for class org.pipecraft.pipes.sync.inter.ConcatPipe
Constructor
ConcatPipe(PipeSupplier<T>...) - Constructor for class org.pipecraft.pipes.sync.inter.ConcatPipe
Constructor
ConcurrentQuantileEstimator - Interface in org.pipecraft.infra.monitoring.quantile
Thread-safe quantile and cdf estimation
ConsumerPipe<T> - Class in org.pipecraft.pipes.terminal
A terminal pipe that consumes all contents of the input pipe in a synchronous manner.
ConsumerPipe(Pipe<T>) - Constructor for class org.pipecraft.pipes.terminal.ConsumerPipe
Constructor Builds a no-op consumer
ConsumerPipe(Pipe<T>, Runnable) - Constructor for class org.pipecraft.pipes.terminal.ConsumerPipe
Constructor
ConsumerPipe(Pipe<T>, FailableConsumer<? super T, PipeException>) - Constructor for class org.pipecraft.pipes.terminal.ConsumerPipe
Constructor
ConsumerPipe(Pipe<T>, FailableConsumer<? super T, PipeException>, Runnable) - Constructor for class org.pipecraft.pipes.terminal.ConsumerPipe
Constructor
copy(String, String) - Method in class org.pipecraft.infra.storage.Bucket
Copies a a remote file in the current bucket to a different location in the same bucket
copyFile(File, File) - Static method in class org.pipecraft.infra.io.FileUtils
Copies a file from one location to the other
copyFileToFolder(File, File) - Static method in class org.pipecraft.infra.io.FileUtils
Copies a file from one location to the other, keeping the filename
copyFolderRecursiveInterruptibly(String, String, int) - Method in class org.pipecraft.infra.storage.Bucket
Copies all files, recursively, from one folder in this bucket to another.
copyFolderRecursiveInterruptibly(String, String, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Copies all files, recursively, from one folder in this bucket to another.
copyInterruptibly(String, String) - Method in class org.pipecraft.infra.storage.Bucket
Copies a a remote file in the current bucket to a different location in the same bucket.
copyInterruptibly(String, String, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Copies a a remote file in the current bucket to a different location in the same bucket.
copyToAnotherBucket(String, String, String) - Method in class org.pipecraft.infra.storage.Bucket
Copies a file between this bucket to another bucket
copyToAnotherBucket(String, String, String) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
copyToAnotherBucketInterruptibly(String, String, String) - Method in class org.pipecraft.infra.storage.Bucket
Copies a file between this bucket to another bucket, using retries.
copyToAnotherBucketInterruptibly(String, String, String, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Copies a file between this bucket to another bucket, using retries
count() - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
 
countEvent(E) - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
Indicates that an event of a given category just occurred.
countEvent(T, long) - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
Increments an event counter
CountPipe - Class in org.pipecraft.pipes.sync.inter
A pipe counting the items in the input pipe, and returning the count as a single output item.
CountPipe(Pipe<?>) - Constructor for class org.pipecraft.pipes.sync.inter.CountPipe
constructor
createFolder(File, String) - Static method in class org.pipecraft.infra.io.FileUtils
creates a folder
createFolder(String) - Static method in class org.pipecraft.infra.io.FileUtils
creates a folder, or keeps it if exists
createInputStream() - Method in class org.pipecraft.pipes.sync.source.BinInputReaderPipe
 
createInputStream() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
 
createInputStream() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
 
createInputStream() - Method in class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
 
createInputStream() - Method in class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
 
createPipeline() - Method in class org.pipecraft.pipes.async.inter.AsyncCompoundPipe
 
createPipeline() - Method in class org.pipecraft.pipes.async.source.AsyncMultiFileReaderPipe
 
createPipeline() - Method in class org.pipecraft.pipes.async.source.AsyncStorageMultiFileReaderPipe
 
createPipeline() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
 
createPipeline() - Method in class org.pipecraft.pipes.sync.inter.GrouperPipe
 
createPipeline() - Method in class org.pipecraft.pipes.sync.inter.join.HashJoinPipe
 
createPipeline() - Method in class org.pipecraft.pipes.sync.inter.reduct.HashReductorPipe
 
createPipeline() - Method in class org.pipecraft.pipes.sync.source.MultiFileReaderPipe
 
createPipeline() - Method in class org.pipecraft.pipes.sync.source.MultiTxtFileReaderPipe
 
createPipeline() - Method in class org.pipecraft.pipes.sync.source.StorageMultiFileReaderPipe
 
createPipeline() - Method in class org.pipecraft.pipes.sync.source.StorageMultiTxtFileReaderPipe
 
createPipeline() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
 
createPipeline() - Method in class org.pipecraft.pipes.terminal.BinFileWriterPipe
 
createPipeline() - Method in class org.pipecraft.pipes.terminal.CompoundTerminalPipe
 
createPipeline() - Method in class org.pipecraft.pipes.terminal.SharderBySeqPipe
 
createTempFile(String, String) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a unique temp file in the system's default tmp folder.
createTempFile(String, String, File) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a unique temp file in the given folder.
createTempFolder(String) - Static method in class org.pipecraft.infra.io.FileUtils
creates a temp folder under the system's default tmp folder
createTempFolder(String, File) - Static method in class org.pipecraft.infra.io.FileUtils
creates a temp folder under a given parent folder
createUniqueFile(String, String) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a unique file in the system's default tmp folder.
createUniqueFile(String, String, File) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a unique file in the given folder.
createUniqueFolder(String) - Static method in class org.pipecraft.infra.io.FileUtils
creates a unique folder under the system's default tmp folder
createUniqueFolder(String, File) - Static method in class org.pipecraft.infra.io.FileUtils
creates a unique folder under a given parent folder
CSV_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
 
CSV_GZ_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
 
CSV_ZSTD_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
 
CSVDecoder<T> - Class in org.pipecraft.pipes.serialization
An ItemDecoder that decodes CSV rows.
CSVDecoder(InputStream, FailableFunction<String[], T, ValidationPipeException>) - Constructor for class org.pipecraft.pipes.serialization.CSVDecoder
Constructor Assumes UTF8, comma as a delimiter, no header rows and default read options (no compression)
CSVDecoder(InputStream, FailableFunction<String[], T, ValidationPipeException>, int) - Constructor for class org.pipecraft.pipes.serialization.CSVDecoder
Constructor Assumes UTF8, comma as a delimiter and default read options (no compression)
CSVDecoder(InputStream, FailableFunction<String[], T, ValidationPipeException>, Charset, char, int, FileReadOptions) - Constructor for class org.pipecraft.pipes.serialization.CSVDecoder
Constructor
CSVEncoder<T> - Class in org.pipecraft.pipes.serialization
An ItemEncoder that encodes objects as compliant CSV rows.
CSVEncoder(OutputStream, Function<T, String[]>) - Constructor for class org.pipecraft.pipes.serialization.CSVEncoder
Constructor Assumes UTF8, comma as a delimiter and default write options (no compression)
CSVEncoder(OutputStream, Function<T, String[]>, Charset, char, String, FileWriteOptions) - Constructor for class org.pipecraft.pipes.serialization.CSVEncoder
Constructor
CSVMapperPipe<T> - Class in org.pipecraft.pipes.sync.inter
An intermediate pipe that parses strings in CSV format, and binds each line to an object
CSVMapperPipe(Pipe<String>, boolean, String[], FailableFunction<Map<String, String>, T, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CSVMapperPipe
Constructor Constructs a mapper with the default delimiter (',').
CSVMapperPipe(Pipe<String>, char, boolean, String[], FailableFunction<Map<String, String>, T, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CSVMapperPipe
Constructor
CSVMapperPipe(Pipe<String>, FailableFunction<Map<String, String>, T, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CSVMapperPipe
Constructor Constructs a mapper with the default delimiter (','), expecting a header, and using the header column names for the row converter.

D

decode() - Method in class org.pipecraft.pipes.serialization.AvroDecoder
 
decode() - Method in class org.pipecraft.pipes.serialization.CSVDecoder
 
decode() - Method in interface org.pipecraft.pipes.serialization.ItemDecoder
Reads and decodes the next object from the input stream.
decode(byte[]) - Method in interface org.pipecraft.pipes.serialization.ByteArrayDecoder
 
decode(byte[]) - Method in class org.pipecraft.pipes.serialization.DelegatingByteArrayCodec
 
DecoderFactory<T> - Interface in org.pipecraft.pipes.serialization
Allows creating ItemDecoder instances of some specific type.
decompress(File, Compression) - Static method in class org.pipecraft.infra.io.FileUtils
Decompresses a given file, leaving the original
decompressAll(File, Compression, int) - Static method in class org.pipecraft.infra.io.FileUtils
Decompresses all files in the given folder, deleting the originals File names are removed the relevant extension (.gz/.zst), and if not found, the name is appended with ".decompressed".
DedupPipe<T> - Class in org.pipecraft.pipes.sync.inter
Uses item equality (equals() method) in input pipe items for performing a dedup operation.
DedupPipe(Pipe<T>, CodecFactory<T>, int, File) - Constructor for class org.pipecraft.pipes.sync.inter.DedupPipe
Constructor
DEFAULT_RETRIER - Static variable in class org.pipecraft.infra.storage.Bucket
 
DEFAULT_RETRY_INITIAL_SLEEP_SEC - Static variable in class org.pipecraft.infra.storage.Bucket
 
DEFAULT_RETRY_MAX_ATTEMPTS - Static variable in class org.pipecraft.infra.storage.Bucket
 
DEFAULT_RETRY_WAIT_TIME_FACTOR - Static variable in class org.pipecraft.infra.storage.Bucket
 
DelegatePipe<T> - Class in org.pipecraft.pipes.sync.inter
A pipe delegating all work to another pipe given in the constructor.
DelegatePipe(Pipe<T>) - Constructor for class org.pipecraft.pipes.sync.inter.DelegatePipe
Constructor
DelegatingByteArrayCodec<T> - Class in org.pipecraft.pipes.serialization
Wraps a given byte array encoder and byte array decoder, and delegates encoding/decoding requests to them.
DelegatingByteArrayCodec(ByteArrayEncoder<T>, ByteArrayDecoder<T>) - Constructor for class org.pipecraft.pipes.serialization.DelegatingByteArrayCodec
Constructor
DelegatingCodecFactory<T> - Class in org.pipecraft.pipes.serialization
Wraps a given encoder and decoder factories, and delegates encoding/decoding creation requests to them.
DelegatingCodecFactory(EncoderFactory<T>, DecoderFactory<T>) - Constructor for class org.pipecraft.pipes.serialization.DelegatingCodecFactory
Constructor
delete(File) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
delete(String) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a single object.
delete(T) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a single object.
deleteAllByMetaInterruptibly(Collection<T>, int) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a set of remote files.
deleteAllByMetaInterruptibly(Collection<T>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a set of remote files.
deleteAllByMetaInterruptibly(Iterator<T>, int) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a set of remote files.
deleteAllByMetaInterruptibly(Iterator<T>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a set of remote files.
deleteAllInterruptibly(Collection<String>, int) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a set of remote files.
deleteAllInterruptibly(Collection<String>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a set of remote files.
deleteAllInterruptibly(Iterator<String>, int) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a set of remote files.
deleteAllInterruptibly(Iterator<String>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a set of remote files.
deleteFile(File, Logger) - Static method in class org.pipecraft.infra.io.FileUtils
Deletes a file/folder, ignoring failures.
deleteFiles(File...) - Static method in class org.pipecraft.infra.io.FileUtils
Deletes a set of files/folders, ignoring failures.
deleteFiles(Logger, File...) - Static method in class org.pipecraft.infra.io.FileUtils
Deletes a set of files/folders, ignoring failures.
deleteFolderRecursiveInterruptibly(String, int) - Method in class org.pipecraft.infra.storage.Bucket
Deletes all folder contents, recursively.
deleteFolderRecursiveInterruptibly(String, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Deletes all folder contents, recursively.
deleteFolderRegularFiles(String) - Method in class org.pipecraft.infra.storage.Bucket
Deletes all regular files under a remote folder.
deleteInterruptibly(String) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a single object with retries.
deleteInterruptibly(String, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a single object with retries.
deleteInterruptibly(T) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a single object with retries.
deleteInterruptibly(T, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Deletes a single object with retries.
detect(File) - Static method in enum org.pipecraft.infra.io.Compression
Detects compression based on file extension
detect(String) - Static method in enum org.pipecraft.infra.io.Compression
Detects compression based on file extension
detectCompression(String) - Method in class org.pipecraft.infra.io.FileReadOptions
Sets the compression of the file by its extension
discriminator(FailableFunction<I, F, PipeException>) - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
 
DistributedShufflerConfig<T> - Class in org.pipecraft.pipes.async.inter.distributed
A configuration object for DistributedShufflerPipe.
DistributedShufflerConfig.Builder<T> - Class in org.pipecraft.pipes.async.inter.distributed
 
DistributedShufflerPipe<T> - Class in org.pipecraft.pipes.async.inter.distributed
An async pipe that takes input and shuffle it across multiple workers.
DistributedShufflerPipe(AsyncPipe<T>, DistributedShufflerConfig<T>) - Constructor for class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerPipe
Another Constructor????? YES!
done() - Method in interface org.pipecraft.pipes.async.AsyncPipeListener
Indicates that the async pipe is done producing items, in a successfull manner.
DONE - org.pipecraft.pipes.async.AsyncPipe.Status
 
DONE_FILE_NAME - Static variable in class org.pipecraft.infra.storage.Bucket
 
downloadAndGetReadPipes(Collection<B>, Bucket<B>, StorageMultiFileReaderConfig<T, B>) - Static method in class org.pipecraft.pipes.utils.multi.MultiFileReaderUtils
 
downloadFirst() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
Indicates that instead of streaming (the default behavior), we first download all files (in an efficient manner), and then read them locally.
downloadFirst(File) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
Indicates that instead of streaming (the default behavior), we first download all files (in an efficient manner), and then read them locally.
drainTo(Collection<? super E>) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
drainTo(Collection<? super E>, int) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
duration() - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
 
duration() - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
 

E

EmptyPipe<T> - Class in org.pipecraft.pipes.sync.source
A source pipe with no data in it.
encode(T) - Method in class org.pipecraft.pipes.serialization.AvroEncoder
 
encode(T) - Method in interface org.pipecraft.pipes.serialization.ByteArrayEncoder
 
encode(T) - Method in class org.pipecraft.pipes.serialization.CSVEncoder
 
encode(T) - Method in class org.pipecraft.pipes.serialization.DelegatingByteArrayCodec
 
encode(T) - Method in interface org.pipecraft.pipes.serialization.ItemEncoder
 
EncoderFactory<T> - Interface in org.pipecraft.pipes.serialization
Allows creating ItemEncoder instances of some specific type.
end(E) - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
 
end(E) - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
Indicates that an action has terminated.
end(E, long) - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
 
EnumEventStatsMap<T extends Enum<T>> - Class in org.pipecraft.infra.monitoring.collectors
An EventStatsMap based on an enum
EnumEventStatsMap(Class<T>) - Constructor for class org.pipecraft.infra.monitoring.collectors.EnumEventStatsMap
Constructor
equals(Object) - Method in class org.pipecraft.infra.net.HostPort
 
equals(Object) - Method in class org.pipecraft.infra.storage.StoragePath
 
equals(Object) - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
 
equals(Object) - Method in class org.pipecraft.pipes.utils.ShardSpecifier
 
error(PipeException) - Method in interface org.pipecraft.pipes.async.AsyncPipeListener
Notifies the listener that an error has been detected by the async pipe during item generation.
ERROR - org.pipecraft.pipes.async.AsyncPipe.Status
 
ErrorPipe<T> - Class in org.pipecraft.pipes.sync.source
A source pipe with no data in it, which only produces a predefined PipeException.
ErrorPipe(PipeException) - Constructor for class org.pipecraft.pipes.sync.source.ErrorPipe
Constructor
EventRateSlidingWindow - Class in org.pipecraft.infra.monitoring.sliding
A simple sliding window used for calculating events rate in a given time frame
EventRateSlidingWindow(int, int, TimeUnit, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
Constructor
EventsCollector<E extends Enum<E>> - Class in org.pipecraft.infra.monitoring.collectors
Counts events that fall into one of a predefined set of categories.
EventsCollector(Class<E>) - Constructor for class org.pipecraft.infra.monitoring.collectors.EventsCollector
Constructor
EventStatsMap<E> - Class in org.pipecraft.infra.monitoring.collectors
A mapping between event categories and their respective counts.
EventStatsMap(Map<E, Long>) - Constructor for class org.pipecraft.infra.monitoring.collectors.EventStatsMap
Constructor (protected)
ExactSamplerPipe<T> - Class in org.pipecraft.pipes.sync.inter.sample
A pipe sampling exactly m items of an input pipe containing n items, where n is known in advance.
ExactSamplerPipe(Pipe<T>, int, int) - Constructor for class org.pipecraft.pipes.sync.inter.sample.ExactSamplerPipe
Constructor
ExactSamplerPipe(Pipe<T>, int, int, Random) - Constructor for class org.pipecraft.pipes.sync.inter.sample.ExactSamplerPipe
Constructor
ExcessiveResourcesUsagePipeException - Exception in org.pipecraft.pipes.exceptions
A pipe exception due to resource usage beyond some threshold
ExcessiveResourcesUsagePipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.ExcessiveResourcesUsagePipeException
 
ExcessiveResourcesUsagePipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.ExcessiveResourcesUsagePipeException
 
ExcessiveResourcesUsagePipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.ExcessiveResourcesUsagePipeException
 
exists(String) - Method in class org.pipecraft.infra.storage.Bucket
 
exists(String) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 

F

FAIL - org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe.GroupSizeLimitPolicy
 
FailableBiConsumer<A,​B,​E extends Exception> - Interface in org.pipecraft.infra.concurrent
A bi-consumer that may fail with a checked exception during the execution of the accept(..) method.
FailableConsumer<T,​E extends Exception> - Interface in org.pipecraft.infra.concurrent
A consumer that may fail with a checked exception during the execution of the accept(..) method.
FailableFunction<T,​R,​E extends Exception> - Interface in org.pipecraft.infra.concurrent
A function that may fail with a checked exception during the execution of the apply(..) method.
FailableInterruptibleConsumer<T,​E extends Exception> - Interface in org.pipecraft.infra.concurrent
An interreuptible consumer that may also fail with a checked exception during the execution of the accept(..) method.
FailableInterruptibleRunnable<E extends Exception> - Interface in org.pipecraft.infra.concurrent
A runnable that is interruptible and may also fail with a checked exception during the execution of the run() method.
FailableInterruptibleSupplier<T,​E extends Exception> - Interface in org.pipecraft.infra.concurrent
A supplier that is interruptible and may also fail with a checked exception during the execution of the get() method.
FailablePredicate<T,​E extends Exception> - Interface in org.pipecraft.infra.concurrent
 
FailableRunnable<E extends Exception> - Interface in org.pipecraft.infra.concurrent
A runnable that may fail with a checked exception during the execution of the run() method.
FailableSupplier<T,​E extends Exception> - Interface in org.pipecraft.infra.concurrent
A supplier that may fail with a checked exception during the execution of the get() method.
FastRandom - Class in org.pipecraft.infra.math
A fast version of Random, which extends from it but eliminates thread safety.
FastRandom() - Constructor for class org.pipecraft.infra.math.FastRandom
Constructor Uses a seed derived from the clock
FastRandom(long) - Constructor for class org.pipecraft.infra.math.FastRandom
Constructor
fileOrder(Comparator<B>) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
fileOrder(Comparator<File>) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
FileReadOptions - Class in org.pipecraft.infra.io
Encapsulates file reading settings, with defaults.
FileReadOptions() - Constructor for class org.pipecraft.infra.io.FileReadOptions
 
FileUtils - Class in org.pipecraft.infra.io
A set of utility methods for manipulating files
FileUtils() - Constructor for class org.pipecraft.infra.io.FileUtils
 
FileWriteOptions - Class in org.pipecraft.infra.io
Encapsulates file writing settings, with defaults.
FileWriteOptions() - Constructor for class org.pipecraft.infra.io.FileWriteOptions
 
FilterBasePipe<T> - Class in org.pipecraft.pipes.sync.inter
A base-class pipe implementation for pipes that filter an input pipe using some criteria.
FilterBasePipe(Pipe<T>) - Constructor for class org.pipecraft.pipes.sync.inter.FilterBasePipe
Constructor
FilterPipe<T> - Class in org.pipecraft.pipes.sync.inter
A pipe filtering an input pipe by some predicate on the pipe items.
FilterPipe(Pipe<T>, Predicate<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.FilterPipe
Constructor
FlexibleMapPipe<S,​T> - Class in org.pipecraft.pipes.sync.inter
An intermediate pipe that maps an input item into zero or more items of another type.
FlexibleMapPipe(Pipe<S>, PipeFactory<S, ? extends T>) - Constructor for class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
Constructor
fromBiConsumer(BiConsumer<X, Y>) - Static method in interface org.pipecraft.infra.concurrent.FailableBiConsumer
Utility method for wrapping a bi-consumer with a failable bi-consumer
fromBytes(ByteBuffer) - Static method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Initialize from a serialized buffer.
fromConsumer(Consumer<T>) - Static method in interface org.pipecraft.infra.concurrent.FailableConsumer
Utility method for wrapping a consumer with a failable consumer
fromConsumer(Consumer<T>) - Static method in interface org.pipecraft.infra.concurrent.FailableInterruptibleConsumer
Utility method for wrapping a consumer with a failable consumer
fromHex(String) - Static method in class org.pipecraft.infra.io.Coding
convert hex to byte array
fromPipe(Pipe<T>) - Static method in class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
 
fromPipes(Collection<Pipe<T>>, int) - Static method in class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
 
fromPipes(List<Pipe<T>>) - Static method in class org.pipecraft.pipes.sync.inter.ConcatPipe
 
fromPipes(Pipe<T>...) - Static method in class org.pipecraft.pipes.sync.inter.ConcatPipe
 
fromSupplier(Supplier<T>) - Static method in interface org.pipecraft.infra.concurrent.FailableInterruptibleSupplier
Utility method for wrapping a supplier with a failable supplier
fromSupplier(Supplier<T>) - Static method in interface org.pipecraft.infra.concurrent.FailableSupplier
Utility method for wrapping a supplier with a failable supplier
FULL_INNER - org.pipecraft.pipes.sync.inter.join.JoinMode
 
FutureCompletionHandler<T> - Class in org.pipecraft.infra.concurrent
To be set as a listener on ListenableFutures.
FutureCompletionHandler(Consumer<? super T>, Consumer<Throwable>, Future<? extends T>) - Constructor for class org.pipecraft.infra.concurrent.FutureCompletionHandler
Protected constructor
FutureCompletionLogger - Class in org.pipecraft.infra.concurrent
To be set as a listener on ListenableFutures.
FutureCompletionLogger(Logger, Level, Level, String, Future<?>) - Constructor for class org.pipecraft.infra.concurrent.FutureCompletionLogger
Constructor

G

generateReadOnlyUrl(String, int) - Method in class org.pipecraft.infra.storage.Bucket
Generates a signed url for reading a specific file.
generateReadOnlyUrl(String, int) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
generateResumableSignedUrlForUpload(String, String, int) - Method in class org.pipecraft.infra.storage.Bucket
Generates a resumable signed url for a for uploading to a specific file for private access.
generateResumableSignedUrlForUpload(String, String, int, Long, boolean) - Method in class org.pipecraft.infra.storage.Bucket
Generates a resumable signed url for a for uploading to a specific file.
generateResumableSignedUrlForUpload(String, String, int, Long, boolean) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
generateSignedUrl(String, String, int) - Method in class org.pipecraft.infra.storage.Bucket
Generates a signed url for an upload on a specific file.
generateSignedUrl(String, String, int, boolean) - Method in class org.pipecraft.infra.storage.Bucket
Generates a signed url for an upload on a specific file.
generateSignedUrl(String, String, int, boolean) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
get() - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
 
get() - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
 
get() - Method in interface org.pipecraft.infra.concurrent.FailableInterruptibleSupplier
Gets a result.
get() - Method in interface org.pipecraft.infra.concurrent.FailableSupplier
Gets a result.
get() - Method in interface org.pipecraft.pipes.utils.PipeSupplier
 
get(long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
 
get(long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
 
get(File, File) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
get(String) - Method in class org.pipecraft.infra.monitoring.MonitoringTree
 
get(String, File) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a file given the remote file path
get(String, Set<String>) - Method in class org.pipecraft.infra.monitoring.MonitoringTree
 
get(SizedInputStream, M) - Method in interface org.pipecraft.pipes.utils.PipeReaderSupplier
 
get(P) - Method in interface org.pipecraft.pipes.utils.PipeFactory
 
get(T, File) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a file given the remote file's metadata object
getAggregationLogic() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
 
getAggregationLogic() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig
 
getAggregatorCreator() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
 
getAggregatorCreator() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig
 
getAll() - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
 
getAll() - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
 
getAll() - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
 
getAll() - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
 
getAll() - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
 
getAll() - Method in class org.pipecraft.infra.monitoring.MonitoringTree
 
getAllLocalFilesToRead(LocalMultiFileReaderConfig<T>) - Static method in class org.pipecraft.pipes.utils.multi.MultiFileReaderUtils
 
getAllRegularFiles(Collection<String>, File, Function<String, String>, int) - Method in class org.pipecraft.infra.storage.Bucket
downloads a set of regular files from different bucket locations.
getAllRegularFilesByMetaInterruptibly(Collection<T>, File, int) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a set of regular files from different bucket locations.
getAllRegularFilesByMetaInterruptibly(Collection<T>, File, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a set of regular files from different bucket locations.
getAllRegularFilesByMetaInterruptibly(Collection<T>, File, Function<String, String>, int) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a set of regular files from different bucket locations.
getAllRegularFilesByMetaInterruptibly(Collection<T>, File, Function<String, String>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a set of regular files from different bucket locations.
getAllRegularFilesInterruptibly(String, File, int) - Method in class org.pipecraft.infra.storage.Bucket
Downloads all regular files from a given folder, performing the task in parallel Uses retries on individual files, using default retry settings.
getAllRegularFilesInterruptibly(String, Predicate<T>, File, int) - Method in class org.pipecraft.infra.storage.Bucket
Downloads regular files from a given remote folder.
getAllRegularFilesInterruptibly(String, Predicate<T>, File, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Downloads regular files from a given remote folder.
getAllRegularFilesInterruptibly(Collection<String>, File, int) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a set of regular files from different bucket locations.
getAllRegularFilesInterruptibly(Collection<String>, File, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a set of regular files from different bucket locations.
getAllRegularFilesInterruptibly(Collection<String>, File, Function<String, String>, int) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a set of regular files from different bucket locations.
getAllRegularFilesInterruptibly(Collection<String>, File, Function<String, String>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a set of regular files from different bucket locations.
getAllRemoteFilesToRead(StorageMultiFileReaderConfig<T, B>) - Static method in class org.pipecraft.pipes.utils.multi.MultiFileReaderUtils
 
getAsJson(JsonMonitorable) - Static method in class org.pipecraft.infra.monitoring.MonitoringTree
 
getAsStream(File, int) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
getAsStream(String) - Method in class org.pipecraft.infra.storage.Bucket
Gets an input stream for a remote file, using the default chunk size.
getAsStream(String, int) - Method in class org.pipecraft.infra.storage.Bucket
Gets an input stream for a remote file, using a given chunk size.
getAsStream(T) - Method in class org.pipecraft.infra.storage.Bucket
Gets an input stream for a remote file, using the default chunk size.
getAsStream(T, int) - Method in class org.pipecraft.infra.storage.Bucket
Gets an input stream for a remote file, using a given chunk size.
getAverageProgress(Collection<? extends BasePipe>) - Static method in class org.pipecraft.pipes.utils.PipeUtils
 
getAvgActionDuration() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
 
getBigEndian16AsBytes(int) - Static method in class org.pipecraft.infra.io.Coding
 
getBigEndian32AsBytes(int) - Static method in class org.pipecraft.infra.io.Coding
 
getBigEndian64AsBytes(long) - Static method in class org.pipecraft.infra.io.Coding
 
getBucket() - Method in class org.pipecraft.infra.storage.StoragePath
 
getBucket() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
 
getBucket(String) - Method in class org.pipecraft.infra.storage.local.LocalDiskStorage
 
getBucket(String) - Method in interface org.pipecraft.infra.storage.Storage
 
getBucketName() - Method in class org.pipecraft.infra.storage.Bucket
 
getBucketNameFromFullyQualifiedPath(String) - Static method in class org.pipecraft.infra.storage.PathUtils
Gets a fully qualified path ({protocol}://{bucket}/{path}) and returns the bucket name.
getBufferSize() - Method in class org.pipecraft.infra.io.FileReadOptions
 
getBufferSize() - Method in class org.pipecraft.infra.io.FileWriteOptions
 
getByteArrayCodec() - Method in interface org.pipecraft.pipes.serialization.CodecFactory
 
getCapacity() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Gets the journal capacity.
getCategories() - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
 
getCategoryStats() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
 
getCategoryStats() - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
 
getChildren() - Method in class org.pipecraft.infra.io.Retrier
 
getChildren() - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
 
getChildren() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
 
getChildren() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
 
getChildren() - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
 
getChildren() - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
 
getChildren() - Method in interface org.pipecraft.infra.monitoring.JsonMonitorable
 
getChildren() - Method in class org.pipecraft.infra.monitoring.JsonMonitorableMerger
 
getChildren() - Method in class org.pipecraft.infra.monitoring.JsonMonitorableWrapper
 
getChildren() - Method in class org.pipecraft.infra.monitoring.MonitoringTree
 
getChildren() - Method in class org.pipecraft.infra.monitoring.sampling.BlockingSampler
 
getChildren() - Method in class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
 
getChildren() - Method in class org.pipecraft.infra.monitoring.SystemHealthMonitorable
 
getCodec() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
 
getColumnNames() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
 
getCompletedCount() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
 
getCompletedCount(E) - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
 
getCompletedCount(E) - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
 
getCompletedCount(E) - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
 
getCompression() - Method in class org.pipecraft.infra.io.FileReadOptions
 
getCompression() - Method in class org.pipecraft.infra.io.FileWriteOptions
 
getCompression() - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
The compression factor
getCompression() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
 
getCompression() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Get the compression factor.
getCompressionInflation() - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
The compression factor of each internal digest is equal to MultiQuantileDigest.compressionInflation * MultiQuantileDigest.compression
getCompressionInputStream(InputStream, Compression) - Static method in class org.pipecraft.infra.io.FileUtils
 
getCompressionLevel() - Method in class org.pipecraft.infra.io.FileWriteOptions
 
getCompressionOutputStream(OutputStream, Compression) - Static method in class org.pipecraft.infra.io.FileUtils
 
getCompressionOutputStream(OutputStream, Compression, int) - Static method in class org.pipecraft.infra.io.FileUtils
 
getConsistentBooleanByProbability(Object, float) - Static method in class org.pipecraft.infra.math.ArithmeticUtils
Get consistent boolean value (accepted/rejected) by a given probability.
getCount() - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
Returns the number of bytes read.
getCount(E) - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
 
getCount(E) - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
 
getCount(T) - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
 
getCurrentTimestamp() - Method in class org.pipecraft.infra.monitoring.graphite.GraphiteClient
 
getDefaultCompressionLevel() - Method in enum org.pipecraft.infra.io.Compression
 
getDiscriminator() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
 
getDiscriminator() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig
 
getDotlessExtension(String) - Static method in class org.pipecraft.infra.io.FileUtils
 
getExtension(String) - Static method in class org.pipecraft.infra.io.FileUtils
 
getFactory(Class<R>) - Static method in class org.pipecraft.pipes.serialization.AvroDecoder
 
getFactory(Class<R>) - Static method in class org.pipecraft.pipes.serialization.AvroEncoder
 
getFactory(Function<R, String[]>) - Static method in class org.pipecraft.pipes.serialization.CSVEncoder
 
getFactory(Function<R, String[]>, Charset, char, String) - Static method in class org.pipecraft.pipes.serialization.CSVEncoder
 
getFactory(FailableFunction<String[], R, ValidationPipeException>) - Static method in class org.pipecraft.pipes.serialization.CSVDecoder
 
getFactory(FailableFunction<String[], R, ValidationPipeException>, Charset, char, int) - Static method in class org.pipecraft.pipes.serialization.CSVDecoder
 
getFileExtension() - Method in enum org.pipecraft.infra.io.Compression
 
getFileFilter() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
 
getFileFilter() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
 
getFileOrder() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
 
getFileOrder() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
 
getFromJson(String, Class<C>) - Method in class org.pipecraft.infra.storage.Bucket
 
getFullMetrics() - Method in interface org.pipecraft.infra.monitoring.JsonMonitorable
 
getHost() - Method in class org.pipecraft.infra.net.HostPort
 
getHostPorts(String) - Static method in class org.pipecraft.infra.net.HostPort
 
getInputPipes() - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
 
getInputStream() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
 
getInputStream(File, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Creates an input stream that reads from a file, using the given FileReadOptions.
getInputStream(InputStream, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Wraps an input stream, adding the features defined by the given FileReadOptions.
getInputStreamFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
Return the input stream of the given resource path
getInputStreamSize() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
 
getInterruptibly(String, File) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a file with retries Uses default retry settings
getInterruptibly(String, File, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a file with retries
getInterruptibly(T, File) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a file with retries Uses default retry settings
getInterruptibly(T, File, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a file with retries
getInventory() - Method in class org.pipecraft.infra.monitoring.MonitoringTree
 
getInventory(JsonMonitorable) - Static method in class org.pipecraft.infra.monitoring.MonitoringTree
 
getItems() - Method in class org.pipecraft.pipes.terminal.AsyncCollectionWriterPipe
 
getItems() - Method in class org.pipecraft.pipes.terminal.CollectionWriterPipe
 
getItemsCount() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
 
getJournalingIntervalMillis() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Gets journaling interval.
getJSONFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
Utility for loading JSON objects from classpath files
getJSONFromFile(File) - Static method in class org.pipecraft.infra.io.FileUtils
 
getJSONFromInpuStream(InputStream) - Static method in class org.pipecraft.infra.io.FileUtils
 
getJSONListFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
Utility for loading a list of JSON objects from classpath files, assuming that every line has one JSON object.
getJSONListFromFile(File) - Static method in class org.pipecraft.infra.io.FileUtils
Utility for loading a list of JSON objects from a file, assuming that every line has one JSON object.
getKey() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
 
getKeyFromFullyQualifiedPath(String) - Static method in class org.pipecraft.infra.storage.PathUtils
Gets a fully qualified path ({protocol}://{bucket}/{path}) and returns the key.
getLastFile(String, Pattern) - Method in class org.pipecraft.infra.storage.Bucket
Returns the maximal (lexicographic ordering of the full path string) file in the path, filtering by given pattern.
getLastPathPart(String) - Static method in class org.pipecraft.infra.storage.PathUtils
Returns the last part of a given path.
getLastUpdated(File) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
getLastUpdated(T) - Method in class org.pipecraft.infra.storage.Bucket
 
getLeft() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
 
getLength(File) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
getLength(T) - Method in class org.pipecraft.infra.storage.Bucket
 
getLinesFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
Utility for loading the lines of a classpath file (UTF8).
getLinesFromFile(File) - Static method in class org.pipecraft.infra.io.FileUtils
Utility for loading the lines of a local text file (UTF8).
getLinesFromFile(File, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Utility for loading the lines of a local text file
getLinesFromFileAsSet(File) - Static method in class org.pipecraft.infra.io.FileUtils
Utility for loading the lines of a local text file (UTF8) into a set
getLinesFromFileAsSet(File, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Utility for loading the lines of a local text file into a set
getListFromReader(Reader) - Static method in class org.pipecraft.infra.io.FileUtils
Utility for loading the lines from a reader
getLittleEndian16AsBytes(int) - Static method in class org.pipecraft.infra.io.Coding
 
getLittleEndian32AsBytes(int) - Static method in class org.pipecraft.infra.io.Coding
 
getLittleEndian64AsBytes(long) - Static method in class org.pipecraft.infra.io.Coding
 
getMaxProgress(Collection<? extends BasePipe>) - Static method in class org.pipecraft.pipes.utils.PipeUtils
 
getMinProgress(Collection<? extends BasePipe>) - Static method in class org.pipecraft.pipes.utils.PipeUtils
 
getObjectMetadata(String) - Method in class org.pipecraft.infra.storage.Bucket
Supplies the metadata of a file, if it exists
getObjectMetadata(String) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
getObjectMetadata(Collection<String>) - Method in class org.pipecraft.infra.storage.Bucket
Supplies metadata objects for a given set of remote file paths.
getObjectMetadata(Collection<String>, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Supplies metadata objects for a given set of remote file paths.
getOrCreateBucket(String) - Method in class org.pipecraft.infra.storage.local.LocalDiskStorage
Creates the bucket if not exists already, and returns the object for manipulating it
getOriginPipe() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
 
getOutputStream(File, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Creates an output stream that writes into a file, using the given FileWriteOptions.
getOutputStream(OutputStream, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Wraps an output stream, adding it options by the given FileWriteOptions.
getOutputStream(String) - Method in class org.pipecraft.infra.storage.Bucket
Gets an output stream for writing to a remote file.
getOutputStream(String, int) - Method in class org.pipecraft.infra.storage.Bucket
Gets an output stream for writing to a remote file.
getOutputStream(String, int) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
getOwnMetrics() - Method in class org.pipecraft.infra.io.Retrier
 
getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
 
getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
 
getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
 
getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
 
getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
 
getOwnMetrics() - Method in interface org.pipecraft.infra.monitoring.JsonMonitorable
 
getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.JsonMonitorableMerger
 
getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.JsonMonitorableWrapper
 
getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.MonitoringTree
 
getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.sampling.BlockingSampler
 
getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
 
getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.SystemHealthMonitorable
 
getParentPath(String) - Static method in class org.pipecraft.infra.storage.PathUtils
 
getPath() - Method in class org.pipecraft.infra.storage.StoragePath
 
getPath(File) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
getPath(T) - Method in class org.pipecraft.infra.storage.Bucket
 
getPaths() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
 
getPaths() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
 
getPercentileValue() - Method in class org.pipecraft.pipes.terminal.PercentilePipe
 
getPipeSupplier() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
 
getPipeSupplier() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
 
getPort() - Method in class org.pipecraft.infra.net.HostPort
 
getPort() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
 
getPostProcessor() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
 
getPostProcessor() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig
 
getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncCallbackPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncCompoundPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncFilterPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncFlexibleMapPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncHeadPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncMapPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncProgressPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncTimeoutPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncUnionPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.source.AsyncEmptyPipe
 
getProgress() - Method in class org.pipecraft.pipes.async.source.AsyncSeqGenPipe
 
getProgress() - Method in interface org.pipecraft.pipes.BasePipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.ConcatPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.CountPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.HeadPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.MapPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.OrderValidationPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.ProgressPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.SkipPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.SortedIntersectionPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.SortedMergePipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.SortedSubtractionPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.SortedUnionPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.SortPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.inter.TopKPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.source.EmptyPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.source.ErrorPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.source.IteratorReaderPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.source.ReaderPipe
 
getProgress() - Method in class org.pipecraft.pipes.sync.source.SeqGenPipe
 
getProgress() - Method in class org.pipecraft.pipes.terminal.AsyncConsumerPipe
 
getProgress() - Method in class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
 
getProgress() - Method in class org.pipecraft.pipes.terminal.AsyncSharderPipe
 
getProgress() - Method in class org.pipecraft.pipes.terminal.CompoundTerminalPipe
 
getProgress() - Method in class org.pipecraft.pipes.terminal.ParallelConsumerPipe
 
getProgress() - Method in class org.pipecraft.pipes.terminal.QueueWriterPipe
 
getProgress() - Method in class org.pipecraft.pipes.terminal.TerminalPipe
 
getProtocol() - Method in class org.pipecraft.infra.storage.local.LocalDiskStorage
 
getProtocol() - Method in interface org.pipecraft.infra.storage.Storage
 
getProtocol() - Method in class org.pipecraft.infra.storage.StoragePath
 
getProtocolFromFullyQualifiedPath(String) - Static method in class org.pipecraft.infra.storage.PathUtils
Gets a fully qualified path ({protocol}://{bucket}/{path}) and returns the protocol name (e.g.
getReader(File) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered reader from a given file, using UTF8.
getReader(File, Charset) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered reader from a given file.
getReader(File, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered reader from a given file.
getReader(File, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered reader from a given file, using UTF8.
getReader(InputStream) - Static method in class org.pipecraft.infra.io.FileUtils
Wraps an input stream and converts it to a reader.
getReader(InputStream, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Wraps an input stream and converts it to a reader.
getReaderFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered reader from a given file, using UTF8.
getReaderFromClasspath(String, Charset) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered reader from a given file.
getReaderFromClasspath(String, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered reader from a given file.
getReaderFromClasspath(String, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered reader from a given file, using UTF8.
getRecord(int) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
 
getRight() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
 
getRunning() - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
 
getRunning() - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
 
getRunning() - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
 
getRunningCount() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
 
getRuntimeException() - Method in exception org.pipecraft.pipes.exceptions.InternalPipeException
 
getSetFromReader(Reader) - Static method in class org.pipecraft.infra.io.FileUtils
Utility for loading the lines from a reader, into a deduped set
getShardByHash(Object, int) - Static method in class org.pipecraft.infra.math.ArithmeticUtils
 
getShardByStrongHash(byte[], int) - Static method in class org.pipecraft.infra.math.ArithmeticUtils
Similar to getShardByHash, but uses 64 bit hash and a stronger hashing algorithm and to achieve better balancing of shards
getShardCount() - Method in class org.pipecraft.pipes.utils.ShardSpecifier
 
getShardFor(String) - Method in class org.pipecraft.infra.math.UUIDRangeSplitter
Finds the shard corresponding to a given UUID
getShardFunc() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
 
getShardIndex() - Method in class org.pipecraft.pipes.utils.ShardSpecifier
 
getShardSizes() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
 
getShardSizes() - Method in class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
 
getShardSizes() - Method in class org.pipecraft.pipes.terminal.AsyncSharderPipe
 
getShardSizes() - Method in class org.pipecraft.pipes.terminal.SharderByItemPipe
 
getShardSizes() - Method in class org.pipecraft.pipes.terminal.SharderBySeqPipe
 
getShardSpecifier() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
 
getShardSpecifier() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
 
getSingleLeft() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
Assumes that there's at most one matching item on left side.
getSingleRight() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
Assumes that there's only one right pipe and at most one matching item in it.
getSize() - Method in class org.pipecraft.infra.io.SizedInputStream
 
getSliced(String, File) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a file from cloud storage, using sliced download.
getSliced(String, File, int) - Method in class org.pipecraft.infra.storage.Bucket
Downloads a file from cloud storage, using sliced download.
getSlotsCount() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
 
getSlotTime() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
 
getSlotTimeUnit() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
 
getSnapshot() - Method in class org.pipecraft.infra.monitoring.sampling.BlockingSampler
 
getSnapshot() - Method in class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
 
getSnapshot() - Method in interface org.pipecraft.infra.monitoring.sampling.Sampler
 
getStats(E) - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
 
getStatus() - Method in class org.pipecraft.pipes.async.AsyncPipe
 
getStatusCode() - Method in exception org.pipecraft.pipes.exceptions.HttpPipeException
 
getStringFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
Utility for loading string from classpath files
getSystemDefaultTmpFolder() - Static method in class org.pipecraft.infra.io.FileUtils
 
getThreadNum() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
 
getThreadNum() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
 
getTmpFolder() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
 
getTotalCompletedCount() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
 
getTotalDurationMicros() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
 
getTotalDurationMicros(E) - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
 
getTotalDurationMicros(E) - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
 
getTotalDurationMicros(E) - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
 
getTotalSizeRecursive(File) - Static method in class org.pipecraft.infra.io.FileUtils
 
getUnionProbability(List<Double>) - Static method in class org.pipecraft.infra.math.ArithmeticUtils
Uses the inclusion-exclusion principle to calculate the probability of a union of independent events Ei, each having a probability Pi (P(E1-n) = P1 +P2 + Pn -P1P2 -P2P3 -P1P3 ...
getWindowTimeSpanMs() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
 
getWorkers() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
 
getWorkerShardId(List<HostPort>, int) - Static method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerPipe
Deprecated.
Use DistributedShufflerConfig.getWorkerShardId(..) instead
getWorkerShardId(HostPort) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
Utility function
getWriter(File) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered writer for a given file, using UTF8 and default file writing settings (See FileWriteOptions).
getWriter(File, Charset) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered writer for a given file, using default file writing settings (See FileWriteOptions).
getWriter(File, Charset, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered writer for a given file.
getWriter(File, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Creates a new buffered writer for a given file, using UTF8.
getWriter(OutputStream, Charset, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Wraps a gives output stream, setting the requires write options It's recommended to call this method from within a try-with-resources block.
GraphiteClient - Class in org.pipecraft.infra.monitoring.graphite
A simple graphite client that sends metrics to graphite server.
GraphiteClient(String, int, String) - Constructor for class org.pipecraft.infra.monitoring.graphite.GraphiteClient
C-tor
GraphiteException - Exception in org.pipecraft.infra.monitoring.graphite
Graphite exception
GraphiteException(String) - Constructor for exception org.pipecraft.infra.monitoring.graphite.GraphiteException
 
GraphiteException(String, Throwable) - Constructor for exception org.pipecraft.infra.monitoring.graphite.GraphiteException
 
GrouperPipe<T> - Class in org.pipecraft.pipes.sync.inter
Splits the input items into different families, and emits items from the same family sequentially.
GrouperPipe(Pipe<T>, FailableFunction<T, ?, PipeException>, CodecFactory<T>, int, File) - Constructor for class org.pipecraft.pipes.sync.inter.GrouperPipe
Constructor
gunzip(File) - Static method in class org.pipecraft.infra.io.FileUtils
Decompresses a given file (from gz), leaving the original
GZ_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
 
gzip(File) - Static method in class org.pipecraft.infra.io.FileUtils
Compresses a given file (to gz), leaving the original
GZIP - org.pipecraft.infra.io.Compression
 

H

hashCode() - Method in class org.pipecraft.infra.net.HostPort
 
hashCode() - Method in class org.pipecraft.infra.storage.StoragePath
 
hashCode() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
 
hashCode() - Method in class org.pipecraft.pipes.utils.ShardSpecifier
 
HashJoinPipe<K,​L,​R> - Class in org.pipecraft.pipes.sync.inter.join
A pipe performing a join operation between a 'left' pipe of type L, and a list of 'right' pipes of type R.
HashJoinPipe(List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>, int, CodecFactory<R>, File) - Constructor for class org.pipecraft.pipes.sync.inter.join.HashJoinPipe
Constructor A constructor for the case of no left pipe.
HashJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>, JoinMode, int, CodecFactory<L>, CodecFactory<R>, File) - Constructor for class org.pipecraft.pipes.sync.inter.join.HashJoinPipe
Constructor
HashJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, Pipe<R>, FailableFunction<R, K, PipeException>, JoinMode, int, CodecFactory<L>, CodecFactory<R>, File) - Constructor for class org.pipecraft.pipes.sync.inter.join.HashJoinPipe
Constructor To be used when there's a single right pipe.
HashReductorPipe<I,​O> - Class in org.pipecraft.pipes.sync.inter.reduct
Scans the input pipe and performs a reduction operation on families of items based on some discriminating property.
HashReductorPipe(Pipe<I>, CodecFactory<I>, int, File, ReductorConfig<I, ?, ?, O>) - Constructor for class org.pipecraft.pipes.sync.inter.reduct.HashReductorPipe
Constructor
HeadPipe<T> - Class in org.pipecraft.pipes.sync.inter
A pipe returning the first K items of its input pipe.
HeadPipe(Pipe<T>, int) - Constructor for class org.pipecraft.pipes.sync.inter.HeadPipe
Constructor
HostPort - Class in org.pipecraft.infra.net
A util class for representing network : Immutable.
HostPort(String) - Constructor for class org.pipecraft.infra.net.HostPort
CTOR.
HostPort(String, int) - Constructor for class org.pipecraft.infra.net.HostPort
Constructor.
HttpPipeException - Exception in org.pipecraft.pipes.exceptions
An IO pipe exception indicating an error reported by an HTTP server Includes the HTTP status code.
HttpPipeException(int) - Constructor for exception org.pipecraft.pipes.exceptions.HttpPipeException
 
HttpPipeException(int, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.HttpPipeException
 

I

identity() - Static method in interface org.pipecraft.infra.concurrent.FailableFunction
Similar to Function.identity(), but returns a FailableFunction
IllegalJsonException - Exception in org.pipecraft.infra.storage
A storage exception meaning that a remote json file has illegal structure and can't be deserialized properly.
IllegalJsonException(String) - Constructor for exception org.pipecraft.infra.storage.IllegalJsonException
 
IllegalJsonException(String, Throwable) - Constructor for exception org.pipecraft.infra.storage.IllegalJsonException
 
ImmediateFuture<V,​E extends Exception> - Class in org.pipecraft.infra.concurrent
A checked listenable future that returns a predefined value or throws a predifined exception.
InaccurateSampler<T> - Class in org.pipecraft.infra.monitoring.sampling
A utility for sampling of recent values, using a non-blocking approach for improved performance.
InaccurateSampler(int) - Constructor for class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
Constructor
InaccurateSampler(int, SampleTextualizer<T>) - Constructor for class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
Constructor
INNER - org.pipecraft.pipes.sync.inter.join.JoinMode
 
innerEnd(E, long) - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
The specific implementation of the "end" operation
innerEnd(E, long) - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
 
innerEnd(E, long) - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
 
innerStart() - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
The specific implementation of the "start" operation
innerStart() - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
 
innerStart() - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
 
InputStreamPipe<T> - Class in org.pipecraft.pipes.sync.source
A base class for source pipes based on some input stream.
InputStreamPipe(int, Compression) - Constructor for class org.pipecraft.pipes.sync.source.InputStreamPipe
Constructor
instance() - Static method in class org.pipecraft.pipes.sync.source.EmptyPipe
 
INT16_BE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
 
INT16_BE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
 
INT16_LE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
 
INT16_LE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
 
INT32_BE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
 
INT32_BE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
 
INT32_LE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
 
INT32_LE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
 
INT64_BE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
 
INT64_BE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
 
INT64_LE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
 
INT64_LE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
 
IntDecoders - Class in org.pipecraft.pipes.serialization
A collection of decoder factories for reading 16, 32 and 64 bit integers
IntDecoders() - Constructor for class org.pipecraft.pipes.serialization.IntDecoders
 
IntEncoders - Class in org.pipecraft.pipes.serialization
A collection of encoder factories for writing 16, 32 and 64 bit integers
IntEncoders() - Constructor for class org.pipecraft.pipes.serialization.IntEncoders
 
IntermediateBinFileWriterPipe<T> - Class in org.pipecraft.pipes.sync.inter
The intermediate version of BinFileWriterPipe.
IntermediateBinFileWriterPipe(Pipe<T>, File, FileWriteOptions, EncoderFactory<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateBinFileWriterPipe
Constructor
IntermediateBinFileWriterPipe(Pipe<T>, File, EncoderFactory<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateBinFileWriterPipe
Constructor Uses default file write settings (see @{FileWriteOptions})
IntermediateSharderBySeqPipe<T> - Class in org.pipecraft.pipes.sync.inter
An intermediate version of SharderBySeqPipe
IntermediateSharderBySeqPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
Constructor Uses default file write options
IntermediateSharderBySeqPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
Constructor
IntermediateTxtFileWriterPipe<T> - Class in org.pipecraft.pipes.sync.inter
A pipe write to a text file any item passed through it.
IntermediateTxtFileWriterPipe(Pipe<T>, File, Charset, FailableFunction<T, String, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
Constructor Uses default file write options.
IntermediateTxtFileWriterPipe(Pipe<T>, File, Charset, FileWriteOptions) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
Constructor Uses the toString as the mapper from the object to String
IntermediateTxtFileWriterPipe(Pipe<T>, File, Charset, FileWriteOptions, FailableFunction<T, String, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
Constructor
IntermediateTxtFileWriterPipe(Pipe<T>, File, FailableFunction<T, String, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
Constructor Uses default file write options and UTF8.
IntermediateTxtFileWriterPipe(Pipe<T>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
Constructor Uses default toString() as the string mapper, and UTF8
IntermediateTxtFileWriterPipe(Pipe<T>, File, FileWriteOptions, FailableFunction<T, String, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
Constructor Uses UTF8
InternalPipeException - Exception in org.pipecraft.pipes.exceptions
A pipe exception resulting from a runtime error.
InternalPipeException(RuntimeException) - Constructor for exception org.pipecraft.pipes.exceptions.InternalPipeException
 
InternalPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.InternalPipeException
 
IOPipeException - Exception in org.pipecraft.pipes.exceptions
A pipe exception resulting from an IO error
IOPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.IOPipeException
 
IOPipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.IOPipeException
 
IOPipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.IOPipeException
 
is - Variable in class org.pipecraft.pipes.serialization.AbstractInputStreamItemDecoder
 
isAppend() - Method in class org.pipecraft.infra.io.FileWriteOptions
 
isBalancedSharding() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
Relevant only when automatic sharding is enabled.
isBalancedSharding() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
Relevant only when automatic sharding is enabled.
isCancelled() - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
 
isCancelled() - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
 
isDone() - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
 
isDone() - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
 
isDownloadFirst() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
 
isFile(T) - Method in class org.pipecraft.infra.storage.Bucket
 
isFilePath(String) - Method in class org.pipecraft.infra.storage.Bucket
 
isFolderPath(String) - Method in class org.pipecraft.infra.storage.Bucket
 
isOwned(String, ShardSpecifier) - Static method in class org.pipecraft.pipes.utils.multi.MultiFileReaderUtils
 
isRecursivePaths() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
 
isRecursivePaths() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
 
isTemp() - Method in class org.pipecraft.infra.io.FileWriteOptions
 
ItemDecoder<T> - Interface in org.pipecraft.pipes.serialization
A functional interface for stateful decoders, decoding object from some binary source.
ItemEncoder<T> - Interface in org.pipecraft.pipes.serialization
A functional interface for stateful encoders, encoding object into some binary destination.
iterator() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
IteratorReaderPipe<T> - Class in org.pipecraft.pipes.sync.source
A pipe based on an iterator.
IteratorReaderPipe(Iterator<T>) - Constructor for class org.pipecraft.pipes.sync.source.IteratorReaderPipe
Constructor
IteratorReaderPipe(Iterator<T>, Integer) - Constructor for class org.pipecraft.pipes.sync.source.IteratorReaderPipe
Constructor

J

JdbcPipeException - Exception in org.pipecraft.pipes.exceptions
A pipe exception due to JDBC related errors
JdbcPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.JdbcPipeException
 
JdbcPipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.JdbcPipeException
 
JdbcPipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.JdbcPipeException
 
JdbcQueryResultsPipe<T> - Class in org.pipecraft.pipes.sync.source
A source pipe reading rows from a DB query result set, and converting them to some entity type
JdbcQueryResultsPipe(FailableSupplier<Connection, SQLException>, String, FailableFunction<ResultSet, T, SQLException>) - Constructor for class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
Constructor
JoinMode - Enum in org.pipecraft.pipes.sync.inter.join
The different join modes supported by join pipes In LEFT mode, all keys from the left pipe (and only them) will be included in the results.
joinPaths(String, String) - Static method in class org.pipecraft.infra.io.FileUtils
 
JoinRecord<K,​L,​R> - Class in org.pipecraft.pipes.sync.inter.join
An item returned by the SortedJoinPipe.
JsonMonitorable - Interface in org.pipecraft.infra.monitoring
To be implemented by classes that can "export" their state (or part of it) as Json.
JsonMonitorableMerger - Class in org.pipecraft.infra.monitoring
A simple JsonMonitorable implementation that joins a set of other JsonMonitorables.
JsonMonitorableMerger(JsonMonitorable...) - Constructor for class org.pipecraft.infra.monitoring.JsonMonitorableMerger
Constructor
JsonMonitorableWrapper - Class in org.pipecraft.infra.monitoring
A simple JsonMonitorable implementation that wraps a set of child monitorables and adds own metrics.
JsonMonitorableWrapper(Map<String, ? extends JsonMonitorable>) - Constructor for class org.pipecraft.infra.monitoring.JsonMonitorableWrapper
 
JsonMonitorableWrapper(JSONObject) - Constructor for class org.pipecraft.infra.monitoring.JsonMonitorableWrapper
 
JsonMonitorableWrapper(JSONObject, Map<String, ? extends JsonMonitorable>) - Constructor for class org.pipecraft.infra.monitoring.JsonMonitorableWrapper
 

L

LEFT - org.pipecraft.pipes.sync.inter.join.JoinMode
 
lineCount(File) - Static method in class org.pipecraft.infra.io.FileUtils
Counts lines in a file, which is assumed to be UTF8, not compressed.
lineCount(File, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
 
listenTo(ListenableFuture<T>, Consumer<? super T>, Consumer<Throwable>) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
Adds a completion listener to a given ListenableFuture.
listenTo(ListenableFuture<T>, Consumer<? super T>, Consumer<Throwable>, Executor) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
Adds a completion listener to a given ListenableFuture
listenTo(ListenableFuture<T>, Logger, Level, Level, String) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionLogger
Adds a logging listener (SLF4J) to a given ListenableFuture.
listenToError(ListenableFuture<?>, Consumer<Throwable>) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
Adds an error listener to a given ListenableFuture.
listenToError(ListenableFuture<?>, Consumer<Throwable>, Executor) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
Adds an error listener to a given ListenableFuture
listenToError(ListenableFuture<T>, Logger, Level, String) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionLogger
Adds a logging listener (SLF4J) on error events to a given ListenableFuture.
listenToSuccess(ListenableFuture<T>, Consumer<? super T>) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
Adds a successful completion listener to a given ListenableFuture.
listenToSuccess(ListenableFuture<T>, Consumer<? super T>, Executor) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
Adds a successful completion listener to a given ListenableFuture
listFiles(String) - Method in class org.pipecraft.infra.storage.Bucket
Lists all files directly under the given path (excluding folders)
listFiles(String, String) - Method in class org.pipecraft.infra.storage.Bucket
Lists all files directly under the given path that match the regular expression.
listFiles(String, Pattern) - Method in class org.pipecraft.infra.storage.Bucket
Lists all files that match the regex pattern and are located directly under the given path
listFilesRecursive(String) - Method in class org.pipecraft.infra.storage.Bucket
Returns an iterator for all the files in a given remote folder, recursively.
listFilesRecursive(String, String) - Method in class org.pipecraft.infra.storage.Bucket
Returns an iterator for all the files in a given remote folder matching the pattern, recursively.
listFilesRecursive(String, Pattern) - Method in class org.pipecraft.infra.storage.Bucket
Returns an iterator for all the files in a given remote folder matching a regex pattern, recursively.
listFolders(String) - Method in class org.pipecraft.infra.storage.Bucket
Lists all sub-folders in the given path
listObjects(String) - Method in class org.pipecraft.infra.storage.Bucket
 
listObjects(String, boolean) - Method in class org.pipecraft.infra.storage.Bucket
 
listObjects(String, boolean) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
listObjects(String, Predicate<T>) - Method in class org.pipecraft.infra.storage.Bucket
Creates an iterator of all objects directly under provided path that satisfy the provided condition
ListReductorPipe<S,​T> - Class in org.pipecraft.pipes.sync.inter.reduct
Scans the input pipe and groups sequential items based on some discriminating property.
ListReductorPipe(Pipe<S>, FailableFunction<S, ?, PipeException>, Function<List<S>, T>) - Constructor for class org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe
Constructor Creates a sequence reductor pipe with no protective threshold on group sizes.
ListReductorPipe(Pipe<S>, FailableFunction<S, ?, PipeException>, Function<List<S>, T>, int, ListReductorPipe.GroupSizeLimitPolicy) - Constructor for class org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe
Constructor
ListReductorPipe.GroupSizeLimitPolicy - Enum in org.pipecraft.pipes.sync.inter.reduct
 
LocalDiskBucket - Class in org.pipecraft.infra.storage.local
A bucket implementation pointing to a local disk folder.
LocalDiskStorage - Class in org.pipecraft.infra.storage.local
A storage implementation for working on local disk.
LocalDiskStorage(File) - Constructor for class org.pipecraft.infra.storage.local.LocalDiskStorage
Constructor
LocalMultiFileReaderConfig<T> - Class in org.pipecraft.pipes.utils.multi
A builder + configuration for pipes reading multiple local files.
LocalMultiFileReaderConfig.Builder<T> - Class in org.pipecraft.pipes.utils.multi
 
LockFreeBlockingQueue<E> - Class in org.pipecraft.infra.concurrent
A blocking queue implementation which wraps the efficient ConcurrentLinkedQueue, and adds adaptive yields/sleeps in order to achieve a blocking behavior without using locks.
LockFreeBlockingQueue(int) - Constructor for class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
Constructor
LookupJoinPipe<K,​L,​R> - Class in org.pipecraft.pipes.sync.inter.join
A pipe performing a join operation between a 'left' pipe of type L, and a list of 'right' pipes of type R.
LookupJoinPipe(List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
Constructor A constructor for the case of no left pipe.
LookupJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>, JoinMode) - Constructor for class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
Constructor
LookupJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, Pipe<R>, FailableFunction<R, K, PipeException>, JoinMode) - Constructor for class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
Constructor To be used when there's a single right pipe.
LZ4 - org.pipecraft.infra.io.Compression
 

M

map(Exception) - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
Maps a checked exception originating from the underlying computation into the standard exception type E.
map(Exception) - Method in class org.pipecraft.infra.concurrent.ImmediateFuture
 
MapPipe<S,​T> - Class in org.pipecraft.pipes.sync.inter
A pipe transforming each item in the input pipe into another, possibly with a different type.
MapPipe(Pipe<S>, FailableFunction<? super S, T, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.MapPipe
constructor
mark(int) - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
 
MonitoringTree - Class in org.pipecraft.infra.monitoring
A hierarchy of JsonMonitorable objects.
MonitoringTree() - Constructor for class org.pipecraft.infra.monitoring.MonitoringTree
 
moveFolderRecursive(String, String, int) - Method in class org.pipecraft.infra.storage.Bucket
Moves all files from one folder to another, recursively.
moveFolderRecursive(String, String, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Moves all files from one folder to another, recursively.
moveInterruptibly(String, String) - Method in class org.pipecraft.infra.storage.Bucket
Moves a file from one location to another, using retries with default settings.
moveInterruptibly(String, String, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Moves a file from one location to another, using retries.
MultiFileReaderPipe<T> - Class in org.pipecraft.pipes.sync.source
A source pipe reading multiple local binary files.
MultiFileReaderPipe(LocalMultiFileReaderConfig<T>) - Constructor for class org.pipecraft.pipes.sync.source.MultiFileReaderPipe
Constructor
MultiFileReaderUtils - Class in org.pipecraft.pipes.utils.multi
Shared helper methods for multi-file reader pipes.
MultiFileReaderUtils() - Constructor for class org.pipecraft.pipes.utils.multi.MultiFileReaderUtils
 
MultiQuantileDigest - Class in org.pipecraft.infra.monitoring.quantile
Thread Safe high-throughput quantile and cdf estimation.
MultiQuantileDigest(int) - Constructor for class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Constructor with default values
MultiQuantileDigest(int, double) - Constructor for class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Constructor with default values
MultiQuantileDigest(int, double, double) - Constructor for class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Fully specified constructor
MultiSortedBasePipe<T> - Class in org.pipecraft.pipes.sync.inter
A base class for pipes performing some set operation on a collection of sorted input pipes.
MultiSortedBasePipe(Comparator<? super T>, Pipe<T>...) - Constructor for class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
Constructor
MultiSortedBasePipe(List<? extends Pipe<T>>, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
Constructor
MultiTxtFileReaderPipe - Class in org.pipecraft.pipes.sync.source
Reads data from multiple files in local disk under some folder, as if they were concatenated using some predefined order.
MultiTxtFileReaderPipe(File) - Constructor for class org.pipecraft.pipes.sync.source.MultiTxtFileReaderPipe
Constructor Assumes UTF8, no file filtering, default buffer size and lexicographic order of files
MultiTxtFileReaderPipe(File, Charset, int, String, Comparator<File>) - Constructor for class org.pipecraft.pipes.sync.source.MultiTxtFileReaderPipe
Constructor
MultiTxtFileReaderPipe(File, Comparator<File>) - Constructor for class org.pipecraft.pipes.sync.source.MultiTxtFileReaderPipe
Constructor Assumes UTF8, no file filtering and default buffer size

N

NDJSON_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
 
negate() - Method in interface org.pipecraft.infra.concurrent.FailablePredicate
 
newByteArrayDecoder() - Method in interface org.pipecraft.pipes.serialization.DecoderFactory
 
newByteArrayDecoder() - Method in class org.pipecraft.pipes.serialization.SimpleDecoderFactory
 
newByteArrayDecoder() - Method in class org.pipecraft.pipes.serialization.TxtDecoderFactory
 
newByteArrayEncoder() - Method in interface org.pipecraft.pipes.serialization.EncoderFactory
 
newByteArrayEncoder() - Method in class org.pipecraft.pipes.serialization.SimpleEncoderFactory
 
newByteArrayEncoder() - Method in class org.pipecraft.pipes.serialization.TxtEncoderFactory
 
newDecoder(InputStream) - Method in interface org.pipecraft.pipes.serialization.DecoderFactory
 
newDecoder(InputStream, FileReadOptions) - Method in class org.pipecraft.pipes.serialization.AvroCodecFactory
 
newDecoder(InputStream, FileReadOptions) - Method in interface org.pipecraft.pipes.serialization.DecoderFactory
 
newDecoder(InputStream, FileReadOptions) - Method in class org.pipecraft.pipes.serialization.DelegatingCodecFactory
 
newDecoder(InputStream, FileReadOptions) - Method in class org.pipecraft.pipes.serialization.SimpleDecoderFactory
 
newDecoder(InputStream, FileReadOptions) - Method in class org.pipecraft.pipes.serialization.TxtDecoderFactory
 
newEncoder(OutputStream) - Method in interface org.pipecraft.pipes.serialization.EncoderFactory
 
newEncoder(OutputStream, FileWriteOptions) - Method in class org.pipecraft.pipes.serialization.AvroCodecFactory
 
newEncoder(OutputStream, FileWriteOptions) - Method in class org.pipecraft.pipes.serialization.DelegatingCodecFactory
 
newEncoder(OutputStream, FileWriteOptions) - Method in interface org.pipecraft.pipes.serialization.EncoderFactory
 
newEncoder(OutputStream, FileWriteOptions) - Method in class org.pipecraft.pipes.serialization.SimpleEncoderFactory
 
newEncoder(OutputStream, FileWriteOptions) - Method in class org.pipecraft.pipes.serialization.TxtEncoderFactory
 
newEvent(E) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
Reports a new event
newEvent(E, R) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
Reports a new event to be appended into a given time slot record
newEvent(Long, SlotRecord) - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
 
newEvent(Void, AtomicInteger) - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
 
newFixedRecSizeDecoder(InputStream, FileReadOptions, int) - Method in interface org.pipecraft.pipes.serialization.ByteArrayDecoder
Returns an efficient ItemDecoder based on this byte array decoder, assuming a fixed record size.
newRecord() - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
 
newRecord() - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
 
newRecord() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
 
newRecordArray(int) - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
 
newRecordArray(int) - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
 
newRecordArray(int) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
 
newValue(T) - Method in class org.pipecraft.infra.monitoring.sampling.BlockingSampler
Notifies about a new value
newValue(T) - Method in class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
 
newValue(T) - Method in interface org.pipecraft.infra.monitoring.sampling.Sampler
Notifies about a new value
next() - Method in class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.CallbackPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.ConcatPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.CountPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.HeadPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.IntermediateBinFileWriterPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.MapPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.OrderValidationPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.ProgressPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.SkipPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.SortedMergePipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.SortPipe
 
next() - Method in class org.pipecraft.pipes.sync.inter.TopKPipe
 
next() - Method in interface org.pipecraft.pipes.sync.Pipe
 
next() - Method in class org.pipecraft.pipes.sync.source.BinInputReaderPipe
 
next() - Method in class org.pipecraft.pipes.sync.source.EmptyPipe
 
next() - Method in class org.pipecraft.pipes.sync.source.ErrorPipe
 
next() - Method in class org.pipecraft.pipes.sync.source.IteratorReaderPipe
 
next() - Method in class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
 
next() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
 
next() - Method in class org.pipecraft.pipes.sync.source.ReaderPipe
 
next() - Method in class org.pipecraft.pipes.sync.source.SeqGenPipe
 
next() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
 
next() - Method in class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
 
next() - Method in class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
 
next(int) - Method in class org.pipecraft.infra.math.FastRandom
 
next(T) - Method in interface org.pipecraft.pipes.async.AsyncPipeListener
Notifies that a new item has been produced by the async pipe.
NonBlockingActionStatsCollector<E extends Enum<E>> - Class in org.pipecraft.infra.monitoring.collectors
A statistics collector which uses a non-blocking approach to improve performance.
NonBlockingActionStatsCollector(Class<E>) - Constructor for class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
Constructor
NONE - org.pipecraft.infra.io.Compression
 
normalizeFolderPath(String) - Method in class org.pipecraft.infra.storage.Bucket
appends to path "/" if not exist already
notifyDone() - Method in class org.pipecraft.pipes.async.AsyncPipe
Fires the event indicating a successful end of item generation
notifyError(PipeException) - Method in class org.pipecraft.pipes.async.AsyncPipe
Fires the event indicating a non-successful termination of the pipe's work
notifyNext(T) - Method in class org.pipecraft.pipes.async.AsyncPipe
Fires the event indicating a new item.

O

ofError(E) - Static method in class org.pipecraft.infra.concurrent.ImmediateFuture
 
offer(E) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
offer(E, long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
ofValue(V) - Static method in class org.pipecraft.infra.concurrent.ImmediateFuture
 
or(FailablePredicate<? super T, ? extends E>) - Method in interface org.pipecraft.infra.concurrent.FailablePredicate
Returns a composed predicate that represents a short-circuiting logical OR of this predicate and another.
OrderValidationPipe<T> - Class in org.pipecraft.pipes.sync.inter
An intermediate pipe that validates the order of the consumed elements by a comparator
OrderValidationPipe(Pipe<T>, Comparator<T>) - Constructor for class org.pipecraft.pipes.sync.inter.OrderValidationPipe
Constructor
org.pipecraft.infra.concurrent - package org.pipecraft.infra.concurrent
 
org.pipecraft.infra.io - package org.pipecraft.infra.io
 
org.pipecraft.infra.math - package org.pipecraft.infra.math
 
org.pipecraft.infra.monitoring - package org.pipecraft.infra.monitoring
 
org.pipecraft.infra.monitoring.collectors - package org.pipecraft.infra.monitoring.collectors
 
org.pipecraft.infra.monitoring.graphite - package org.pipecraft.infra.monitoring.graphite
 
org.pipecraft.infra.monitoring.quantile - package org.pipecraft.infra.monitoring.quantile
 
org.pipecraft.infra.monitoring.sampling - package org.pipecraft.infra.monitoring.sampling
 
org.pipecraft.infra.monitoring.sliding - package org.pipecraft.infra.monitoring.sliding
 
org.pipecraft.infra.net - package org.pipecraft.infra.net
 
org.pipecraft.infra.sets - package org.pipecraft.infra.sets
 
org.pipecraft.infra.storage - package org.pipecraft.infra.storage
 
org.pipecraft.infra.storage.local - package org.pipecraft.infra.storage.local
 
org.pipecraft.pipes - package org.pipecraft.pipes
 
org.pipecraft.pipes.async - package org.pipecraft.pipes.async
 
org.pipecraft.pipes.async.inter - package org.pipecraft.pipes.async.inter
 
org.pipecraft.pipes.async.inter.distributed - package org.pipecraft.pipes.async.inter.distributed
 
org.pipecraft.pipes.async.source - package org.pipecraft.pipes.async.source
 
org.pipecraft.pipes.exceptions - package org.pipecraft.pipes.exceptions
 
org.pipecraft.pipes.serialization - package org.pipecraft.pipes.serialization
 
org.pipecraft.pipes.sync - package org.pipecraft.pipes.sync
 
org.pipecraft.pipes.sync.inter - package org.pipecraft.pipes.sync.inter
 
org.pipecraft.pipes.sync.inter.join - package org.pipecraft.pipes.sync.inter.join
 
org.pipecraft.pipes.sync.inter.reduct - package org.pipecraft.pipes.sync.inter.reduct
 
org.pipecraft.pipes.sync.inter.sample - package org.pipecraft.pipes.sync.inter.sample
 
org.pipecraft.pipes.sync.source - package org.pipecraft.pipes.sync.source
 
org.pipecraft.pipes.terminal - package org.pipecraft.pipes.terminal
 
org.pipecraft.pipes.utils - package org.pipecraft.pipes.utils
 
org.pipecraft.pipes.utils.multi - package org.pipecraft.pipes.utils.multi
 
os - Variable in class org.pipecraft.pipes.serialization.AbstractOutputStreamItemEncoder
 
OUTER - org.pipecraft.pipes.sync.inter.join.JoinMode
 
OutOfOrderPipeException - Exception in org.pipecraft.pipes.exceptions
Indicates that the ordering of items in a pipe was not as expected
OutOfOrderPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.OutOfOrderPipeException
Constructor
OutOfOrderPipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.OutOfOrderPipeException
Constructor
OutOfOrderPipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.OutOfOrderPipeException
Constructor

P

ParallelConsumerPipe - Class in org.pipecraft.pipes.terminal
A terminal pipe that consumes multiple input pipes in a parallel manner, with a configurable number of threads.
ParallelConsumerPipe(int, Collection<? extends BasePipe>) - Constructor for class org.pipecraft.pipes.terminal.ParallelConsumerPipe
Constructor
ParallelConsumerPipe(int, Collection<? extends BasePipe>, Runnable) - Constructor for class org.pipecraft.pipes.terminal.ParallelConsumerPipe
Constructor
ParallelConsumerPipe(int, BasePipe...) - Constructor for class org.pipecraft.pipes.terminal.ParallelConsumerPipe
Constructor
ParallelTaskProcessor - Class in org.pipecraft.infra.concurrent
Processes a heavy task (typically with IO involved) in parallel.
ParallelTaskProcessor() - Constructor for class org.pipecraft.infra.concurrent.ParallelTaskProcessor
 
parseFullyQualifiedPath(String) - Static method in class org.pipecraft.infra.storage.PathUtils
Parses a fully qualified path and returns the protocol+bucket+key triplet.
paths(File...) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
paths(String) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
paths(String) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
paths(String...) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
paths(String...) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
paths(String, boolean) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
paths(String, boolean) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
paths(Collection<String>) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
paths(Collection<String>) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
paths(Collection<String>, boolean) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
paths(Collection<String>, boolean) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
PathUtils - Class in org.pipecraft.infra.storage
A set of utility methods for working with storage paths
PathUtils() - Constructor for class org.pipecraft.infra.storage.PathUtils
 
peek() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
peek() - Method in class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.CallbackPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.ConcatPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.CountPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.HeadPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.MapPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.OrderValidationPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.ProgressPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.SkipPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.SortedMergePipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.SortPipe
 
peek() - Method in class org.pipecraft.pipes.sync.inter.TopKPipe
 
peek() - Method in interface org.pipecraft.pipes.sync.Pipe
 
peek() - Method in class org.pipecraft.pipes.sync.source.BinInputReaderPipe
 
peek() - Method in class org.pipecraft.pipes.sync.source.EmptyPipe
 
peek() - Method in class org.pipecraft.pipes.sync.source.ErrorPipe
 
peek() - Method in class org.pipecraft.pipes.sync.source.IteratorReaderPipe
 
peek() - Method in class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
 
peek() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
 
peek() - Method in class org.pipecraft.pipes.sync.source.ReaderPipe
 
peek() - Method in class org.pipecraft.pipes.sync.source.SeqGenPipe
 
peek() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
 
peek() - Method in class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
 
peek() - Method in class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
 
PercentilePipe<T,​C extends Comparable<C>> - Class in org.pipecraft.pipes.terminal
A terminal pipe that finds a given percentile p in the input pipe.
PercentilePipe(Pipe<T>, double, Function<T, C>) - Constructor for class org.pipecraft.pipes.terminal.PercentilePipe
Constructor
Pipe<T> - Interface in org.pipecraft.pipes.sync
The interface to be implemented by synchronous pipes, which are passive and items are "pulled" from them.
PipeException - Exception in org.pipecraft.pipes.exceptions
Indicates an error during data fetching/processing/writing of a pipeline This is the surertype for all pipe exceptions.
PipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.PipeException
Constructor
PipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.PipeException
Constructor
PipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.PipeException
Constructor
PipeFactory<P,​T> - Interface in org.pipecraft.pipes.utils
An interface for pipe creation based on some parameter.
PipeReaderSupplier<T,​M> - Interface in org.pipecraft.pipes.utils
An interface for reader pipe creators.
PipeSupplier<T> - Interface in org.pipecraft.pipes.utils
An interface for pipe creators.
PipeUtils - Class in org.pipecraft.pipes.utils
A collection of pipe utility functions
PipeUtils() - Constructor for class org.pipecraft.pipes.utils.PipeUtils
 
poll() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
poll(long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
port(int) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
 
PortionSamplerPipe<T> - Class in org.pipecraft.pipes.sync.inter.sample
A pipe sampling about x% of the incoming items.
PortionSamplerPipe(Pipe<T>, double) - Constructor for class org.pipecraft.pipes.sync.inter.sample.PortionSamplerPipe
Constructor
PortionSamplerPipe(Pipe<T>, double, Random) - Constructor for class org.pipecraft.pipes.sync.inter.sample.PortionSamplerPipe
Constructor
postProcessor(Function<G, O>) - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
 
prepareNext() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
 
ProgressPipe<T> - Class in org.pipecraft.pipes.sync.inter
A no-op pipe with only one side effect - progress tracking.
ProgressPipe(Pipe<T>, int, Consumer<Integer>) - Constructor for class org.pipecraft.pipes.sync.inter.ProgressPipe
Constructor
ProgressTransformer - Class in org.pipecraft.pipes.utils
A progress listener wrapping another progress listener, allowing filtering of progress events and changing the reported progress range.
ProgressTransformer(Consumer<Integer>, int) - Constructor for class org.pipecraft.pipes.utils.ProgressTransformer
Constructor
ProgressTransformer(Consumer<Integer>, int, int) - Constructor for class org.pipecraft.pipes.utils.ProgressTransformer
Constructor
ProgressTransformer(Consumer<Integer>, int, int, int) - Constructor for class org.pipecraft.pipes.utils.ProgressTransformer
Constructor
publishToJournal() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Squash live digest(s) and add to journal as latest entry.
put(E) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
put(String, InputStream, long, String, boolean) - Method in class org.pipecraft.infra.storage.Bucket
Uploads data into a remote file from a given InputStream.
put(String, InputStream, long, String, boolean, boolean) - Method in class org.pipecraft.infra.storage.Bucket
Uploads data into a remote file from a given InputStream
put(String, InputStream, long, String, boolean, boolean) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
 
putAllInterruptibly(String, File, int, boolean) - Method in class org.pipecraft.infra.storage.Bucket
Uploads all regular files from a given folder.
putAllInterruptibly(String, File, int, boolean, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Uploads all regular files from a given folder.
putAllRecursiveInterruptibly(String, File, int, boolean) - Method in class org.pipecraft.infra.storage.Bucket
uploads a complete local folder to the cloud, recursively.
putAllRecursiveInterruptibly(String, File, int, boolean, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
uploads a complete local folder to the cloud, recursively.
putDoneFile(String) - Method in class org.pipecraft.infra.storage.Bucket
Put a _DONE file in a given cloud folder.
putEmptyFile(String) - Method in class org.pipecraft.infra.storage.Bucket
Writes an empty file to the given path, setting private access.
putFile(String, File, boolean) - Method in class org.pipecraft.infra.storage.Bucket
Uploads file to given path
putFileInterruptibly(String, File, boolean) - Method in class org.pipecraft.infra.storage.Bucket
Uploads file to given path, with retries.
putFileInterruptibly(String, File, boolean, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
Uploads file to given path, with retries
putLockFile(String) - Method in class org.pipecraft.infra.storage.Bucket
Writes a file in an exclusive manner, providing lock semantics.
putPrivate(String, File) - Method in class org.pipecraft.infra.storage.Bucket
Uploads file to given path and sets private read access
putPrivate(String, InputStream, long, String) - Method in class org.pipecraft.infra.storage.Bucket
Uploads file from InputStream and sets private read access
putPublic(String, File) - Method in class org.pipecraft.infra.storage.Bucket
Uploads file to given path and sets public read access
putPublic(String, InputStream, long, String) - Method in class org.pipecraft.infra.storage.Bucket
Uploads file from InputStream and sets public read access
putUniquePrivate(String, File) - Method in class org.pipecraft.infra.storage.Bucket
Uploads file, using an auto generated key, to given remote folder and sets private read access
putUniquePrivate(String, InputStream, long, String) - Method in class org.pipecraft.infra.storage.Bucket
Uploads file from InputStream to unique key under given path and sets private read access
putUniquePrivate(String, InputStream, String, long, String) - Method in class org.pipecraft.infra.storage.Bucket
Uploads a file from InputStream to a unique key under the given path and sets private read access.
putUniquePublic(String, File) - Method in class org.pipecraft.infra.storage.Bucket
Uploads file, using an auto generated key, to given remote folder and sets public read access
putUniquePublic(String, InputStream, long, String) - Method in class org.pipecraft.infra.storage.Bucket
Uploads file from InputStream to unique key under given path and sets public read access
putUniquePublic(String, InputStream, String, long, String) - Method in class org.pipecraft.infra.storage.Bucket
Uploads a file from InputStream to a unique key under the given path and sets public read access.

Q

quantile(double) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
Get an estimate of the quantile at q.
quantile(double) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Get an estimate of the quantile at q.
quantile(double) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Get an estimate of the quantile at q.
quantile(double) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Get an estimate of the quantile at q.
quantile(List<Double>) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
Get an estimated quantile for every value in the input list.
quantile(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Get an estimated quantile for every value in the input list.
quantile(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Get an estimated quantile for every value in the input list.
quantile(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Get an estimated quantile for every value in the input list.
QuantileDigest - Class in org.pipecraft.infra.monitoring.quantile
A synchronized wrapper for com.tdunning.math.stats.MergingDigest which is an implementation of t-digests.
QuantileDigest(double) - Constructor for class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Constructor
query() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
 
query(int) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
 
query(AtomicInteger[]) - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
 
query(TimeUnit) - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
 
query(SlotRecord[]) - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
 
query(R[]) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
 
QueuePipeException - Exception in org.pipecraft.pipes.exceptions
Indicates an error found during the pipeline while interacting with producer/consumer queues.
QueuePipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.QueuePipeException
 
QueuePipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.QueuePipeException
 
QueuePipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.QueuePipeException
 
QueueReaderPipe<T> - Class in org.pipecraft.pipes.sync.source
A source pipe reading the contents of a BlockingQueue.
QueueReaderPipe(BlockingQueue<T>, T, T) - Constructor for class org.pipecraft.pipes.sync.source.QueueReaderPipe
Constructor
QueueWriterPipe<T> - Class in org.pipecraft.pipes.terminal
A terminal pipe writing items to a BlockingQueue.
QueueWriterPipe(Pipe<T>, BlockingQueue<T>, T, T) - Constructor for class org.pipecraft.pipes.terminal.QueueWriterPipe
Constructor

R

read() - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
 
read(byte[], int, int) - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
 
read(InputStream) - Static method in class org.pipecraft.infra.io.Coding
Reads a single mandatory byte from a given stream
read(InputStream, byte[], int, int) - Static method in class org.pipecraft.infra.io.Coding
Reads a given number of bytes from the stream into a given buffer
read(InputStream, int) - Static method in class org.pipecraft.infra.io.Coding
Reads a given number of bytes from the stream into a new buffer
readBigEndian16(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
readBigEndian16(InputStream) - Static method in class org.pipecraft.infra.io.Coding
Reads a 16 bit int from the input stream.
readBigEndian32(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
readBigEndian32(InputStream) - Static method in class org.pipecraft.infra.io.Coding
Reads a 32 bit int from the input stream.
readBigEndian64(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
readBigEndian64(InputStream) - Static method in class org.pipecraft.infra.io.Coding
Reads a 64 bit int from the input stream.
readCSV(File) - Static method in class org.pipecraft.infra.io.FileUtils
Reads and parses a CSV file with no headers.
readCSV(File, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Reads and parses a CSV file with no headers.
readCSV(File, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Reads and parses a CSV file with no headers.
readCSV(Reader) - Static method in class org.pipecraft.infra.io.FileUtils
Reads and parses a CSV file with no headers.
ReaderPipe - Class in org.pipecraft.pipes.sync.source
A source pipe that reads lines from a given reader.
ReaderPipe(Reader) - Constructor for class org.pipecraft.pipes.sync.source.ReaderPipe
Constructor
ReaderPipe(Reader, int) - Constructor for class org.pipecraft.pipes.sync.source.ReaderPipe
Constructor
readLittleEndian16(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
readLittleEndian16(InputStream) - Static method in class org.pipecraft.infra.io.Coding
Reads a 16 bit int from the input stream.
readLittleEndian32(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
readLittleEndian32(InputStream) - Static method in class org.pipecraft.infra.io.Coding
Reads a 32 bit int from the input stream.
readLittleEndian64(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
readLittleEndian64(InputStream) - Static method in class org.pipecraft.infra.io.Coding
Reads a 64 bit int from the input stream.
readVarint32(byte[], MutableInt) - Static method in class org.pipecraft.infra.io.Coding
Reads a varint from a given byte array
readVarint32(InputStream, MutableInt) - Static method in class org.pipecraft.infra.io.Coding
Reads a varint from a given input stream.
ReductorConfig<I,​F,​G,​O> - Class in org.pipecraft.pipes.sync.inter.reduct
A configuration for a reduction operation.
ReductorConfig.Builder<I,​F,​G,​O> - Class in org.pipecraft.pipes.sync.inter.reduct
 
remainingCapacity() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
removeCSVExtension(String) - Static method in class org.pipecraft.infra.io.FileUtils
 
removeDotlessExtension(String) - Static method in class org.pipecraft.infra.io.FileUtils
 
removeExtension(String) - Static method in class org.pipecraft.infra.io.FileUtils
 
reset() - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
 
reset() - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Reset the digest.
reset() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Resets the digest to size zero and returns the final state prior to resetting.
reset(T) - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
Resets a counter.
resolveProgress(Pipe<?>, Collection<? extends Pipe<?>>) - Method in enum org.pipecraft.pipes.sync.inter.join.JoinMode
 
Retrier - Class in org.pipecraft.infra.io
Retrier(int, double, int) - Constructor for class org.pipecraft.infra.io.Retrier
Constructor
run() - Method in interface org.pipecraft.infra.concurrent.FailableInterruptibleRunnable
Runs the runnable's task
run() - Method in interface org.pipecraft.infra.concurrent.FailableRunnable
Runs the runnable's task
run() - Method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
 
run(Collection<T>, int, Consumer<? super T>) - Static method in class org.pipecraft.infra.concurrent.ParallelTaskProcessor
Processed the items in parallel by running a given processor on them.
run(ExecutorService, Collection<T>, Consumer<? super T>) - Static method in class org.pipecraft.infra.concurrent.ParallelTaskProcessor
Processed the items in parallel, by running a given processor on them, using the provided executor.
run(FailableInterruptibleRunnable<E>) - Method in class org.pipecraft.infra.io.Retrier
Runs the given task with the retry configuration as defined in the constructor, and using only RuntimeException and Error as early exit errors.
run(FailableInterruptibleRunnable<E>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the given retry configuration
run(FailableInterruptibleRunnable<E>, Collection<Class<? extends E>>) - Method in class org.pipecraft.infra.io.Retrier
Runs the given task with the retry configuration as defined in the constructor
run(FailableInterruptibleRunnable<E>, Collection<Class<? extends E>>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the given retry configuration
run(FailableInterruptibleRunnable<E>, Predicate<E>) - Method in class org.pipecraft.infra.io.Retrier
Runs the given task with the retry configuration as defined in the constructor
run(FailableInterruptibleRunnable<E>, Predicate<E>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the given retry configuration
run(FailableInterruptibleSupplier<T, E>) - Method in class org.pipecraft.infra.io.Retrier
Runs the given task with the retry configuration as defined in the constructor, and using only RuntimeException and Error as early exit errors.
run(FailableInterruptibleSupplier<T, E>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the given retry configuration
run(FailableInterruptibleSupplier<T, E>, Collection<Class<? extends E>>) - Method in class org.pipecraft.infra.io.Retrier
Runs the given task with the retry configuration as defined in the constructor
run(FailableInterruptibleSupplier<T, E>, Collection<Class<? extends E>>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the given retry configuration
run(FailableInterruptibleSupplier<T, E>, Predicate<E>) - Method in class org.pipecraft.infra.io.Retrier
Runs the given task with the retry configuration as defined in the constructor
run(FailableInterruptibleSupplier<T, E>, Predicate<E>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the given retry configuration
runFailable(Collection<T>, int, FailableInterruptibleConsumer<? super T, E>) - Static method in class org.pipecraft.infra.concurrent.ParallelTaskProcessor
Processed the items in parallel by running a given processor on them.
runFailable(ExecutorService, Collection<T>, FailableInterruptibleConsumer<? super T, E>) - Static method in class org.pipecraft.infra.concurrent.ParallelTaskProcessor
Processed the items in parallel, by running a given processor on them, using the provided executor.
runWithDefaults(FailableInterruptibleRunnable<E>) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the default retry configuration
runWithDefaults(FailableInterruptibleRunnable<E>, Collection<Class<? extends E>>) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the default retry configuration
runWithDefaults(FailableInterruptibleRunnable<E>, Predicate<E>) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the default retry configuration
runWithDefaults(FailableInterruptibleSupplier<T, E>) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the default retry configuration
runWithDefaults(FailableInterruptibleSupplier<T, E>, Collection<Class<? extends E>>) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the default retry configuration
runWithDefaults(FailableInterruptibleSupplier<T, E>, Predicate<E>) - Static method in class org.pipecraft.infra.io.Retrier
Runs the given task with the default retry configuration

S

sampleLines(File, int, File, int) - Static method in class org.pipecraft.infra.io.FileUtils
Uses a streaming sampling algorithm to select M lines from a given file, guaranteeing equal probability for all subsets of the requested sample size (See https://eyalsch.wordpress.com/2010/04/01/random-sample/ for details).
Sampler<T> - Interface in org.pipecraft.infra.monitoring.sampling
Allows sampling values from a stream
SampleTextualizer<T> - Interface in org.pipecraft.infra.monitoring.sampling
Converts sample items into a text representation
saveFileHead(File, int, File) - Static method in class org.pipecraft.infra.io.FileUtils
Saves the head of a given file in another new file/
schedule(int) - Method in class org.pipecraft.infra.math.StaticJobScheduler
Performs the job scheduling, returning the full assignment of jobs to workers.
sendMetric(String, Number) - Method in class org.pipecraft.infra.monitoring.graphite.GraphiteClient
Sends the metric to graphite, under environment root path, in the current timestamp.
sendMetric(String, Number, long) - Method in class org.pipecraft.infra.monitoring.graphite.GraphiteClient
Sends the metric to graphite, under environment root path, in the given timestamp.
sendMetrics(Map<String, ? extends Number>) - Method in class org.pipecraft.infra.monitoring.graphite.GraphiteClient
Sends the metrics to graphite, under environment root path, in the current timestamp.
sendMetrics(Map<String, ? extends Number>, long) - Method in class org.pipecraft.infra.monitoring.graphite.GraphiteClient
Sends the metric to graphite, under environment root path
SeqGenPipe<T> - Class in org.pipecraft.pipes.sync.source
A pipe based on a given sequence generator function.
SeqGenPipe(Function<Long, T>) - Constructor for class org.pipecraft.pipes.sync.source.SeqGenPipe
Constructor
SeqGenPipe(Function<Long, T>, long) - Constructor for class org.pipecraft.pipes.sync.source.SeqGenPipe
Constructor
SequenceReductorPipe<I,​O> - Class in org.pipecraft.pipes.sync.inter.reduct
Scans the input pipe and performs a reduction operation on a sequence of items with some discriminating property.
SequenceReductorPipe(Pipe<I>, ReductorConfig<I, ?, ?, O>) - Constructor for class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
Constructor
set(T) - Method in class org.pipecraft.infra.concurrent.SettableListenableFuture
 
setCategoryCounts(E, long) - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
Sets the count for a specific category.
setCategoryStats(E, long, long) - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
Sets the statistics for a specific category.
setCompression(Compression) - Method in class org.pipecraft.infra.io.FileReadOptions
Sets the compression of the file
setCompression(Compression) - Method in class org.pipecraft.infra.io.FileWriteOptions
Sets the compression of the file
setCompression(Compression, int) - Method in class org.pipecraft.infra.io.FileWriteOptions
Sets the compression of the file
setException(Throwable) - Method in class org.pipecraft.infra.concurrent.SettableListenableFuture
 
setListener(AsyncPipeListener<? super T>) - Method in class org.pipecraft.pipes.async.AsyncPipe
Sets the listener on produced items and other lifecycle events.
setRunningCount(int) - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
 
SettableListenableFuture<T> - Class in org.pipecraft.infra.concurrent
The future implementation to be used in cases where a class is responsible for setting the Future's outcome (value/exception), and the future should be a ListenableFuture.
SettableListenableFuture() - Constructor for class org.pipecraft.infra.concurrent.SettableListenableFuture
 
shard(ShardSpecifier) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
shard(ShardSpecifier) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
shard(ShardSpecifier, boolean) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
shard(ShardSpecifier, boolean) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
shardBy(Function<T, Object>) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
 
SharderByHashPipe<T> - Class in org.pipecraft.pipes.terminal
A terminal pipe that splits the contents of the input pipe into multiple files, according to a hash on a some feature of the item.
SharderByHashPipe(Pipe<T>, EncoderFactory<T>, FailableFunction<? super T, ?, PipeException>, int, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.SharderByHashPipe
Constructor
SharderByHashPipe(Pipe<T>, EncoderFactory<T>, FailableFunction<? super T, ?, PipeException>, Function<Integer, String>, int, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.SharderByHashPipe
Constructor
SharderByItemPipe<T> - Class in org.pipecraft.pipes.terminal
A terminal pipe that splits the contents of the input pipe into multiple files, according to some sharding criteria based on each item.
SharderByItemPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File) - Constructor for class org.pipecraft.pipes.terminal.SharderByItemPipe
Constructor
SharderByItemPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.SharderByItemPipe
Constructor
SharderBySeqPipe<T> - Class in org.pipecraft.pipes.terminal
A terminal pipe that splits the contents of the input pipe according to some criteria which breaks the input pipe into disjoint contiguous sequences.
SharderBySeqPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File) - Constructor for class org.pipecraft.pipes.terminal.SharderBySeqPipe
Constructor Uses default file write options
SharderBySeqPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.SharderBySeqPipe
Constructor
shardFunc(Function<T, Integer>) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
 
ShardSpecifier - Class in org.pipecraft.pipes.utils
Specifies a shard index and a total number of shards.
ShardSpecifier(int, int) - Constructor for class org.pipecraft.pipes.utils.ShardSpecifier
Constructor
shouldOutput(JoinRecord<?, ?, ?>, int) - Method in enum org.pipecraft.pipes.sync.inter.join.JoinMode
 
shouldOutput(T, BitSet) - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
The method to override for determining whether a visited value should be part of the output or not
shouldOutput(T, BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedIntersectionPipe
 
shouldOutput(T, BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedSubtractionPipe
 
shouldOutput(T, BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedUnionPipe
 
shouldSelect(T) - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
 
shouldSelect(T) - Method in class org.pipecraft.pipes.sync.inter.FilterPipe
 
shouldSelect(T) - Method in class org.pipecraft.pipes.sync.inter.sample.ExactSamplerPipe
 
shouldSelect(T) - Method in class org.pipecraft.pipes.sync.inter.sample.PortionSamplerPipe
 
shutdown() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
Terminates the sliding window.
SimpleDecoderFactory<T> - Class in org.pipecraft.pipes.serialization
A simple generic decoder factory implementation.
SimpleDecoderFactory(FailableFunction<InputStream, T, ? extends IOException>) - Constructor for class org.pipecraft.pipes.serialization.SimpleDecoderFactory
Constructor
SimpleDecoderFactory(FailableFunction<InputStream, T, ? extends IOException>, ByteArrayDecoder<T>) - Constructor for class org.pipecraft.pipes.serialization.SimpleDecoderFactory
Constructor
SimpleEncoderFactory<T> - Class in org.pipecraft.pipes.serialization
A simple generic encoder factory implementation.
SimpleEncoderFactory(FailableBiConsumer<T, OutputStream, ? extends IOException>) - Constructor for class org.pipecraft.pipes.serialization.SimpleEncoderFactory
Constructor
SimpleEncoderFactory(FailableBiConsumer<T, OutputStream, ? extends IOException>, ByteArrayEncoder<T>) - Constructor for class org.pipecraft.pipes.serialization.SimpleEncoderFactory
Constructor
SimpleSampleTextualizer<T> - Class in org.pipecraft.infra.monitoring.sampling
A sample textualizer that uses the items toString().
SimpleSampleTextualizer() - Constructor for class org.pipecraft.infra.monitoring.sampling.SimpleSampleTextualizer
 
size() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
size() - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
Returns the number of samples added to the current Estimator.
size() - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Returns the number of samples added to the current Estimator.
size() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Returns the number of samples added to the current Estimator.
size() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Returns the number of samples added to the current Estimator.
size() - Method in class org.pipecraft.infra.monitoring.sampling.BlockingSampler
 
size() - Method in class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
 
size() - Method in interface org.pipecraft.infra.monitoring.sampling.Sampler
 
SizedInputStream - Class in org.pipecraft.infra.io
A simple InputStream wrapper, that adds awareness to the stream size
SizedInputStream(InputStream, Long) - Constructor for class org.pipecraft.infra.io.SizedInputStream
Package protected constructor
skip(long) - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
 
SkipPipe<T> - Class in org.pipecraft.pipes.sync.inter
A pipe skipping the first K items of its input pipe.
SkipPipe(Pipe<T>, int) - Constructor for class org.pipecraft.pipes.sync.inter.SkipPipe
Constructor
SlidingWindow<E,​R,​Q> - Class in org.pipecraft.infra.monitoring.sliding
An abstract sliding window.
SlidingWindow(int, int, TimeUnit, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.sliding.SlidingWindow
Constructor
SlidingWindowQuantileDigest - Class in org.pipecraft.infra.monitoring.quantile
High throughput, thread safe, quantile and cdf estimation with a sliding window of time.
SlidingWindowQuantileDigest(int, double, double, int, int, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Fully specified constructor
SlidingWindowQuantileDigest(int, double, int, int, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Instantiate with default compressionInflation value
SlidingWindowQuantileDigest(int, int, int, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Instantiate with default compression and default compressionInflation values
sort(File, FilenameFilter, File, File, int) - Static method in class org.pipecraft.infra.io.FileUtils
Same as {@link this#sort(File, FilenameFilter, File, File, int)}, but enables to supply a FilenameFilter to exclude files from the provided directory from being sorted.
sort(File, File, File, int) - Static method in class org.pipecraft.infra.io.FileUtils
Serves for sorting large files on the file system, limiting the memory used in the process.
SortedIntersectionPipe<T> - Class in org.pipecraft.pipes.sync.inter
An intermediate pipe performing set intersection operation on a collection of sorted input pipes.
SortedIntersectionPipe(Comparator<? super T>, Pipe<T>...) - Constructor for class org.pipecraft.pipes.sync.inter.SortedIntersectionPipe
Constructor
SortedIntersectionPipe(List<? extends Pipe<T>>, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortedIntersectionPipe
Constructor
SortedJoinPipe<K,​L,​R> - Class in org.pipecraft.pipes.sync.inter.join
A pipe performing a join operation between a 'left' pipe of type L, and a list of 'right' pipes of type R.
SortedJoinPipe(List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>, Comparator<? super K>) - Constructor for class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
Constructor A constructor for the case of no left pipe.
SortedJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>, Comparator<? super K>, JoinMode) - Constructor for class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
Constructor
SortedJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, Pipe<R>, FailableFunction<R, K, PipeException>, Comparator<? super K>, JoinMode) - Constructor for class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
Constructor To be used when there's a single right pipe.
SortedMergePipe<T> - Class in org.pipecraft.pipes.sync.inter
An intermediate pipe sort-merging the contents of a collection of sorted input pipes.
SortedMergePipe(Comparator<? super T>, Pipe<T>...) - Constructor for class org.pipecraft.pipes.sync.inter.SortedMergePipe
Constructor
SortedMergePipe(List<? extends Pipe<T>>, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortedMergePipe
Constructor
SortedSubtractionPipe<T> - Class in org.pipecraft.pipes.sync.inter
An intermediate pipe performing a set subtraction operation on two given pipes (i.e.
SortedSubtractionPipe(Pipe<T>, Pipe<T>, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortedSubtractionPipe
Constructor
SortedUnionPipe<T> - Class in org.pipecraft.pipes.sync.inter
An intermediate pipe performing set union operation on a collection of sorted input pipes.
SortedUnionPipe(Comparator<? super T>, Pipe<T>...) - Constructor for class org.pipecraft.pipes.sync.inter.SortedUnionPipe
Constructor
SortedUnionPipe(List<? extends Pipe<T>>, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortedUnionPipe
Constructor
SortPipe<T> - Class in org.pipecraft.pipes.sync.inter
An intermediate pipe performing a sort on an input pipe, without deduping.
SortPipe(Pipe<T>, int, File, CodecFactory<T>, Comparator<T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortPipe
Constructor Uses compression on temp files.
SortPipe(Pipe<T>, int, File, EncoderFactory<? super T>, DecoderFactory<T>, Comparator<T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortPipe
Constructor Uses compression on temp files.
SortPipe(Pipe<T>, int, File, EncoderFactory<? super T>, DecoderFactory<T>, Comparator<T>, Compression) - Constructor for class org.pipecraft.pipes.sync.inter.SortPipe
Constructor
SortPipe(Pipe<T>, int, CodecFactory<T>, Comparator<T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortPipe
Constructor Uses compression on temp files, and uses system default temp folder
SortPipe(Pipe<T>, Comparator<T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortPipe
Constructor Use this constructor for disabling disk usage and sorting in-memory only.
start() - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
 
start() - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
Indicates that an action has started.
start() - Method in class org.pipecraft.pipes.async.inter.AsyncCallbackPipe
 
start() - Method in class org.pipecraft.pipes.async.inter.AsyncCompoundPipe
 
start() - Method in class org.pipecraft.pipes.async.inter.AsyncFilterPipe
 
start() - Method in class org.pipecraft.pipes.async.inter.AsyncFlexibleMapPipe
 
start() - Method in class org.pipecraft.pipes.async.inter.AsyncHeadPipe
 
start() - Method in class org.pipecraft.pipes.async.inter.AsyncMapPipe
 
start() - Method in class org.pipecraft.pipes.async.inter.AsyncProgressPipe
 
start() - Method in class org.pipecraft.pipes.async.inter.AsyncTimeoutPipe
 
start() - Method in class org.pipecraft.pipes.async.inter.AsyncUnionPipe
 
start() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerPipe
 
start() - Method in class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
 
start() - Method in class org.pipecraft.pipes.async.source.AsyncEmptyPipe
 
start() - Method in class org.pipecraft.pipes.async.source.AsyncSeqGenPipe
 
start() - Method in interface org.pipecraft.pipes.BasePipe
Performs pre-processing prior to item flow throw the pipe.
start() - Method in class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.ConcatPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.CountPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.HeadPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.IntermediateBinFileWriterPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.MapPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.OrderValidationPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.ProgressPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.SkipPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.SortedMergePipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.SortPipe
 
start() - Method in class org.pipecraft.pipes.sync.inter.TopKPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.BinInputReaderPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.EmptyPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.ErrorPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.IteratorReaderPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.ReaderPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.SeqGenPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
 
start() - Method in class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
 
start() - Method in class org.pipecraft.pipes.terminal.AsyncCollectionWriterPipe
 
start() - Method in class org.pipecraft.pipes.terminal.AsyncConsumerPipe
 
start() - Method in class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
 
start() - Method in class org.pipecraft.pipes.terminal.AsyncSharderPipe
 
start() - Method in class org.pipecraft.pipes.terminal.CollectionWriterPipe
 
start() - Method in class org.pipecraft.pipes.terminal.CompoundTerminalPipe
 
start() - Method in class org.pipecraft.pipes.terminal.ConsumerPipe
 
start() - Method in class org.pipecraft.pipes.terminal.ParallelConsumerPipe
 
start() - Method in class org.pipecraft.pipes.terminal.PercentilePipe
 
start() - Method in class org.pipecraft.pipes.terminal.QueueWriterPipe
 
start() - Method in class org.pipecraft.pipes.terminal.SharderByItemPipe
 
start() - Method in class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
 
start() - Method in class org.pipecraft.pipes.terminal.TxtFileWriterPipe
 
start() - Method in class org.pipecraft.pipes.terminal.WriterPipe
 
startAndEnd(E) - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
Indicates the starting and termination of an "instant" action (duration = 0)
startAndEnd(E) - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
 
startAndEnd(E) - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
 
StaticJobScheduler<J> - Class in org.pipecraft.infra.math
Schedules n "jobs" among m "workers", trying to minimize the makespan.
StaticJobScheduler(Collection<J>, Function<J, Double>) - Constructor for class org.pipecraft.infra.math.StaticJobScheduler
Constructor
Storage<S extends Bucket<T>,​T> - Interface in org.pipecraft.infra.storage
A parent interface for all remote/local storage implementations
StorageMultiFileReaderConfig<T,​B> - Class in org.pipecraft.pipes.utils.multi
A builder + configuration for pipes reading multiple remote files from storage.
StorageMultiFileReaderConfig.Builder<T,​B> - Class in org.pipecraft.pipes.utils.multi
 
StorageMultiFileReaderPipe<T,​B> - Class in org.pipecraft.pipes.sync.source
A source pipe reading multiple remote binary files from the cloud.
StorageMultiFileReaderPipe(StorageMultiFileReaderConfig<T, B>) - Constructor for class org.pipecraft.pipes.sync.source.StorageMultiFileReaderPipe
Constructor
StorageMultiTxtFileReaderPipe<B> - Class in org.pipecraft.pipes.sync.source
Reads data from multiple files in cloud storage under some folder, as if they were concatenated using some predefined order.
StorageMultiTxtFileReaderPipe(Storage<?, B>, String, String) - Constructor for class org.pipecraft.pipes.sync.source.StorageMultiTxtFileReaderPipe
Constructor Scans the remote files in lexicographic name order.
StorageMultiTxtFileReaderPipe(Storage<?, B>, String, String, Charset, int, String, Comparator<B>) - Constructor for class org.pipecraft.pipes.sync.source.StorageMultiTxtFileReaderPipe
Constructor
StorageMultiTxtFileReaderPipe(Storage<?, B>, String, String, Comparator<B>) - Constructor for class org.pipecraft.pipes.sync.source.StorageMultiTxtFileReaderPipe
Constructor Assumes UTF8 encoding of all files, and doesn't apply any filter on files to read from.
StoragePath - Class in org.pipecraft.infra.storage
A data class pointing to a specific protocol (e.g.
StoragePath(String, String, String) - Constructor for class org.pipecraft.infra.storage.StoragePath
Constructor
StorageTxtFileFetcherReaderPipe - Class in org.pipecraft.pipes.sync.source
A source pipe providing the lines of a text file from cloud storage.
StorageTxtFileFetcherReaderPipe(Storage<?, ?>, String, String, File) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
Constructor Uses the default read chunk size and default read options, and assumes UTF8
StorageTxtFileFetcherReaderPipe(Storage<?, ?>, String, String, Charset, int, FileReadOptions, File) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
Constructor
StorageTxtFileFetcherReaderPipe(Storage<?, ?>, String, String, Charset, File) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
Constructor Uses the default read chunk size and default read options
StorageTxtFileFetcherReaderPipe(Storage<?, ?>, String, String, FileReadOptions, File) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
Constructor Uses the default read chunk size and assumes UTF8
StorageTxtFileReaderPipe - Class in org.pipecraft.pipes.sync.source
A source pipe providing the lines of a text file in some Storage, in a streaming manner.
StorageTxtFileReaderPipe(Storage<?, ?>, String, String) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
Constructor Uses the default read chunk size and default read options, and assumes UTF8
StorageTxtFileReaderPipe(Storage<?, ?>, String, String, Charset) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
Constructor Uses the default read chunk size and default read options
StorageTxtFileReaderPipe(Storage<?, ?>, String, String, Charset, int, FileReadOptions) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
Constructor
StorageTxtFileReaderPipe(Storage<?, ?>, String, String, FileReadOptions) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
Constructor Uses the default read chunk size and assumes UTF8
StorageTxtFileWriterPipe - Class in org.pipecraft.pipes.terminal
A terminal pipe writing text lines from the input pipe into a remote cloud storage file.
StorageTxtFileWriterPipe(Pipe<String>, Storage<?, ?>, String, String) - Constructor for class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
Constructor Uses default write options and chunk size, and assumes UTF8
StorageTxtFileWriterPipe(Pipe<String>, Storage<?, ?>, String, String, Charset) - Constructor for class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
Constructor Uses the default write options and chunk size
StorageTxtFileWriterPipe(Pipe<String>, Storage<?, ?>, String, String, Charset, int, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
Constructor
StorageTxtFileWriterPipe(Pipe<String>, Storage<?, ?>, String, String, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
Constructor Uses default chunk size and UTF8
StreamSampler - Class in org.pipecraft.infra.sets
A random sampler on a stream of a known size.
StreamSampler(Random, int, int) - Constructor for class org.pipecraft.infra.sets.StreamSampler
Constructor
summarize() - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Merge internal digests into a single QuantileDigest.
summarize() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Get an aggregate view of the current state of this object as a QuantileDigest.
summarize(int) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Get an aggregate view of the current state of the lookback most recent journal entries as a QuantileDigest.
SyncToAsyncPipe<T> - Class in org.pipecraft.pipes.async.inter
A pipe converting multiple sync pipes into a single async one.
SyncToAsyncPipe(Collection<PipeSupplier<T>>, int) - Constructor for class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
Constructor
SystemHealthMonitorable - Class in org.pipecraft.infra.monitoring
A monitorable covering different JVM and runtime aspects TODO(Eyal): Consider implementing a generic JMXBean->JSON converter, so that any MXBean can be exposed as a JsonMonitorable easily.
SystemHealthMonitorable() - Constructor for class org.pipecraft.infra.monitoring.SystemHealthMonitorable
 

T

take() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
 
temp() - Method in class org.pipecraft.infra.io.FileWriteOptions
Sets the file to be temporary, meaning that it will be deleted once the JVM exits gracefully (by default it's false)
temp(boolean) - Method in class org.pipecraft.infra.io.FileWriteOptions
if true, sets compression the flag on file write options.
TerminalPipe - Class in org.pipecraft.pipes.terminal
Base class for terminal pipes, i.e.
TerminalPipe() - Constructor for class org.pipecraft.pipes.terminal.TerminalPipe
 
test(T) - Method in interface org.pipecraft.infra.concurrent.FailablePredicate
Evaluates this predicate on the given argument.
threadNum(int) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
 
threadNum(int) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
 
ThreadSafeCountingInputStream - Class in org.pipecraft.infra.io
Copied from Guava's CountingInputStream.
ThreadSafeCountingInputStream(InputStream) - Constructor for class org.pipecraft.infra.io.ThreadSafeCountingInputStream
Wraps another input stream, counting the number of bytes read.
ThrowableTextualizer - Class in org.pipecraft.infra.monitoring.sampling
A sample textualizer for throwable objects.
ThrowableTextualizer() - Constructor for class org.pipecraft.infra.monitoring.sampling.ThrowableTextualizer
 
TimeoutPipeException - Exception in org.pipecraft.pipes.exceptions
A pipe exception resulting from a timeout
TimeoutPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.TimeoutPipeException
 
TimeoutPipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.TimeoutPipeException
 
TimeoutPipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.TimeoutPipeException
 
toHex(byte[]) - Static method in class org.pipecraft.infra.io.Coding
convert byte array to hex
toJson() - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
 
TopKPipe<T> - Class in org.pipecraft.pipes.sync.inter
A pipe returning the top K items of the input pipe, according to some predefined order relation.
TopKPipe(Pipe<T>, int, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.TopKPipe
Constructor
toString() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
 
toString() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
 
toString() - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
 
toString() - Method in class org.pipecraft.infra.net.HostPort
 
toString() - Method in class org.pipecraft.infra.storage.StoragePath
 
toString() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
 
toString() - Method in class org.pipecraft.pipes.utils.ShardSpecifier
 
toText(Throwable) - Method in class org.pipecraft.infra.monitoring.sampling.ThrowableTextualizer
 
toText(T) - Method in interface org.pipecraft.infra.monitoring.sampling.SampleTextualizer
 
toText(T) - Method in class org.pipecraft.infra.monitoring.sampling.SimpleSampleTextualizer
 
TRUNCATE - org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe.GroupSizeLimitPolicy
 
tryAdd(double) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
Attempts to add an unweighted sample to this estimator.
tryAdd(double, int) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
Attempts to add a weighted sample to this estimator.
tryAdd(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
Attempts to add a weighted sample to this estimator.
tryAdd(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Attempts to add a weighted sample to this estimator.
tryAdd(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
Attempts to add a weighted sample to this estimator.
tryRead(InputStream, byte[], int, int) - Static method in class org.pipecraft.infra.io.Coding
Tries to read a given number of bytes from the stream into a given buffer.
TxtCodecFactory<T> - Class in org.pipecraft.pipes.serialization
A textual encoder-decoder
TxtCodecFactory(Function<T, String>, FailableFunction<String, T, ? extends ValidationPipeException>) - Constructor for class org.pipecraft.pipes.serialization.TxtCodecFactory
Constructor Assumes UTF8 in encoded form
TxtCodecFactory(Function<T, String>, FailableFunction<String, T, ? extends ValidationPipeException>, Charset) - Constructor for class org.pipecraft.pipes.serialization.TxtCodecFactory
Constructor
TxtDecoderFactory<T> - Class in org.pipecraft.pipes.serialization
An DecoderFactory that decodes items from a textual form, assuming that items are delimited by "\n".
TxtDecoderFactory(FailableFunction<String, T, ? extends ValidationPipeException>) - Constructor for class org.pipecraft.pipes.serialization.TxtDecoderFactory
Constructor Assumes UTF8 text encoding.
TxtDecoderFactory(FailableFunction<String, T, ? extends ValidationPipeException>, Charset) - Constructor for class org.pipecraft.pipes.serialization.TxtDecoderFactory
Constructor
TxtEncoderFactory<T> - Class in org.pipecraft.pipes.serialization
An EncoderFactory that encodes items as text, delimiting them by "\n".
TxtEncoderFactory() - Constructor for class org.pipecraft.pipes.serialization.TxtEncoderFactory
Constructor Assumes UTF8 text encoding and textualization based on the object's toString()
TxtEncoderFactory(Function<T, String>) - Constructor for class org.pipecraft.pipes.serialization.TxtEncoderFactory
Constructor Assumes UTF8 text encoding
TxtEncoderFactory(Function<T, String>, Charset) - Constructor for class org.pipecraft.pipes.serialization.TxtEncoderFactory
Constructor
TxtFileReaderPipe - Class in org.pipecraft.pipes.sync.source
A source pipe reading lines from a given local text file or input stream containing text content.
TxtFileReaderPipe(File) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
Constructor Detects the compression type by the filename extension
TxtFileReaderPipe(File, Charset) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
Constructor Detects the compression type by the filename extension
TxtFileReaderPipe(File, Charset, FileReadOptions) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
Constructor
TxtFileReaderPipe(File, FileReadOptions) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
Constructor
TxtFileReaderPipe(FailableInterruptibleSupplier<SizedInputStream, IOException>, Charset, int, Compression) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
Constructor
TxtFileReaderPipe(SizedInputStream, Charset, int, Compression) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
Constructor
TxtFileWriterPipe - Class in org.pipecraft.pipes.terminal
A terminal pipe writing text lines from the input pipe into a file.
TxtFileWriterPipe(Pipe<String>, File) - Constructor for class org.pipecraft.pipes.terminal.TxtFileWriterPipe
Constructor Uses default file write options and UTF8 charset encoding.
TxtFileWriterPipe(Pipe<String>, File, Charset) - Constructor for class org.pipecraft.pipes.terminal.TxtFileWriterPipe
Constructor Uses default file write options.
TxtFileWriterPipe(Pipe<String>, File, Charset, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.TxtFileWriterPipe
Constructor
TxtFileWriterPipe(Pipe<String>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.TxtFileWriterPipe
Constructor Uses UTF8 charset encoding.

U

UnboundedEventsCollector<T> - Class in org.pipecraft.infra.monitoring.collectors
Collects counts on an unbounded set of categories.
UnboundedEventsCollector() - Constructor for class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
 
UnboundedEventStatsMap<T> - Class in org.pipecraft.infra.monitoring.collectors
An EventStatsMap with no predefined set of possible categories.
UnboundedEventStatsMap() - Constructor for class org.pipecraft.infra.monitoring.collectors.UnboundedEventStatsMap
Constructor
URLTxtReaderPipe - Class in org.pipecraft.pipes.sync.source
A source pipe providing the lines of a text resource defined by a URL.
URLTxtReaderPipe(URL) - Constructor for class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
Constructor Uses defaults: UTF8 charset, no compression, and default timeouts.
URLTxtReaderPipe(URL, Charset, FileReadOptions, int, int) - Constructor for class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
Constructor
UTF8 - Static variable in class org.pipecraft.infra.io.FileUtils
 
UUIDRangeSplitter - Class in org.pipecraft.infra.math
Splits the UUID value range into K equal sized continuous shards, and returns the thresholds.
UUIDRangeSplitter(int) - Constructor for class org.pipecraft.infra.math.UUIDRangeSplitter
Constructor

V

validateFolderNotEmpty(File) - Static method in class org.pipecraft.infra.io.FileUtils
throws exception if folder is invalid or empty.
validateNotFolderPath(String) - Method in class org.pipecraft.infra.storage.Bucket
 
ValidationPipeException - Exception in org.pipecraft.pipes.exceptions
Indicates that the contents of a pipe were found to be invalid
ValidationPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.ValidationPipeException
Constructor
ValidationPipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.ValidationPipeException
Constructor
ValidationPipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.ValidationPipeException
Constructor
valueOf(String) - Static method in enum org.pipecraft.infra.io.Compression
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.pipecraft.pipes.async.AsyncPipe.Status
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.pipecraft.pipes.sync.inter.join.JoinMode
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe.GroupSizeLimitPolicy
Returns the enum constant of this type with the specified name.
values() - Static method in enum org.pipecraft.infra.io.Compression
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.pipecraft.pipes.async.AsyncPipe.Status
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.pipecraft.pipes.sync.inter.join.JoinMode
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe.GroupSizeLimitPolicy
Returns an array containing the constants of this enum type, in the order they are declared.

W

withExtension(String) - Method in enum org.pipecraft.infra.io.Compression
 
workers(Set<HostPort>) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
 
WORKING - org.pipecraft.pipes.async.AsyncPipe.Status
 
wrap(MergingDigest) - Static method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
Wrap a MergingDigest in order to make it thread safe.
writeBigEndian16(int, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
writeBigEndian16(int, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
Writes a 16 bit int into the output stream.
writeBigEndian32(int, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
writeBigEndian32(int, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
Writes a 32 bit int into the output stream.
writeBigEndian64(long, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
writeBigEndian64(long, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
Writes a 64 bit int into the output stream.
writeCSV(Collection<T>, File, Function<T, Object[]>) - Static method in class org.pipecraft.infra.io.FileUtils
Writes CSV file with no headers.
writeCSV(Collection<T>, File, Function<T, Object[]>, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Writes CSV file with no headers.
writeCSV(Iterator<T>, File, Function<T, Object[]>, FileWriteOptions, String...) - Static method in class org.pipecraft.infra.io.FileUtils
Writes items from iterator into the given csv file.
writeCSV(List<List<String>>, File) - Static method in class org.pipecraft.infra.io.FileUtils
Writes CSV file with no headers.
writeJSONListToFile(List<JSONObject>, File) - Static method in class org.pipecraft.infra.io.FileUtils
 
writeJSONToFile(JSONObject, File) - Static method in class org.pipecraft.infra.io.FileUtils
 
writeLines(Collection<String>, File) - Static method in class org.pipecraft.infra.io.FileUtils
Writes the given lines to a file, using default file write options
writeLines(Collection<String>, File, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
Writes the given lines to a file.
writeLittleEndian16(int, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
writeLittleEndian16(int, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
Writes a 16 bit int into the output stream.
writeLittleEndian32(int, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
writeLittleEndian32(int, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
Writes a 32 bit int into the output stream.
writeLittleEndian64(long, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 
writeLittleEndian64(long, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
Writes a 64 bit int into the output stream.
WriterPipe - Class in org.pipecraft.pipes.terminal
A terminal pipe writing textual items to a given Writer, one item per line.
WriterPipe(Pipe<String>, Writer) - Constructor for class org.pipecraft.pipes.terminal.WriterPipe
Constructor
WriterPipe(Pipe<String>, Writer, int) - Constructor for class org.pipecraft.pipes.terminal.WriterPipe
Constructor
writeVarint32(int, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
 

Z

ZSTD - org.pipecraft.infra.io.Compression
 
ZSTD_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
 
A B C D E F G H I J L M N O P Q R S T U V W Z 
All Classes All Packages