A B C D E F G H I J L M N O P Q R S T U V W Z
All Classes All Packages
All Classes All Packages
All Classes All Packages
A
- AbstractActionStatsCollector<E extends Enum<E>> - Class in org.pipecraft.infra.monitoring.collectors
-
A baseline for statistics collector implementations.
- AbstractActionStatsCollector(Class<E>) - Constructor for class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
-
Constructor
- AbstractCheckedFuture<V,E extends Exception> - Class in org.pipecraft.infra.concurrent
-
An abstract decorator on
ListenableFuturewhich adds checkedGet() methods which simplify Future's error handling. - AbstractCheckedFuture(ListenableFuture<V>) - Constructor for class org.pipecraft.infra.concurrent.AbstractCheckedFuture
-
Constructor
- AbstractInputStreamItemDecoder<T> - Class in org.pipecraft.pipes.serialization
-
A base class for item decoders whose pre-processing on the input streams consists only on buffering and decompression, providing the transformed input stream for the decode method to work on.
- AbstractInputStreamItemDecoder(InputStream, FileReadOptions) - Constructor for class org.pipecraft.pipes.serialization.AbstractInputStreamItemDecoder
-
Constructor
- AbstractOutputStreamItemEncoder<T> - Class in org.pipecraft.pipes.serialization
-
A base class for item encoders whose pre-processing on the output streams consists only on buffering and compression, providing the transformed output stream for the encode method to work on.
- AbstractOutputStreamItemEncoder(OutputStream, FileWriteOptions) - Constructor for class org.pipecraft.pipes.serialization.AbstractOutputStreamItemEncoder
-
Constructor
- accept() - Method in class org.pipecraft.infra.sets.StreamSampler
-
To be called per visited item.
- accept(A, B) - Method in interface org.pipecraft.infra.concurrent.FailableBiConsumer
-
Performs this operation on the given arguments.
- accept(Integer) - Method in class org.pipecraft.pipes.utils.ProgressTransformer
- accept(T) - Method in interface org.pipecraft.infra.concurrent.FailableConsumer
-
Performs this operation on the given argument.
- accept(T) - Method in interface org.pipecraft.infra.concurrent.FailableInterruptibleConsumer
-
Performs this operation on the given argument.
- ActionStats - Class in org.pipecraft.infra.monitoring.collectors
-
Simple action statistics bean referring to a specific action type.
- ActionStats(long, long) - Constructor for class org.pipecraft.infra.monitoring.collectors.ActionStats
-
Constructor
- ActionStatsCollector<E extends Enum<E>> - Interface in org.pipecraft.infra.monitoring.collectors
-
A common interface to all action statistics collectors.
- ActionStatsMap<E extends Enum<E>> - Class in org.pipecraft.infra.monitoring.collectors
-
A collection of simple statistics gathered on multiple categories.
- ActionStatsMap(Class<E>) - Constructor for class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
-
Constructor
- add(double) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
-
Add an unweighted sample to this estimator.
- add(double, int) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
-
Add a weighted sample.
- add(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Add a weighted sample.
- add(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Adds a weighted sample to the digest.
- add(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Add a weighted sample.
- add(List<QuantileDigest>) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Merge a list of
QuantileDigestinto this digest. - add(EventStatsMap<E>) - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
-
Adds the counts from the other collector.
- add(QuantileDigest) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Merge another
QuantileDigestinto this digest. - addListener(Runnable, Executor) - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
- addListener(Runnable, Executor) - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
- addRoot(String, JsonMonitorable) - Method in class org.pipecraft.infra.monitoring.MonitoringTree
-
Registers a new top level monitored entity.
- aggregationLogic(FailableBiConsumer<G, I, PipeException>) - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
- aggregatorCreator(Function<F, G>) - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
- ALL - Static variable in class org.pipecraft.pipes.utils.ShardSpecifier
- and(FailablePredicate<? super T, ? extends E>) - Method in interface org.pipecraft.infra.concurrent.FailablePredicate
-
Returns a composed predicate that represents a short-circuiting logical AND of this predicate and another.
- andFilter(String) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- andFilter(String) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- andFilter(Predicate<B>) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- andFilter(Predicate<File>) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- andPathFilter(Predicate<String>) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- andThen(FailableBiConsumer<? super A, ? super B, ? extends E>) - Method in interface org.pipecraft.infra.concurrent.FailableBiConsumer
-
Similar to andThen method of
Consumer - andThen(FailableConsumer<? super T, ? extends E>) - Method in interface org.pipecraft.infra.concurrent.FailableConsumer
-
Similar to andThen method of
Consumer - andThen(FailableFunction<? super R, ? extends V, E>) - Method in interface org.pipecraft.infra.concurrent.FailableFunction
-
Similar to Function.andThen(..), but works with
FailableFunction - andThen(FailableInterruptibleConsumer<? super T, ? extends E>) - Method in interface org.pipecraft.infra.concurrent.FailableInterruptibleConsumer
-
Similar to andThen method of
Consumer - append() - Method in class org.pipecraft.infra.io.FileWriteOptions
-
Sets the append flag (by default it's false)
- apply(T) - Method in interface org.pipecraft.infra.concurrent.FailableFunction
-
Applies the function
- areIdentical(File, File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Compares two given files
- ArithmeticUtils - Class in org.pipecraft.infra.math
-
Arithmetics and math utilities
- asReadOnlyBuffer() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Serialize this object to a read-only
ByteBuffer. - AsyncCallbackPipe<T> - Class in org.pipecraft.pipes.async.inter
-
A no-op async pipe that "spies" on data passing through it.
- AsyncCallbackPipe(AsyncPipe<T>, FailableConsumer<? super T, ? extends PipeException>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncCallbackPipe
-
Constructor
- AsyncCollectionWriterPipe<T> - Class in org.pipecraft.pipes.terminal
-
A terminal async pipe writing all contents from an input pipe into a given collection.
- AsyncCollectionWriterPipe(AsyncPipe<T>) - Constructor for class org.pipecraft.pipes.terminal.AsyncCollectionWriterPipe
-
Constructor Collects items into a thread safe
Listcreated internally. - AsyncCollectionWriterPipe(AsyncPipe<T>, Collection<T>) - Constructor for class org.pipecraft.pipes.terminal.AsyncCollectionWriterPipe
-
Constructor
- AsyncCompoundPipe<T> - Class in org.pipecraft.pipes.async.inter
-
A pipe encapsulating a pipeline.
- AsyncCompoundPipe() - Constructor for class org.pipecraft.pipes.async.inter.AsyncCompoundPipe
- AsyncConsumerPipe<T> - Class in org.pipecraft.pipes.terminal
-
Consumes the contents of an
AsyncPipe, blocking in the start() method until all data is read. - AsyncConsumerPipe(AsyncPipe<T>) - Constructor for class org.pipecraft.pipes.terminal.AsyncConsumerPipe
-
Constructor
- AsyncConsumerPipe(AsyncPipe<T>, FailableConsumer<? super T, PipeException>) - Constructor for class org.pipecraft.pipes.terminal.AsyncConsumerPipe
-
Constructor
- AsyncConsumerPipe(AsyncPipe<T>, FailableConsumer<? super T, PipeException>, Runnable) - Constructor for class org.pipecraft.pipes.terminal.AsyncConsumerPipe
-
Constructor
- AsyncEmptyPipe<T> - Class in org.pipecraft.pipes.async.source
-
An async source pipe returning no data.
- AsyncEmptyPipe() - Constructor for class org.pipecraft.pipes.async.source.AsyncEmptyPipe
- AsyncEnqueuingSharderPipe<T> - Class in org.pipecraft.pipes.terminal
-
A terminal pipe that receives an async pipe as input, and shards the contents of the input pipe into multiple queues according to some sharding criteria based on item values.
- AsyncEnqueuingSharderPipe(AsyncPipe<T>, List<? extends BlockingQueue<T>>, Function<? super T, Integer>, T, T) - Constructor for class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
-
Constructor
- AsyncEnqueuingSharderPipe(AsyncPipe<T>, List<? extends BlockingQueue<T>>, T, T) - Constructor for class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
-
Constructor Uses hash based sharding into queues
- AsyncFilterPipe<T> - Class in org.pipecraft.pipes.async.inter
-
An async version of the filter pipe (See
FilterPipe. - AsyncFilterPipe(AsyncPipe<T>, Predicate<? super T>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncFilterPipe
-
constructor
- AsyncFlexibleMapPipe<S,T> - Class in org.pipecraft.pipes.async.inter
-
An async version of the flexible mapper pipe (See
FlexibleMapPipe. - AsyncFlexibleMapPipe(AsyncPipe<S>, PipeFactory<S, ? extends T>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncFlexibleMapPipe
-
constructor
- AsyncHeadPipe<T> - Class in org.pipecraft.pipes.async.inter
-
An async version of the head pipe (See
HeadPipe. - AsyncHeadPipe(AsyncPipe<T>, int) - Constructor for class org.pipecraft.pipes.async.inter.AsyncHeadPipe
-
constructor
- AsyncMapPipe<S,T> - Class in org.pipecraft.pipes.async.inter
-
An async version of the mapper pipe (See
MapPipe. - AsyncMapPipe(AsyncPipe<S>, FailableFunction<? super S, T, PipeException>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncMapPipe
-
constructor
- AsyncMultiFileReaderPipe<T> - Class in org.pipecraft.pipes.async.source
-
An async source pipe reading multiple local binary files.
- AsyncMultiFileReaderPipe(LocalMultiFileReaderConfig<T>) - Constructor for class org.pipecraft.pipes.async.source.AsyncMultiFileReaderPipe
-
Constructor
- AsyncPipe<T> - Class in org.pipecraft.pipes.async
-
A pipe that produces items asynchronously.
- AsyncPipe() - Constructor for class org.pipecraft.pipes.async.AsyncPipe
- AsyncPipe.Status - Enum in org.pipecraft.pipes.async
- AsyncPipeListener<T> - Interface in org.pipecraft.pipes.async
-
A listener to be attached to
AsyncPipes. - AsyncProgressPipe<T> - Class in org.pipecraft.pipes.async.inter
-
A no-op async pipe that reports progress.
- AsyncProgressPipe(AsyncPipe<T>, int, Consumer<Integer>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncProgressPipe
-
Constructor
- AsyncSeqGenPipe<T> - Class in org.pipecraft.pipes.async.source
-
An async source pipe, producing a fixed number of items using a fixed number of threads.
- AsyncSeqGenPipe(long, Function<Long, T>, int) - Constructor for class org.pipecraft.pipes.async.source.AsyncSeqGenPipe
-
Constructor
- AsyncSharderByHashPipe<T> - Class in org.pipecraft.pipes.terminal
-
An async sharder pipe, writing items to files based on the hash value of individual items.
- AsyncSharderByHashPipe(AsyncPipe<T>, EncoderFactory<? super T>, int, File) - Constructor for class org.pipecraft.pipes.terminal.AsyncSharderByHashPipe
-
Constructor Uses default file write options.
- AsyncSharderByHashPipe(AsyncPipe<T>, EncoderFactory<? super T>, int, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.AsyncSharderByHashPipe
-
Constructor
- AsyncSharderPipe<T> - Class in org.pipecraft.pipes.terminal
-
A terminal pipe that receives an async pipe as input, and splits the contents of the input pipe into multiple files according to some sharding criteria based on individual items.
- AsyncSharderPipe(AsyncPipe<T>, EncoderFactory<? super T>, Function<? super T, String>, File) - Constructor for class org.pipecraft.pipes.terminal.AsyncSharderPipe
-
Constructor Uses default file write options
- AsyncSharderPipe(AsyncPipe<T>, EncoderFactory<? super T>, Function<? super T, String>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.AsyncSharderPipe
-
Constructor
- asyncStart() - Method in class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
-
A special async version of the standard start() method.
- AsyncStorageMultiFileReaderPipe<T,B> - Class in org.pipecraft.pipes.async.source
-
An async source pipe reading multiple remote binary files from the cloud.
- AsyncStorageMultiFileReaderPipe(StorageMultiFileReaderConfig<T, B>) - Constructor for class org.pipecraft.pipes.async.source.AsyncStorageMultiFileReaderPipe
-
Constructor
- AsyncTimeoutPipe<T> - Class in org.pipecraft.pipes.async.inter
-
An async pipe enforcing a timeout on completion of its async input pipe.
- AsyncTimeoutPipe(AsyncPipe<T>, Duration, ScheduledExecutorService) - Constructor for class org.pipecraft.pipes.async.inter.AsyncTimeoutPipe
-
constructor
- AsyncToSyncPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A pipe which acts as a converter from async pipe/s to a sync pipe.
- AsyncToSyncPipe(AsyncPipe<T>, int, Supplier<T>) - Constructor for class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
-
Constructor Uses a LinkedBlockingQueue with the given capacity
- AsyncToSyncPipe(AsyncPipe<T>, BlockingQueue<T>, Supplier<T>) - Constructor for class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
-
Constructor
- AsyncUnionPipe<T> - Class in org.pipecraft.pipes.async.inter
-
An intermediate async pipe fed by a set of other async pipes.
- AsyncUnionPipe(Collection<AsyncPipe<T>>) - Constructor for class org.pipecraft.pipes.async.inter.AsyncUnionPipe
-
Constructor
- AverageSlidingWindow - Class in org.pipecraft.infra.monitoring.sliding
-
A sliding window used for calculating the average of a stream of numbers, in a given time frame
- AverageSlidingWindow(int, int, TimeUnit, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
-
Constructor
- AvroCodecFactory<T> - Class in org.pipecraft.pipes.serialization
-
A codec factory for AVRO format.
- AvroCodecFactory(Class<T>) - Constructor for class org.pipecraft.pipes.serialization.AvroCodecFactory
-
Constructor
- AvroDecoder<T> - Class in org.pipecraft.pipes.serialization
-
An
ItemDecoderthat decodes objects encoded in avro format. - AvroDecoder(Class<T>, InputStream) - Constructor for class org.pipecraft.pipes.serialization.AvroDecoder
-
Constructor.
- AvroEncoder<T> - Class in org.pipecraft.pipes.serialization
-
An
ItemEncoderthat encode any java class to bytes using avro. - AvroEncoder(Class<T>, OutputStream) - Constructor for class org.pipecraft.pipes.serialization.AvroEncoder
-
Constructor
B
- BasePipe - Interface in org.pipecraft.pipes
-
A base interface containing minimal API for sync, async and terminal pipes
- BinFileWriterPipe<T> - Class in org.pipecraft.pipes.terminal
-
A terminal pipe writing items to a local file in a binary format.
- BinFileWriterPipe(Pipe<T>, File, FileWriteOptions, EncoderFactory<? super T>) - Constructor for class org.pipecraft.pipes.terminal.BinFileWriterPipe
-
Constructor
- BinFileWriterPipe(Pipe<T>, File, EncoderFactory<? super T>) - Constructor for class org.pipecraft.pipes.terminal.BinFileWriterPipe
-
Constructor Uses default file write settings (see @{FileWriteOptions})
- BinInputReaderPipe<T> - Class in org.pipecraft.pipes.sync.source
-
A source pipe reading items from a given binary input (file or input stream).
- BinInputReaderPipe(File, FileReadOptions, DecoderFactory<T>) - Constructor for class org.pipecraft.pipes.sync.source.BinInputReaderPipe
-
Constructor
- BinInputReaderPipe(File, DecoderFactory<T>) - Constructor for class org.pipecraft.pipes.sync.source.BinInputReaderPipe
-
Constructor
- BinInputReaderPipe(InputStream, DecoderFactory<T>, int, long, Compression) - Constructor for class org.pipecraft.pipes.sync.source.BinInputReaderPipe
-
Constructor
- BinInputReaderPipe(FailableInterruptibleSupplier<SizedInputStream, IOException>, DecoderFactory<T>, int, Compression) - Constructor for class org.pipecraft.pipes.sync.source.BinInputReaderPipe
-
Constructor
- BinInputReaderPipe(SizedInputStream, DecoderFactory<T>, FileReadOptions) - Constructor for class org.pipecraft.pipes.sync.source.BinInputReaderPipe
-
Constructor
- BlockingActionStatsCollector<E extends Enum<E>> - Class in org.pipecraft.infra.monitoring.collectors
-
A statistics collector which uses synchronization locks for guaranteeing data consistency.
- BlockingActionStatsCollector(Class<E>) - Constructor for class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
-
Constructor
- BlockingSampler<T> - Class in org.pipecraft.infra.monitoring.sampling
-
A utility for sampling of recent values, using a blocking approach for guaranteeing k latest events in a FIFO order.
- BlockingSampler(int) - Constructor for class org.pipecraft.infra.monitoring.sampling.BlockingSampler
-
Constructor
- BlockingSampler(int, SampleTextualizer<T>) - Constructor for class org.pipecraft.infra.monitoring.sampling.BlockingSampler
-
Constructor
- bucket(Bucket<B>) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- bucket(Storage<?, B>, String) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- Bucket<T> - Class in org.pipecraft.infra.storage
-
A base class for a storage bucket implementations.
- Bucket(String) - Constructor for class org.pipecraft.infra.storage.Bucket
-
Constructor
- buffer(int) - Method in class org.pipecraft.infra.io.FileReadOptions
-
Sets the buffer size (default = 8192)
- buffer(int) - Method in class org.pipecraft.infra.io.FileWriteOptions
-
Sets the buffer size (default = 8192)
- build() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
- build() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
- build() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- build() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- builder() - Static method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
- builder() - Static method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig
- builder(DecoderFactory<T>) - Static method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
-
Creates a builder set up with the given file data decoder and additional defaults.
- builder(DecoderFactory<T>) - Static method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
-
Creates a builder set up with the given file data decoder and additional defaults.
- builder(DecoderFactory<T>, FileReadOptions) - Static method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
-
Creates a builder set up with the given file data decoder and additional defaults.
- builder(DecoderFactory<T>, FileReadOptions) - Static method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
-
Creates a builder set up with the given file data decoder and additional defaults.
- builder(PipeReaderSupplier<T, B>) - Static method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
-
Creates a builder set up with the given pipe supplier and additional defaults.
- builder(PipeReaderSupplier<T, File>) - Static method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
-
Creates a builder set up with the given pipe supplier and additional defaults.
- buildFullPath(String, String...) - Static method in class org.pipecraft.infra.storage.PathUtils
-
Builds a full cloud path from the given parts.
- buildPath(boolean, String...) - Static method in class org.pipecraft.infra.storage.PathUtils
-
Builds a cloud path from the given parts (not including protocol) Handles normalization of the path by eliminating consecutive separators, using separators between paths.
- buildPath(String...) - Static method in class org.pipecraft.infra.storage.PathUtils
-
Builds a path from the given parts (not including protocol) Handles normalization of the path by eliminating consecutive separators, using separators between paths.
- buildPath(String, boolean, String...) - Static method in class org.pipecraft.infra.storage.PathUtils
-
Builds a full cloud path from the given parts.
- ByteArrayCodec<T> - Interface in org.pipecraft.pipes.serialization
-
An interface for byte array encoder and decoder
- ByteArrayDecoder<T> - Interface in org.pipecraft.pipes.serialization
-
A functional interface for decoders working on byte arrays representing single items.
- ByteArrayEncoder<T> - Interface in org.pipecraft.pipes.serialization
-
A functional interface for encoders producing byte arrays representing single items.
- byteSize() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Returns the byte size of the wrapped
MergingDigest.
C
- CallbackPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A pipe invoking a callback method per item passed through it.
- CallbackPipe(Pipe<T>, FailableConsumer<? super T, ? extends PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CallbackPipe
-
Constructor
- CallbackPipe(Pipe<T>, FailableConsumer<? super T, ? extends PipeException>, FailableRunnable<? extends PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CallbackPipe
-
Constructor
- CallbackPipe(Pipe<T>, FailableRunnable<? extends PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CallbackPipe
-
Constructor
- cancel(boolean) - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
- cancel(boolean) - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
- canEarlyExit(BitSet, int) - Method in enum org.pipecraft.pipes.sync.inter.join.JoinMode
- canTerminate(BitSet) - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
-
Called whenever one of the input pipes terminated.
- canTerminate(BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedIntersectionPipe
- canTerminate(BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedSubtractionPipe
- canTerminate(BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedUnionPipe
- categoriesEnumClass - Variable in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
- cdf(double) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
-
Get an estimate for the cdf of the distribution at
x. - cdf(double) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Get an estimate for the cdf of the distribution at
x. - cdf(double) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Get an estimate for the cdf of the distribution at
x. - cdf(double) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Get an estimate for the cdf of the distribution at
x. - cdf(List<Double>) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
-
Get an estimate for the cdf of the distribution at every coordinate of input list.
- cdf(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Get an estimate for the cdf of the distribution at every coordinate of input list.
- cdf(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Get an estimate for the cdf of the distribution at every coordinate of input list.
- cdf(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Get an estimate for the cdf of the distribution at every coordinate of input list.
- CheckedFuture<V,E extends Exception> - Interface in org.pipecraft.infra.concurrent
-
Extends
ListenableFutureand adds checkedGet() methods which simplify Future's error handling. - CheckedFutureTransformer<S,T,E extends Exception> - Class in org.pipecraft.infra.concurrent
-
A
CheckedFuturedecorator converting a checked future with value type S to a checked future with value type T. - CheckedFutureTransformer(AbstractCheckedFuture<S, E>, Function<S, T>) - Constructor for class org.pipecraft.infra.concurrent.CheckedFutureTransformer
-
Constructor
- checkedGet() - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
-
A simplified version of
Future.get()which mapsExecutionExceptionto a more indicative exception type - checkedGet() - Method in interface org.pipecraft.infra.concurrent.CheckedFuture
-
A simplified version of
Future.get()which mapsExecutionExceptionto a more indicative exception type - checkedGet() - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
-
A simplified version of
Future.get()which mapsExecutionExceptionto a more indicative exception type - checkedGet(long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
-
A simplified version of
Future.get(long, TimeUnit)which mapsExecutionExceptionto a more indicative exception type - checkedGet(long, TimeUnit) - Method in interface org.pipecraft.infra.concurrent.CheckedFuture
-
A simplified version of
Future.get(long, TimeUnit)which mapsExecutionExceptionto a more indicative exception type - checkedGet(long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
-
A simplified version of
Future.get(long, TimeUnit)which mapsExecutionExceptionto a more indicative exception type - clear() - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
-
Clears all statistics.
- clear() - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
- clear() - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
-
Clears all counters.
- clear() - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
- clearRecord(AtomicInteger) - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
- clearRecord(SlotRecord) - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
- clearRecord(R) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
-
clears a given record by resetting its data.
- close() - Method in class org.pipecraft.pipes.async.AsyncPipe
- close() - Method in class org.pipecraft.pipes.async.inter.AsyncCallbackPipe
- close() - Method in class org.pipecraft.pipes.async.inter.AsyncCompoundPipe
- close() - Method in class org.pipecraft.pipes.async.inter.AsyncFilterPipe
- close() - Method in class org.pipecraft.pipes.async.inter.AsyncFlexibleMapPipe
- close() - Method in class org.pipecraft.pipes.async.inter.AsyncHeadPipe
- close() - Method in class org.pipecraft.pipes.async.inter.AsyncMapPipe
- close() - Method in class org.pipecraft.pipes.async.inter.AsyncProgressPipe
- close() - Method in class org.pipecraft.pipes.async.inter.AsyncTimeoutPipe
- close() - Method in class org.pipecraft.pipes.async.inter.AsyncUnionPipe
- close() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerPipe
- close() - Method in class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
- close() - Method in class org.pipecraft.pipes.async.source.AsyncSeqGenPipe
- close() - Method in class org.pipecraft.pipes.serialization.AbstractInputStreamItemDecoder
- close() - Method in class org.pipecraft.pipes.serialization.AbstractOutputStreamItemEncoder
- close() - Method in class org.pipecraft.pipes.serialization.AvroDecoder
- close() - Method in class org.pipecraft.pipes.serialization.AvroEncoder
- close() - Method in class org.pipecraft.pipes.serialization.CSVDecoder
- close() - Method in class org.pipecraft.pipes.serialization.CSVEncoder
- close() - Method in interface org.pipecraft.pipes.serialization.ItemDecoder
- close() - Method in class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.ConcatPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.CountPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
- close() - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
- close() - Method in class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.HeadPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.IntermediateBinFileWriterPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.join.HashJoinPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.MapPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
- close() - Method in class org.pipecraft.pipes.sync.inter.OrderValidationPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.ProgressPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.reduct.HashReductorPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.SkipPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.SortedMergePipe
- close() - Method in class org.pipecraft.pipes.sync.inter.SortPipe
- close() - Method in class org.pipecraft.pipes.sync.inter.TopKPipe
- close() - Method in class org.pipecraft.pipes.sync.source.EmptyPipe
- close() - Method in class org.pipecraft.pipes.sync.source.ErrorPipe
- close() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
- close() - Method in class org.pipecraft.pipes.sync.source.IteratorReaderPipe
- close() - Method in class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
- close() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
- close() - Method in class org.pipecraft.pipes.sync.source.ReaderPipe
- close() - Method in class org.pipecraft.pipes.sync.source.SeqGenPipe
- close() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
- close() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
- close() - Method in class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
- close() - Method in class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
- close() - Method in class org.pipecraft.pipes.terminal.AsyncCollectionWriterPipe
- close() - Method in class org.pipecraft.pipes.terminal.AsyncConsumerPipe
- close() - Method in class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
- close() - Method in class org.pipecraft.pipes.terminal.AsyncSharderPipe
- close() - Method in class org.pipecraft.pipes.terminal.CollectionWriterPipe
- close() - Method in class org.pipecraft.pipes.terminal.CompoundTerminalPipe
- close() - Method in class org.pipecraft.pipes.terminal.ConsumerPipe
- close() - Method in class org.pipecraft.pipes.terminal.ParallelConsumerPipe
- close() - Method in class org.pipecraft.pipes.terminal.PercentilePipe
- close() - Method in class org.pipecraft.pipes.terminal.QueueWriterPipe
- close() - Method in class org.pipecraft.pipes.terminal.SharderByItemPipe
- close() - Method in class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
- close() - Method in class org.pipecraft.pipes.terminal.TxtFileWriterPipe
- close() - Method in class org.pipecraft.pipes.terminal.WriterPipe
- close(Closeable) - Static method in class org.pipecraft.infra.io.FileUtils
-
Closes the closeable.
- close(Closeable...) - Static method in class org.pipecraft.infra.io.FileUtils
-
Closes the resources in the order they are provided.
- close(Collection<? extends Closeable>) - Static method in class org.pipecraft.infra.io.FileUtils
-
Closes the resources in the order they are provided.
- close(Collection<? extends BasePipe>) - Static method in class org.pipecraft.pipes.utils.PipeUtils
-
Closes the given pipes, ignoring errors.
- close(BasePipe...) - Static method in class org.pipecraft.pipes.utils.PipeUtils
-
Closes the given pipes, ignoring errors.
- CLOSED - org.pipecraft.pipes.async.AsyncPipe.Status
- closeSilently(Closeable...) - Static method in class org.pipecraft.infra.io.FileUtils
-
Closes the given closeables, in a silent manner (ignoring IOExceptions)
- closeSilently(Collection<? extends Closeable>) - Static method in class org.pipecraft.infra.io.FileUtils
-
Closes the given closeables, in a silent manner (ignoring IOExceptions)
- codec(ByteArrayCodec<T>) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
- CodecFactory<T> - Interface in org.pipecraft.pipes.serialization
-
A factory of both encoders and decoders
- Coding - Class in org.pipecraft.infra.io
-
General encoding/decoding utility functions
- Coding() - Constructor for class org.pipecraft.infra.io.Coding
- CollectionReaderPipe<T> - Class in org.pipecraft.pipes.sync.source
-
A pipe based on a given collection of items.
- CollectionReaderPipe(Collection<T>) - Constructor for class org.pipecraft.pipes.sync.source.CollectionReaderPipe
-
Constructor
- CollectionReaderPipe(T...) - Constructor for class org.pipecraft.pipes.sync.source.CollectionReaderPipe
-
Constructor
- CollectionWriterPipe<T> - Class in org.pipecraft.pipes.terminal
-
A terminal pipe writing all contents from an input pipe into a given collection.
- CollectionWriterPipe(Pipe<T>) - Constructor for class org.pipecraft.pipes.terminal.CollectionWriterPipe
-
Constructor Collects items into an
ArrayList - CollectionWriterPipe(Pipe<T>, Collection<T>) - Constructor for class org.pipecraft.pipes.terminal.CollectionWriterPipe
-
Constructor
- compareTo(HostPort) - Method in class org.pipecraft.infra.net.HostPort
- compose(List<String>, String, boolean) - Method in class org.pipecraft.infra.storage.Bucket
-
Composes (concats) remote files.
- compose(List<String>, String, boolean) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- compose(FailableFunction<? super V, ? extends T, E>) - Method in interface org.pipecraft.infra.concurrent.FailableFunction
-
Similar to Function.compose(..), but works with
FailableFunction - CompoundPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A pipe encapsulating a pipeline.
- CompoundPipe() - Constructor for class org.pipecraft.pipes.sync.inter.CompoundPipe
- CompoundTerminalPipe - Class in org.pipecraft.pipes.terminal
-
A terminal pipe encapsulating a pipeline.
- CompoundTerminalPipe() - Constructor for class org.pipecraft.pipes.terminal.CompoundTerminalPipe
- compress(File, Compression) - Static method in class org.pipecraft.infra.io.FileUtils
-
Compresses a given file, leaving the original.
- compress(File, Compression, int) - Static method in class org.pipecraft.infra.io.FileUtils
-
Compresses a given file, leaving the original
- compressAll(File, Compression, int) - Static method in class org.pipecraft.infra.io.FileUtils
-
Compresses all files in the given folder, deleting the originals Original file names are appended the corresponding compression suffix (.gz/.zst).
- compressAll(File, Compression, int, int) - Static method in class org.pipecraft.infra.io.FileUtils
-
Compresses all files in the given folder, deleting the originals Original file names are appended the corresponding compression suffix (.gz/.zst).
- compression() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Compression factor of this digest.
- Compression - Enum in org.pipecraft.infra.io
-
Supported compression types
- computeVarint32Size(int) - Static method in class org.pipecraft.infra.io.Coding
-
Compute the number of bytes that would be needed to encode a varint.
- ConcatPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
An intermediate pipe consisting of concatenating the contents of a series of pipes
- ConcatPipe(List<PipeSupplier<T>>) - Constructor for class org.pipecraft.pipes.sync.inter.ConcatPipe
-
Constructor
- ConcatPipe(PipeSupplier<T>...) - Constructor for class org.pipecraft.pipes.sync.inter.ConcatPipe
-
Constructor
- ConcurrentQuantileEstimator - Interface in org.pipecraft.infra.monitoring.quantile
-
Thread-safe quantile and cdf estimation
- ConsumerPipe<T> - Class in org.pipecraft.pipes.terminal
-
A terminal pipe that consumes all contents of the input pipe in a synchronous manner.
- ConsumerPipe(Pipe<T>) - Constructor for class org.pipecraft.pipes.terminal.ConsumerPipe
-
Constructor Builds a no-op consumer
- ConsumerPipe(Pipe<T>, Runnable) - Constructor for class org.pipecraft.pipes.terminal.ConsumerPipe
-
Constructor
- ConsumerPipe(Pipe<T>, FailableConsumer<? super T, PipeException>) - Constructor for class org.pipecraft.pipes.terminal.ConsumerPipe
-
Constructor
- ConsumerPipe(Pipe<T>, FailableConsumer<? super T, PipeException>, Runnable) - Constructor for class org.pipecraft.pipes.terminal.ConsumerPipe
-
Constructor
- copy(String, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Copies a a remote file in the current bucket to a different location in the same bucket
- copyFile(File, File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Copies a file from one location to the other
- copyFileToFolder(File, File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Copies a file from one location to the other, keeping the filename
- copyFolderRecursiveInterruptibly(String, String, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Copies all files, recursively, from one folder in this bucket to another.
- copyFolderRecursiveInterruptibly(String, String, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Copies all files, recursively, from one folder in this bucket to another.
- copyInterruptibly(String, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Copies a a remote file in the current bucket to a different location in the same bucket.
- copyInterruptibly(String, String, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Copies a a remote file in the current bucket to a different location in the same bucket.
- copyToAnotherBucket(String, String, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Copies a file between this bucket to another bucket
- copyToAnotherBucket(String, String, String) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- copyToAnotherBucketInterruptibly(String, String, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Copies a file between this bucket to another bucket, using retries.
- copyToAnotherBucketInterruptibly(String, String, String, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Copies a file between this bucket to another bucket, using retries
- count() - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
- countEvent(E) - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
-
Indicates that an event of a given category just occurred.
- countEvent(T, long) - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
-
Increments an event counter
- CountPipe - Class in org.pipecraft.pipes.sync.inter
-
A pipe counting the items in the input pipe, and returning the count as a single output item.
- CountPipe(Pipe<?>) - Constructor for class org.pipecraft.pipes.sync.inter.CountPipe
-
constructor
- createFolder(File, String) - Static method in class org.pipecraft.infra.io.FileUtils
-
creates a folder
- createFolder(String) - Static method in class org.pipecraft.infra.io.FileUtils
-
creates a folder, or keeps it if exists
- createInputStream() - Method in class org.pipecraft.pipes.sync.source.BinInputReaderPipe
- createInputStream() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
- createInputStream() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
- createInputStream() - Method in class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
- createInputStream() - Method in class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
- createPipeline() - Method in class org.pipecraft.pipes.async.inter.AsyncCompoundPipe
- createPipeline() - Method in class org.pipecraft.pipes.async.source.AsyncMultiFileReaderPipe
- createPipeline() - Method in class org.pipecraft.pipes.async.source.AsyncStorageMultiFileReaderPipe
- createPipeline() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
- createPipeline() - Method in class org.pipecraft.pipes.sync.inter.GrouperPipe
- createPipeline() - Method in class org.pipecraft.pipes.sync.inter.join.HashJoinPipe
- createPipeline() - Method in class org.pipecraft.pipes.sync.inter.reduct.HashReductorPipe
- createPipeline() - Method in class org.pipecraft.pipes.sync.source.MultiFileReaderPipe
- createPipeline() - Method in class org.pipecraft.pipes.sync.source.MultiTxtFileReaderPipe
- createPipeline() - Method in class org.pipecraft.pipes.sync.source.StorageMultiFileReaderPipe
- createPipeline() - Method in class org.pipecraft.pipes.sync.source.StorageMultiTxtFileReaderPipe
- createPipeline() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
- createPipeline() - Method in class org.pipecraft.pipes.terminal.BinFileWriterPipe
- createPipeline() - Method in class org.pipecraft.pipes.terminal.CompoundTerminalPipe
- createPipeline() - Method in class org.pipecraft.pipes.terminal.SharderBySeqPipe
- createTempFile(String, String) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a unique temp file in the system's default tmp folder.
- createTempFile(String, String, File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a unique temp file in the given folder.
- createTempFolder(String) - Static method in class org.pipecraft.infra.io.FileUtils
-
creates a temp folder under the system's default tmp folder
- createTempFolder(String, File) - Static method in class org.pipecraft.infra.io.FileUtils
-
creates a temp folder under a given parent folder
- createUniqueFile(String, String) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a unique file in the system's default tmp folder.
- createUniqueFile(String, String, File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a unique file in the given folder.
- createUniqueFolder(String) - Static method in class org.pipecraft.infra.io.FileUtils
-
creates a unique folder under the system's default tmp folder
- createUniqueFolder(String, File) - Static method in class org.pipecraft.infra.io.FileUtils
-
creates a unique folder under a given parent folder
- CSV_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
- CSV_GZ_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
- CSV_ZSTD_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
- CSVDecoder<T> - Class in org.pipecraft.pipes.serialization
-
An
ItemDecoderthat decodes CSV rows. - CSVDecoder(InputStream, FailableFunction<String[], T, ValidationPipeException>) - Constructor for class org.pipecraft.pipes.serialization.CSVDecoder
-
Constructor Assumes UTF8, comma as a delimiter, no header rows and default read options (no compression)
- CSVDecoder(InputStream, FailableFunction<String[], T, ValidationPipeException>, int) - Constructor for class org.pipecraft.pipes.serialization.CSVDecoder
-
Constructor Assumes UTF8, comma as a delimiter and default read options (no compression)
- CSVDecoder(InputStream, FailableFunction<String[], T, ValidationPipeException>, Charset, char, int, FileReadOptions) - Constructor for class org.pipecraft.pipes.serialization.CSVDecoder
-
Constructor
- CSVEncoder<T> - Class in org.pipecraft.pipes.serialization
-
An
ItemEncoderthat encodes objects as compliant CSV rows. - CSVEncoder(OutputStream, Function<T, String[]>) - Constructor for class org.pipecraft.pipes.serialization.CSVEncoder
-
Constructor Assumes UTF8, comma as a delimiter and default write options (no compression)
- CSVEncoder(OutputStream, Function<T, String[]>, Charset, char, String, FileWriteOptions) - Constructor for class org.pipecraft.pipes.serialization.CSVEncoder
-
Constructor
- CSVMapperPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
An intermediate pipe that parses strings in CSV format, and binds each line to an object
- CSVMapperPipe(Pipe<String>, boolean, String[], FailableFunction<Map<String, String>, T, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CSVMapperPipe
-
Constructor Constructs a mapper with the default delimiter (',').
- CSVMapperPipe(Pipe<String>, char, boolean, String[], FailableFunction<Map<String, String>, T, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CSVMapperPipe
-
Constructor
- CSVMapperPipe(Pipe<String>, FailableFunction<Map<String, String>, T, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.CSVMapperPipe
-
Constructor Constructs a mapper with the default delimiter (','), expecting a header, and using the header column names for the row converter.
D
- decode() - Method in class org.pipecraft.pipes.serialization.AvroDecoder
- decode() - Method in class org.pipecraft.pipes.serialization.CSVDecoder
- decode() - Method in interface org.pipecraft.pipes.serialization.ItemDecoder
-
Reads and decodes the next object from the input stream.
- decode(byte[]) - Method in interface org.pipecraft.pipes.serialization.ByteArrayDecoder
- decode(byte[]) - Method in class org.pipecraft.pipes.serialization.DelegatingByteArrayCodec
- DecoderFactory<T> - Interface in org.pipecraft.pipes.serialization
-
Allows creating
ItemDecoderinstances of some specific type. - decompress(File, Compression) - Static method in class org.pipecraft.infra.io.FileUtils
-
Decompresses a given file, leaving the original
- decompressAll(File, Compression, int) - Static method in class org.pipecraft.infra.io.FileUtils
-
Decompresses all files in the given folder, deleting the originals File names are removed the relevant extension (.gz/.zst), and if not found, the name is appended with ".decompressed".
- DedupPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
Uses item equality (equals() method) in input pipe items for performing a dedup operation.
- DedupPipe(Pipe<T>, CodecFactory<T>, int, File) - Constructor for class org.pipecraft.pipes.sync.inter.DedupPipe
-
Constructor
- DEFAULT_RETRIER - Static variable in class org.pipecraft.infra.storage.Bucket
- DEFAULT_RETRY_INITIAL_SLEEP_SEC - Static variable in class org.pipecraft.infra.storage.Bucket
- DEFAULT_RETRY_MAX_ATTEMPTS - Static variable in class org.pipecraft.infra.storage.Bucket
- DEFAULT_RETRY_WAIT_TIME_FACTOR - Static variable in class org.pipecraft.infra.storage.Bucket
- DelegatePipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A pipe delegating all work to another pipe given in the constructor.
- DelegatePipe(Pipe<T>) - Constructor for class org.pipecraft.pipes.sync.inter.DelegatePipe
-
Constructor
- DelegatingByteArrayCodec<T> - Class in org.pipecraft.pipes.serialization
-
Wraps a given byte array encoder and byte array decoder, and delegates encoding/decoding requests to them.
- DelegatingByteArrayCodec(ByteArrayEncoder<T>, ByteArrayDecoder<T>) - Constructor for class org.pipecraft.pipes.serialization.DelegatingByteArrayCodec
-
Constructor
- DelegatingCodecFactory<T> - Class in org.pipecraft.pipes.serialization
-
Wraps a given encoder and decoder factories, and delegates encoding/decoding creation requests to them.
- DelegatingCodecFactory(EncoderFactory<T>, DecoderFactory<T>) - Constructor for class org.pipecraft.pipes.serialization.DelegatingCodecFactory
-
Constructor
- delete(File) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- delete(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a single object.
- delete(T) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a single object.
- deleteAllByMetaInterruptibly(Collection<T>, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a set of remote files.
- deleteAllByMetaInterruptibly(Collection<T>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a set of remote files.
- deleteAllByMetaInterruptibly(Iterator<T>, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a set of remote files.
- deleteAllByMetaInterruptibly(Iterator<T>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a set of remote files.
- deleteAllInterruptibly(Collection<String>, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a set of remote files.
- deleteAllInterruptibly(Collection<String>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a set of remote files.
- deleteAllInterruptibly(Iterator<String>, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a set of remote files.
- deleteAllInterruptibly(Iterator<String>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a set of remote files.
- deleteFile(File, Logger) - Static method in class org.pipecraft.infra.io.FileUtils
-
Deletes a file/folder, ignoring failures.
- deleteFiles(File...) - Static method in class org.pipecraft.infra.io.FileUtils
-
Deletes a set of files/folders, ignoring failures.
- deleteFiles(Logger, File...) - Static method in class org.pipecraft.infra.io.FileUtils
-
Deletes a set of files/folders, ignoring failures.
- deleteFolderRecursiveInterruptibly(String, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes all folder contents, recursively.
- deleteFolderRecursiveInterruptibly(String, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes all folder contents, recursively.
- deleteFolderRegularFiles(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes all regular files under a remote folder.
- deleteInterruptibly(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a single object with retries.
- deleteInterruptibly(String, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a single object with retries.
- deleteInterruptibly(T) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a single object with retries.
- deleteInterruptibly(T, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Deletes a single object with retries.
- detect(File) - Static method in enum org.pipecraft.infra.io.Compression
-
Detects compression based on file extension
- detect(String) - Static method in enum org.pipecraft.infra.io.Compression
-
Detects compression based on file extension
- detectCompression(String) - Method in class org.pipecraft.infra.io.FileReadOptions
-
Sets the compression of the file by its extension
- discriminator(FailableFunction<I, F, PipeException>) - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
- DistributedShufflerConfig<T> - Class in org.pipecraft.pipes.async.inter.distributed
-
A configuration object for
DistributedShufflerPipe. - DistributedShufflerConfig.Builder<T> - Class in org.pipecraft.pipes.async.inter.distributed
- DistributedShufflerPipe<T> - Class in org.pipecraft.pipes.async.inter.distributed
-
An async pipe that takes input and shuffle it across multiple workers.
- DistributedShufflerPipe(AsyncPipe<T>, DistributedShufflerConfig<T>) - Constructor for class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerPipe
-
Another Constructor????? YES!
- done() - Method in interface org.pipecraft.pipes.async.AsyncPipeListener
-
Indicates that the async pipe is done producing items, in a successfull manner.
- DONE - org.pipecraft.pipes.async.AsyncPipe.Status
- DONE_FILE_NAME - Static variable in class org.pipecraft.infra.storage.Bucket
- downloadAndGetReadPipes(Collection<B>, Bucket<B>, StorageMultiFileReaderConfig<T, B>) - Static method in class org.pipecraft.pipes.utils.multi.MultiFileReaderUtils
- downloadFirst() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
-
Indicates that instead of streaming (the default behavior), we first download all files (in an efficient manner), and then read them locally.
- downloadFirst(File) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
-
Indicates that instead of streaming (the default behavior), we first download all files (in an efficient manner), and then read them locally.
- drainTo(Collection<? super E>) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- drainTo(Collection<? super E>, int) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- duration() - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
- duration() - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
E
- EmptyPipe<T> - Class in org.pipecraft.pipes.sync.source
-
A source pipe with no data in it.
- encode(T) - Method in class org.pipecraft.pipes.serialization.AvroEncoder
- encode(T) - Method in interface org.pipecraft.pipes.serialization.ByteArrayEncoder
- encode(T) - Method in class org.pipecraft.pipes.serialization.CSVEncoder
- encode(T) - Method in class org.pipecraft.pipes.serialization.DelegatingByteArrayCodec
- encode(T) - Method in interface org.pipecraft.pipes.serialization.ItemEncoder
- EncoderFactory<T> - Interface in org.pipecraft.pipes.serialization
-
Allows creating
ItemEncoderinstances of some specific type. - end(E) - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
- end(E) - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
-
Indicates that an action has terminated.
- end(E, long) - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
- EnumEventStatsMap<T extends Enum<T>> - Class in org.pipecraft.infra.monitoring.collectors
-
An EventStatsMap based on an enum
- EnumEventStatsMap(Class<T>) - Constructor for class org.pipecraft.infra.monitoring.collectors.EnumEventStatsMap
-
Constructor
- equals(Object) - Method in class org.pipecraft.infra.net.HostPort
- equals(Object) - Method in class org.pipecraft.infra.storage.StoragePath
- equals(Object) - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
- equals(Object) - Method in class org.pipecraft.pipes.utils.ShardSpecifier
- error(PipeException) - Method in interface org.pipecraft.pipes.async.AsyncPipeListener
-
Notifies the listener that an error has been detected by the async pipe during item generation.
- ERROR - org.pipecraft.pipes.async.AsyncPipe.Status
- ErrorPipe<T> - Class in org.pipecraft.pipes.sync.source
-
A source pipe with no data in it, which only produces a predefined
PipeException. - ErrorPipe(PipeException) - Constructor for class org.pipecraft.pipes.sync.source.ErrorPipe
-
Constructor
- EventRateSlidingWindow - Class in org.pipecraft.infra.monitoring.sliding
-
A simple sliding window used for calculating events rate in a given time frame
- EventRateSlidingWindow(int, int, TimeUnit, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
-
Constructor
- EventsCollector<E extends Enum<E>> - Class in org.pipecraft.infra.monitoring.collectors
-
Counts events that fall into one of a predefined set of categories.
- EventsCollector(Class<E>) - Constructor for class org.pipecraft.infra.monitoring.collectors.EventsCollector
-
Constructor
- EventStatsMap<E> - Class in org.pipecraft.infra.monitoring.collectors
-
A mapping between event categories and their respective counts.
- EventStatsMap(Map<E, Long>) - Constructor for class org.pipecraft.infra.monitoring.collectors.EventStatsMap
-
Constructor (protected)
- ExactSamplerPipe<T> - Class in org.pipecraft.pipes.sync.inter.sample
-
A pipe sampling exactly m items of an input pipe containing n items, where n is known in advance.
- ExactSamplerPipe(Pipe<T>, int, int) - Constructor for class org.pipecraft.pipes.sync.inter.sample.ExactSamplerPipe
-
Constructor
- ExactSamplerPipe(Pipe<T>, int, int, Random) - Constructor for class org.pipecraft.pipes.sync.inter.sample.ExactSamplerPipe
-
Constructor
- ExcessiveResourcesUsagePipeException - Exception in org.pipecraft.pipes.exceptions
-
A pipe exception due to resource usage beyond some threshold
- ExcessiveResourcesUsagePipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.ExcessiveResourcesUsagePipeException
- ExcessiveResourcesUsagePipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.ExcessiveResourcesUsagePipeException
- ExcessiveResourcesUsagePipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.ExcessiveResourcesUsagePipeException
- exists(String) - Method in class org.pipecraft.infra.storage.Bucket
- exists(String) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
F
- FAIL - org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe.GroupSizeLimitPolicy
- FailableBiConsumer<A,B,E extends Exception> - Interface in org.pipecraft.infra.concurrent
-
A bi-consumer that may fail with a checked exception during the execution of the accept(..) method.
- FailableConsumer<T,E extends Exception> - Interface in org.pipecraft.infra.concurrent
-
A consumer that may fail with a checked exception during the execution of the accept(..) method.
- FailableFunction<T,R,E extends Exception> - Interface in org.pipecraft.infra.concurrent
-
A function that may fail with a checked exception during the execution of the apply(..) method.
- FailableInterruptibleConsumer<T,E extends Exception> - Interface in org.pipecraft.infra.concurrent
-
An interreuptible consumer that may also fail with a checked exception during the execution of the accept(..) method.
- FailableInterruptibleRunnable<E extends Exception> - Interface in org.pipecraft.infra.concurrent
-
A runnable that is interruptible and may also fail with a checked exception during the execution of the run() method.
- FailableInterruptibleSupplier<T,E extends Exception> - Interface in org.pipecraft.infra.concurrent
-
A supplier that is interruptible and may also fail with a checked exception during the execution of the get() method.
- FailablePredicate<T,E extends Exception> - Interface in org.pipecraft.infra.concurrent
- FailableRunnable<E extends Exception> - Interface in org.pipecraft.infra.concurrent
-
A runnable that may fail with a checked exception during the execution of the run() method.
- FailableSupplier<T,E extends Exception> - Interface in org.pipecraft.infra.concurrent
-
A supplier that may fail with a checked exception during the execution of the get() method.
- FastRandom - Class in org.pipecraft.infra.math
-
A fast version of
Random, which extends from it but eliminates thread safety. - FastRandom() - Constructor for class org.pipecraft.infra.math.FastRandom
-
Constructor Uses a seed derived from the clock
- FastRandom(long) - Constructor for class org.pipecraft.infra.math.FastRandom
-
Constructor
- fileOrder(Comparator<B>) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- fileOrder(Comparator<File>) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- FileReadOptions - Class in org.pipecraft.infra.io
-
Encapsulates file reading settings, with defaults.
- FileReadOptions() - Constructor for class org.pipecraft.infra.io.FileReadOptions
- FileUtils - Class in org.pipecraft.infra.io
-
A set of utility methods for manipulating files
- FileUtils() - Constructor for class org.pipecraft.infra.io.FileUtils
- FileWriteOptions - Class in org.pipecraft.infra.io
-
Encapsulates file writing settings, with defaults.
- FileWriteOptions() - Constructor for class org.pipecraft.infra.io.FileWriteOptions
- FilterBasePipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A base-class pipe implementation for pipes that filter an input pipe using some criteria.
- FilterBasePipe(Pipe<T>) - Constructor for class org.pipecraft.pipes.sync.inter.FilterBasePipe
-
Constructor
- FilterPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A pipe filtering an input pipe by some predicate on the pipe items.
- FilterPipe(Pipe<T>, Predicate<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.FilterPipe
-
Constructor
- FlexibleMapPipe<S,T> - Class in org.pipecraft.pipes.sync.inter
-
An intermediate pipe that maps an input item into zero or more items of another type.
- FlexibleMapPipe(Pipe<S>, PipeFactory<S, ? extends T>) - Constructor for class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
-
Constructor
- fromBiConsumer(BiConsumer<X, Y>) - Static method in interface org.pipecraft.infra.concurrent.FailableBiConsumer
-
Utility method for wrapping a bi-consumer with a failable bi-consumer
- fromBytes(ByteBuffer) - Static method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Initialize from a serialized buffer.
- fromConsumer(Consumer<T>) - Static method in interface org.pipecraft.infra.concurrent.FailableConsumer
-
Utility method for wrapping a consumer with a failable consumer
- fromConsumer(Consumer<T>) - Static method in interface org.pipecraft.infra.concurrent.FailableInterruptibleConsumer
-
Utility method for wrapping a consumer with a failable consumer
- fromHex(String) - Static method in class org.pipecraft.infra.io.Coding
-
convert hex to byte array
- fromPipe(Pipe<T>) - Static method in class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
- fromPipes(Collection<Pipe<T>>, int) - Static method in class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
- fromPipes(List<Pipe<T>>) - Static method in class org.pipecraft.pipes.sync.inter.ConcatPipe
- fromPipes(Pipe<T>...) - Static method in class org.pipecraft.pipes.sync.inter.ConcatPipe
- fromSupplier(Supplier<T>) - Static method in interface org.pipecraft.infra.concurrent.FailableInterruptibleSupplier
-
Utility method for wrapping a supplier with a failable supplier
- fromSupplier(Supplier<T>) - Static method in interface org.pipecraft.infra.concurrent.FailableSupplier
-
Utility method for wrapping a supplier with a failable supplier
- FULL_INNER - org.pipecraft.pipes.sync.inter.join.JoinMode
- FutureCompletionHandler<T> - Class in org.pipecraft.infra.concurrent
-
To be set as a listener on
ListenableFutures. - FutureCompletionHandler(Consumer<? super T>, Consumer<Throwable>, Future<? extends T>) - Constructor for class org.pipecraft.infra.concurrent.FutureCompletionHandler
-
Protected constructor
- FutureCompletionLogger - Class in org.pipecraft.infra.concurrent
-
To be set as a listener on
ListenableFutures. - FutureCompletionLogger(Logger, Level, Level, String, Future<?>) - Constructor for class org.pipecraft.infra.concurrent.FutureCompletionLogger
-
Constructor
G
- generateReadOnlyUrl(String, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Generates a signed url for reading a specific file.
- generateReadOnlyUrl(String, int) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- generateResumableSignedUrlForUpload(String, String, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Generates a resumable signed url for a for uploading to a specific file for private access.
- generateResumableSignedUrlForUpload(String, String, int, Long, boolean) - Method in class org.pipecraft.infra.storage.Bucket
-
Generates a resumable signed url for a for uploading to a specific file.
- generateResumableSignedUrlForUpload(String, String, int, Long, boolean) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- generateSignedUrl(String, String, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Generates a signed url for an upload on a specific file.
- generateSignedUrl(String, String, int, boolean) - Method in class org.pipecraft.infra.storage.Bucket
-
Generates a signed url for an upload on a specific file.
- generateSignedUrl(String, String, int, boolean) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- get() - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
- get() - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
- get() - Method in interface org.pipecraft.infra.concurrent.FailableInterruptibleSupplier
-
Gets a result.
- get() - Method in interface org.pipecraft.infra.concurrent.FailableSupplier
-
Gets a result.
- get() - Method in interface org.pipecraft.pipes.utils.PipeSupplier
- get(long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
- get(long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
- get(File, File) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- get(String) - Method in class org.pipecraft.infra.monitoring.MonitoringTree
- get(String, File) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a file given the remote file path
- get(String, Set<String>) - Method in class org.pipecraft.infra.monitoring.MonitoringTree
- get(SizedInputStream, M) - Method in interface org.pipecraft.pipes.utils.PipeReaderSupplier
- get(P) - Method in interface org.pipecraft.pipes.utils.PipeFactory
- get(T, File) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a file given the remote file's metadata object
- getAggregationLogic() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
- getAggregationLogic() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig
- getAggregatorCreator() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
- getAggregatorCreator() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig
- getAll() - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
- getAll() - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
- getAll() - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
- getAll() - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
- getAll() - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
- getAll() - Method in class org.pipecraft.infra.monitoring.MonitoringTree
- getAllLocalFilesToRead(LocalMultiFileReaderConfig<T>) - Static method in class org.pipecraft.pipes.utils.multi.MultiFileReaderUtils
- getAllRegularFiles(Collection<String>, File, Function<String, String>, int) - Method in class org.pipecraft.infra.storage.Bucket
-
downloads a set of regular files from different bucket locations.
- getAllRegularFilesByMetaInterruptibly(Collection<T>, File, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a set of regular files from different bucket locations.
- getAllRegularFilesByMetaInterruptibly(Collection<T>, File, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a set of regular files from different bucket locations.
- getAllRegularFilesByMetaInterruptibly(Collection<T>, File, Function<String, String>, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a set of regular files from different bucket locations.
- getAllRegularFilesByMetaInterruptibly(Collection<T>, File, Function<String, String>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a set of regular files from different bucket locations.
- getAllRegularFilesInterruptibly(String, File, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads all regular files from a given folder, performing the task in parallel Uses retries on individual files, using default retry settings.
- getAllRegularFilesInterruptibly(String, Predicate<T>, File, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads regular files from a given remote folder.
- getAllRegularFilesInterruptibly(String, Predicate<T>, File, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads regular files from a given remote folder.
- getAllRegularFilesInterruptibly(Collection<String>, File, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a set of regular files from different bucket locations.
- getAllRegularFilesInterruptibly(Collection<String>, File, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a set of regular files from different bucket locations.
- getAllRegularFilesInterruptibly(Collection<String>, File, Function<String, String>, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a set of regular files from different bucket locations.
- getAllRegularFilesInterruptibly(Collection<String>, File, Function<String, String>, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a set of regular files from different bucket locations.
- getAllRemoteFilesToRead(StorageMultiFileReaderConfig<T, B>) - Static method in class org.pipecraft.pipes.utils.multi.MultiFileReaderUtils
- getAsJson(JsonMonitorable) - Static method in class org.pipecraft.infra.monitoring.MonitoringTree
- getAsStream(File, int) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- getAsStream(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Gets an input stream for a remote file, using the default chunk size.
- getAsStream(String, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Gets an input stream for a remote file, using a given chunk size.
- getAsStream(T) - Method in class org.pipecraft.infra.storage.Bucket
-
Gets an input stream for a remote file, using the default chunk size.
- getAsStream(T, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Gets an input stream for a remote file, using a given chunk size.
- getAverageProgress(Collection<? extends BasePipe>) - Static method in class org.pipecraft.pipes.utils.PipeUtils
- getAvgActionDuration() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
- getBigEndian16AsBytes(int) - Static method in class org.pipecraft.infra.io.Coding
- getBigEndian32AsBytes(int) - Static method in class org.pipecraft.infra.io.Coding
- getBigEndian64AsBytes(long) - Static method in class org.pipecraft.infra.io.Coding
- getBucket() - Method in class org.pipecraft.infra.storage.StoragePath
- getBucket() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
- getBucket(String) - Method in class org.pipecraft.infra.storage.local.LocalDiskStorage
- getBucket(String) - Method in interface org.pipecraft.infra.storage.Storage
- getBucketName() - Method in class org.pipecraft.infra.storage.Bucket
- getBucketNameFromFullyQualifiedPath(String) - Static method in class org.pipecraft.infra.storage.PathUtils
-
Gets a fully qualified path ({protocol}://{bucket}/{path}) and returns the bucket name.
- getBufferSize() - Method in class org.pipecraft.infra.io.FileReadOptions
- getBufferSize() - Method in class org.pipecraft.infra.io.FileWriteOptions
- getByteArrayCodec() - Method in interface org.pipecraft.pipes.serialization.CodecFactory
- getCapacity() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Gets the journal capacity.
- getCategories() - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
- getCategoryStats() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
- getCategoryStats() - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
- getChildren() - Method in class org.pipecraft.infra.io.Retrier
- getChildren() - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
- getChildren() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
- getChildren() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
- getChildren() - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
- getChildren() - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
- getChildren() - Method in interface org.pipecraft.infra.monitoring.JsonMonitorable
- getChildren() - Method in class org.pipecraft.infra.monitoring.JsonMonitorableMerger
- getChildren() - Method in class org.pipecraft.infra.monitoring.JsonMonitorableWrapper
- getChildren() - Method in class org.pipecraft.infra.monitoring.MonitoringTree
- getChildren() - Method in class org.pipecraft.infra.monitoring.sampling.BlockingSampler
- getChildren() - Method in class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
- getChildren() - Method in class org.pipecraft.infra.monitoring.SystemHealthMonitorable
- getCodec() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
- getColumnNames() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
- getCompletedCount() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
- getCompletedCount(E) - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
- getCompletedCount(E) - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
- getCompletedCount(E) - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
- getCompression() - Method in class org.pipecraft.infra.io.FileReadOptions
- getCompression() - Method in class org.pipecraft.infra.io.FileWriteOptions
- getCompression() - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
The compression factor
- getCompression() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
- getCompression() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Get the compression factor.
- getCompressionInflation() - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
The compression factor of each internal digest is equal to
MultiQuantileDigest.compressionInflation*MultiQuantileDigest.compression - getCompressionInputStream(InputStream, Compression) - Static method in class org.pipecraft.infra.io.FileUtils
- getCompressionLevel() - Method in class org.pipecraft.infra.io.FileWriteOptions
- getCompressionOutputStream(OutputStream, Compression) - Static method in class org.pipecraft.infra.io.FileUtils
- getCompressionOutputStream(OutputStream, Compression, int) - Static method in class org.pipecraft.infra.io.FileUtils
- getConsistentBooleanByProbability(Object, float) - Static method in class org.pipecraft.infra.math.ArithmeticUtils
-
Get consistent boolean value (accepted/rejected) by a given probability.
- getCount() - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
-
Returns the number of bytes read.
- getCount(E) - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
- getCount(E) - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
- getCount(T) - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
- getCurrentTimestamp() - Method in class org.pipecraft.infra.monitoring.graphite.GraphiteClient
- getDefaultCompressionLevel() - Method in enum org.pipecraft.infra.io.Compression
- getDiscriminator() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
- getDiscriminator() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig
- getDotlessExtension(String) - Static method in class org.pipecraft.infra.io.FileUtils
- getExtension(String) - Static method in class org.pipecraft.infra.io.FileUtils
- getFactory(Class<R>) - Static method in class org.pipecraft.pipes.serialization.AvroDecoder
- getFactory(Class<R>) - Static method in class org.pipecraft.pipes.serialization.AvroEncoder
- getFactory(Function<R, String[]>) - Static method in class org.pipecraft.pipes.serialization.CSVEncoder
- getFactory(Function<R, String[]>, Charset, char, String) - Static method in class org.pipecraft.pipes.serialization.CSVEncoder
- getFactory(FailableFunction<String[], R, ValidationPipeException>) - Static method in class org.pipecraft.pipes.serialization.CSVDecoder
- getFactory(FailableFunction<String[], R, ValidationPipeException>, Charset, char, int) - Static method in class org.pipecraft.pipes.serialization.CSVDecoder
- getFileExtension() - Method in enum org.pipecraft.infra.io.Compression
- getFileFilter() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
- getFileFilter() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
- getFileOrder() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
- getFileOrder() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
- getFromJson(String, Class<C>) - Method in class org.pipecraft.infra.storage.Bucket
- getFullMetrics() - Method in interface org.pipecraft.infra.monitoring.JsonMonitorable
- getHost() - Method in class org.pipecraft.infra.net.HostPort
- getHostPorts(String) - Static method in class org.pipecraft.infra.net.HostPort
- getInputPipes() - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
- getInputStream() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
- getInputStream(File, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates an input stream that reads from a file, using the given
FileReadOptions. - getInputStream(InputStream, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Wraps an input stream, adding the features defined by the given
FileReadOptions. - getInputStreamFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
-
Return the input stream of the given resource path
- getInputStreamSize() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
- getInterruptibly(String, File) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a file with retries Uses default retry settings
- getInterruptibly(String, File, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a file with retries
- getInterruptibly(T, File) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a file with retries Uses default retry settings
- getInterruptibly(T, File, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a file with retries
- getInventory() - Method in class org.pipecraft.infra.monitoring.MonitoringTree
- getInventory(JsonMonitorable) - Static method in class org.pipecraft.infra.monitoring.MonitoringTree
- getItems() - Method in class org.pipecraft.pipes.terminal.AsyncCollectionWriterPipe
- getItems() - Method in class org.pipecraft.pipes.terminal.CollectionWriterPipe
- getItemsCount() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
- getJournalingIntervalMillis() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Gets journaling interval.
- getJSONFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
-
Utility for loading JSON objects from classpath files
- getJSONFromFile(File) - Static method in class org.pipecraft.infra.io.FileUtils
- getJSONFromInpuStream(InputStream) - Static method in class org.pipecraft.infra.io.FileUtils
- getJSONListFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
-
Utility for loading a list of JSON objects from classpath files, assuming that every line has one JSON object.
- getJSONListFromFile(File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Utility for loading a list of JSON objects from a file, assuming that every line has one JSON object.
- getKey() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
- getKeyFromFullyQualifiedPath(String) - Static method in class org.pipecraft.infra.storage.PathUtils
-
Gets a fully qualified path ({protocol}://{bucket}/{path}) and returns the key.
- getLastFile(String, Pattern) - Method in class org.pipecraft.infra.storage.Bucket
-
Returns the maximal (lexicographic ordering of the full path string) file in the path, filtering by given pattern.
- getLastPathPart(String) - Static method in class org.pipecraft.infra.storage.PathUtils
-
Returns the last part of a given path.
- getLastUpdated(File) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- getLastUpdated(T) - Method in class org.pipecraft.infra.storage.Bucket
- getLeft() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
- getLength(File) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- getLength(T) - Method in class org.pipecraft.infra.storage.Bucket
- getLinesFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
-
Utility for loading the lines of a classpath file (UTF8).
- getLinesFromFile(File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Utility for loading the lines of a local text file (UTF8).
- getLinesFromFile(File, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Utility for loading the lines of a local text file
- getLinesFromFileAsSet(File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Utility for loading the lines of a local text file (UTF8) into a set
- getLinesFromFileAsSet(File, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Utility for loading the lines of a local text file into a set
- getListFromReader(Reader) - Static method in class org.pipecraft.infra.io.FileUtils
-
Utility for loading the lines from a reader
- getLittleEndian16AsBytes(int) - Static method in class org.pipecraft.infra.io.Coding
- getLittleEndian32AsBytes(int) - Static method in class org.pipecraft.infra.io.Coding
- getLittleEndian64AsBytes(long) - Static method in class org.pipecraft.infra.io.Coding
- getMaxProgress(Collection<? extends BasePipe>) - Static method in class org.pipecraft.pipes.utils.PipeUtils
- getMinProgress(Collection<? extends BasePipe>) - Static method in class org.pipecraft.pipes.utils.PipeUtils
- getObjectMetadata(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Supplies the metadata of a file, if it exists
- getObjectMetadata(String) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- getObjectMetadata(Collection<String>) - Method in class org.pipecraft.infra.storage.Bucket
-
Supplies metadata objects for a given set of remote file paths.
- getObjectMetadata(Collection<String>, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Supplies metadata objects for a given set of remote file paths.
- getOrCreateBucket(String) - Method in class org.pipecraft.infra.storage.local.LocalDiskStorage
-
Creates the bucket if not exists already, and returns the object for manipulating it
- getOriginPipe() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
- getOutputStream(File, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates an output stream that writes into a file, using the given
FileWriteOptions. - getOutputStream(OutputStream, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Wraps an output stream, adding it options by the given
FileWriteOptions. - getOutputStream(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Gets an output stream for writing to a remote file.
- getOutputStream(String, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Gets an output stream for writing to a remote file.
- getOutputStream(String, int) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- getOwnMetrics() - Method in class org.pipecraft.infra.io.Retrier
- getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
- getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
- getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
- getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.collectors.EventsCollector
- getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
- getOwnMetrics() - Method in interface org.pipecraft.infra.monitoring.JsonMonitorable
- getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.JsonMonitorableMerger
- getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.JsonMonitorableWrapper
- getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.MonitoringTree
- getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.sampling.BlockingSampler
- getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
- getOwnMetrics() - Method in class org.pipecraft.infra.monitoring.SystemHealthMonitorable
- getParentPath(String) - Static method in class org.pipecraft.infra.storage.PathUtils
- getPath() - Method in class org.pipecraft.infra.storage.StoragePath
- getPath(File) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- getPath(T) - Method in class org.pipecraft.infra.storage.Bucket
- getPaths() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
- getPaths() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
- getPercentileValue() - Method in class org.pipecraft.pipes.terminal.PercentilePipe
- getPipeSupplier() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
- getPipeSupplier() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
- getPort() - Method in class org.pipecraft.infra.net.HostPort
- getPort() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
- getPostProcessor() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
- getPostProcessor() - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig
- getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncCallbackPipe
- getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncCompoundPipe
- getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncFilterPipe
- getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncFlexibleMapPipe
- getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncHeadPipe
- getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncMapPipe
- getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncProgressPipe
- getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncTimeoutPipe
- getProgress() - Method in class org.pipecraft.pipes.async.inter.AsyncUnionPipe
- getProgress() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerPipe
- getProgress() - Method in class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
- getProgress() - Method in class org.pipecraft.pipes.async.source.AsyncEmptyPipe
- getProgress() - Method in class org.pipecraft.pipes.async.source.AsyncSeqGenPipe
- getProgress() - Method in interface org.pipecraft.pipes.BasePipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.ConcatPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.CountPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.HeadPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.MapPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.OrderValidationPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.ProgressPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.SkipPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.SortedIntersectionPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.SortedMergePipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.SortedSubtractionPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.SortedUnionPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.SortPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.inter.TopKPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.source.EmptyPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.source.ErrorPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.source.IteratorReaderPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.source.ReaderPipe
- getProgress() - Method in class org.pipecraft.pipes.sync.source.SeqGenPipe
- getProgress() - Method in class org.pipecraft.pipes.terminal.AsyncConsumerPipe
- getProgress() - Method in class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
- getProgress() - Method in class org.pipecraft.pipes.terminal.AsyncSharderPipe
- getProgress() - Method in class org.pipecraft.pipes.terminal.CompoundTerminalPipe
- getProgress() - Method in class org.pipecraft.pipes.terminal.ParallelConsumerPipe
- getProgress() - Method in class org.pipecraft.pipes.terminal.QueueWriterPipe
- getProgress() - Method in class org.pipecraft.pipes.terminal.TerminalPipe
- getProtocol() - Method in class org.pipecraft.infra.storage.local.LocalDiskStorage
- getProtocol() - Method in interface org.pipecraft.infra.storage.Storage
- getProtocol() - Method in class org.pipecraft.infra.storage.StoragePath
- getProtocolFromFullyQualifiedPath(String) - Static method in class org.pipecraft.infra.storage.PathUtils
-
Gets a fully qualified path ({protocol}://{bucket}/{path}) and returns the protocol name (e.g.
- getReader(File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered reader from a given file, using UTF8.
- getReader(File, Charset) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered reader from a given file.
- getReader(File, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered reader from a given file.
- getReader(File, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered reader from a given file, using UTF8.
- getReader(InputStream) - Static method in class org.pipecraft.infra.io.FileUtils
-
Wraps an input stream and converts it to a reader.
- getReader(InputStream, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Wraps an input stream and converts it to a reader.
- getReaderFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered reader from a given file, using UTF8.
- getReaderFromClasspath(String, Charset) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered reader from a given file.
- getReaderFromClasspath(String, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered reader from a given file.
- getReaderFromClasspath(String, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered reader from a given file, using UTF8.
- getRecord(int) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
- getRight() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
- getRunning() - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
- getRunning() - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
- getRunning() - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
- getRunningCount() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
- getRuntimeException() - Method in exception org.pipecraft.pipes.exceptions.InternalPipeException
- getSetFromReader(Reader) - Static method in class org.pipecraft.infra.io.FileUtils
-
Utility for loading the lines from a reader, into a deduped set
- getShardByHash(Object, int) - Static method in class org.pipecraft.infra.math.ArithmeticUtils
- getShardByStrongHash(byte[], int) - Static method in class org.pipecraft.infra.math.ArithmeticUtils
-
Similar to getShardByHash, but uses 64 bit hash and a stronger hashing algorithm and to achieve better balancing of shards
- getShardCount() - Method in class org.pipecraft.pipes.utils.ShardSpecifier
- getShardFor(String) - Method in class org.pipecraft.infra.math.UUIDRangeSplitter
-
Finds the shard corresponding to a given UUID
- getShardFunc() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
- getShardIndex() - Method in class org.pipecraft.pipes.utils.ShardSpecifier
- getShardSizes() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
- getShardSizes() - Method in class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
- getShardSizes() - Method in class org.pipecraft.pipes.terminal.AsyncSharderPipe
- getShardSizes() - Method in class org.pipecraft.pipes.terminal.SharderByItemPipe
- getShardSizes() - Method in class org.pipecraft.pipes.terminal.SharderBySeqPipe
- getShardSpecifier() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
- getShardSpecifier() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
- getSingleLeft() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
-
Assumes that there's at most one matching item on left side.
- getSingleRight() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
-
Assumes that there's only one right pipe and at most one matching item in it.
- getSize() - Method in class org.pipecraft.infra.io.SizedInputStream
- getSliced(String, File) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a file from cloud storage, using sliced download.
- getSliced(String, File, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Downloads a file from cloud storage, using sliced download.
- getSlotsCount() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
- getSlotTime() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
- getSlotTimeUnit() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
- getSnapshot() - Method in class org.pipecraft.infra.monitoring.sampling.BlockingSampler
- getSnapshot() - Method in class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
- getSnapshot() - Method in interface org.pipecraft.infra.monitoring.sampling.Sampler
- getStats(E) - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
- getStatus() - Method in class org.pipecraft.pipes.async.AsyncPipe
- getStatusCode() - Method in exception org.pipecraft.pipes.exceptions.HttpPipeException
- getStringFromClasspath(String) - Static method in class org.pipecraft.infra.io.FileUtils
-
Utility for loading string from classpath files
- getSystemDefaultTmpFolder() - Static method in class org.pipecraft.infra.io.FileUtils
- getThreadNum() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
- getThreadNum() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
- getTmpFolder() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
- getTotalCompletedCount() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
- getTotalDurationMicros() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
- getTotalDurationMicros(E) - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
- getTotalDurationMicros(E) - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
- getTotalDurationMicros(E) - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
- getTotalSizeRecursive(File) - Static method in class org.pipecraft.infra.io.FileUtils
- getUnionProbability(List<Double>) - Static method in class org.pipecraft.infra.math.ArithmeticUtils
-
Uses the inclusion-exclusion principle to calculate the probability of a union of independent events Ei, each having a probability Pi (P(E1-n) = P1 +P2 + Pn -P1P2 -P2P3 -P1P3 ...
- getWindowTimeSpanMs() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
- getWorkers() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
- getWorkerShardId(List<HostPort>, int) - Static method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerPipe
-
Deprecated.Use DistributedShufflerConfig.getWorkerShardId(..) instead
- getWorkerShardId(HostPort) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig
-
Utility function
- getWriter(File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered writer for a given file, using UTF8 and default file writing settings (See
FileWriteOptions). - getWriter(File, Charset) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered writer for a given file, using default file writing settings (See
FileWriteOptions). - getWriter(File, Charset, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered writer for a given file.
- getWriter(File, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Creates a new buffered writer for a given file, using UTF8.
- getWriter(OutputStream, Charset, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Wraps a gives output stream, setting the requires write options It's recommended to call this method from within a try-with-resources block.
- GraphiteClient - Class in org.pipecraft.infra.monitoring.graphite
-
A simple graphite client that sends metrics to graphite server.
- GraphiteClient(String, int, String) - Constructor for class org.pipecraft.infra.monitoring.graphite.GraphiteClient
-
C-tor
- GraphiteException - Exception in org.pipecraft.infra.monitoring.graphite
-
Graphite exception
- GraphiteException(String) - Constructor for exception org.pipecraft.infra.monitoring.graphite.GraphiteException
- GraphiteException(String, Throwable) - Constructor for exception org.pipecraft.infra.monitoring.graphite.GraphiteException
- GrouperPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
Splits the input items into different families, and emits items from the same family sequentially.
- GrouperPipe(Pipe<T>, FailableFunction<T, ?, PipeException>, CodecFactory<T>, int, File) - Constructor for class org.pipecraft.pipes.sync.inter.GrouperPipe
-
Constructor
- gunzip(File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Decompresses a given file (from gz), leaving the original
- GZ_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
- gzip(File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Compresses a given file (to gz), leaving the original
- GZIP - org.pipecraft.infra.io.Compression
H
- hashCode() - Method in class org.pipecraft.infra.net.HostPort
- hashCode() - Method in class org.pipecraft.infra.storage.StoragePath
- hashCode() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
- hashCode() - Method in class org.pipecraft.pipes.utils.ShardSpecifier
- HashJoinPipe<K,L,R> - Class in org.pipecraft.pipes.sync.inter.join
-
A pipe performing a join operation between a 'left' pipe of type L, and a list of 'right' pipes of type R.
- HashJoinPipe(List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>, int, CodecFactory<R>, File) - Constructor for class org.pipecraft.pipes.sync.inter.join.HashJoinPipe
-
Constructor A constructor for the case of no left pipe.
- HashJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>, JoinMode, int, CodecFactory<L>, CodecFactory<R>, File) - Constructor for class org.pipecraft.pipes.sync.inter.join.HashJoinPipe
-
Constructor
- HashJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, Pipe<R>, FailableFunction<R, K, PipeException>, JoinMode, int, CodecFactory<L>, CodecFactory<R>, File) - Constructor for class org.pipecraft.pipes.sync.inter.join.HashJoinPipe
-
Constructor To be used when there's a single right pipe.
- HashReductorPipe<I,O> - Class in org.pipecraft.pipes.sync.inter.reduct
-
Scans the input pipe and performs a reduction operation on families of items based on some discriminating property.
- HashReductorPipe(Pipe<I>, CodecFactory<I>, int, File, ReductorConfig<I, ?, ?, O>) - Constructor for class org.pipecraft.pipes.sync.inter.reduct.HashReductorPipe
-
Constructor
- HeadPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A pipe returning the first K items of its input pipe.
- HeadPipe(Pipe<T>, int) - Constructor for class org.pipecraft.pipes.sync.inter.HeadPipe
-
Constructor
- HostPort - Class in org.pipecraft.infra.net
-
A util class for representing network
: Immutable. - HostPort(String) - Constructor for class org.pipecraft.infra.net.HostPort
-
CTOR.
- HostPort(String, int) - Constructor for class org.pipecraft.infra.net.HostPort
-
Constructor.
- HttpPipeException - Exception in org.pipecraft.pipes.exceptions
-
An IO pipe exception indicating an error reported by an HTTP server Includes the HTTP status code.
- HttpPipeException(int) - Constructor for exception org.pipecraft.pipes.exceptions.HttpPipeException
- HttpPipeException(int, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.HttpPipeException
I
- identity() - Static method in interface org.pipecraft.infra.concurrent.FailableFunction
-
Similar to Function.identity(), but returns a
FailableFunction - IllegalJsonException - Exception in org.pipecraft.infra.storage
-
A storage exception meaning that a remote json file has illegal structure and can't be deserialized properly.
- IllegalJsonException(String) - Constructor for exception org.pipecraft.infra.storage.IllegalJsonException
- IllegalJsonException(String, Throwable) - Constructor for exception org.pipecraft.infra.storage.IllegalJsonException
- ImmediateFuture<V,E extends Exception> - Class in org.pipecraft.infra.concurrent
-
A checked listenable future that returns a predefined value or throws a predifined exception.
- InaccurateSampler<T> - Class in org.pipecraft.infra.monitoring.sampling
-
A utility for sampling of recent values, using a non-blocking approach for improved performance.
- InaccurateSampler(int) - Constructor for class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
-
Constructor
- InaccurateSampler(int, SampleTextualizer<T>) - Constructor for class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
-
Constructor
- INNER - org.pipecraft.pipes.sync.inter.join.JoinMode
- innerEnd(E, long) - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
-
The specific implementation of the "end" operation
- innerEnd(E, long) - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
- innerEnd(E, long) - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
- innerStart() - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
-
The specific implementation of the "start" operation
- innerStart() - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
- innerStart() - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
- InputStreamPipe<T> - Class in org.pipecraft.pipes.sync.source
-
A base class for source pipes based on some input stream.
- InputStreamPipe(int, Compression) - Constructor for class org.pipecraft.pipes.sync.source.InputStreamPipe
-
Constructor
- instance() - Static method in class org.pipecraft.pipes.sync.source.EmptyPipe
- INT16_BE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
- INT16_BE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
- INT16_LE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
- INT16_LE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
- INT32_BE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
- INT32_BE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
- INT32_LE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
- INT32_LE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
- INT64_BE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
- INT64_BE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
- INT64_LE_DECODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntDecoders
- INT64_LE_ENCODER_FACTORY - Static variable in class org.pipecraft.pipes.serialization.IntEncoders
- IntDecoders - Class in org.pipecraft.pipes.serialization
-
A collection of decoder factories for reading 16, 32 and 64 bit integers
- IntDecoders() - Constructor for class org.pipecraft.pipes.serialization.IntDecoders
- IntEncoders - Class in org.pipecraft.pipes.serialization
-
A collection of encoder factories for writing 16, 32 and 64 bit integers
- IntEncoders() - Constructor for class org.pipecraft.pipes.serialization.IntEncoders
- IntermediateBinFileWriterPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
The intermediate version of
BinFileWriterPipe. - IntermediateBinFileWriterPipe(Pipe<T>, File, FileWriteOptions, EncoderFactory<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateBinFileWriterPipe
-
Constructor
- IntermediateBinFileWriterPipe(Pipe<T>, File, EncoderFactory<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateBinFileWriterPipe
-
Constructor Uses default file write settings (see @{FileWriteOptions})
- IntermediateSharderBySeqPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
An intermediate version of
SharderBySeqPipe - IntermediateSharderBySeqPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
-
Constructor Uses default file write options
- IntermediateSharderBySeqPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
-
Constructor
- IntermediateTxtFileWriterPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A pipe write to a text file any item passed through it.
- IntermediateTxtFileWriterPipe(Pipe<T>, File, Charset, FailableFunction<T, String, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
-
Constructor Uses default file write options.
- IntermediateTxtFileWriterPipe(Pipe<T>, File, Charset, FileWriteOptions) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
-
Constructor Uses the toString as the mapper from the object to String
- IntermediateTxtFileWriterPipe(Pipe<T>, File, Charset, FileWriteOptions, FailableFunction<T, String, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
-
Constructor
- IntermediateTxtFileWriterPipe(Pipe<T>, File, FailableFunction<T, String, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
-
Constructor Uses default file write options and UTF8.
- IntermediateTxtFileWriterPipe(Pipe<T>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
-
Constructor Uses default toString() as the string mapper, and UTF8
- IntermediateTxtFileWriterPipe(Pipe<T>, File, FileWriteOptions, FailableFunction<T, String, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
-
Constructor Uses UTF8
- InternalPipeException - Exception in org.pipecraft.pipes.exceptions
-
A pipe exception resulting from a runtime error.
- InternalPipeException(RuntimeException) - Constructor for exception org.pipecraft.pipes.exceptions.InternalPipeException
- InternalPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.InternalPipeException
- IOPipeException - Exception in org.pipecraft.pipes.exceptions
-
A pipe exception resulting from an IO error
- IOPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.IOPipeException
- IOPipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.IOPipeException
- IOPipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.IOPipeException
- is - Variable in class org.pipecraft.pipes.serialization.AbstractInputStreamItemDecoder
- isAppend() - Method in class org.pipecraft.infra.io.FileWriteOptions
- isBalancedSharding() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
-
Relevant only when automatic sharding is enabled.
- isBalancedSharding() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
-
Relevant only when automatic sharding is enabled.
- isCancelled() - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
- isCancelled() - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
- isDone() - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
- isDone() - Method in class org.pipecraft.infra.concurrent.CheckedFutureTransformer
- isDownloadFirst() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
- isFile(T) - Method in class org.pipecraft.infra.storage.Bucket
- isFilePath(String) - Method in class org.pipecraft.infra.storage.Bucket
- isFolderPath(String) - Method in class org.pipecraft.infra.storage.Bucket
- isOwned(String, ShardSpecifier) - Static method in class org.pipecraft.pipes.utils.multi.MultiFileReaderUtils
- isRecursivePaths() - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig
- isRecursivePaths() - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig
- isTemp() - Method in class org.pipecraft.infra.io.FileWriteOptions
- ItemDecoder<T> - Interface in org.pipecraft.pipes.serialization
-
A functional interface for stateful decoders, decoding object from some binary source.
- ItemEncoder<T> - Interface in org.pipecraft.pipes.serialization
-
A functional interface for stateful encoders, encoding object into some binary destination.
- iterator() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- IteratorReaderPipe<T> - Class in org.pipecraft.pipes.sync.source
-
A pipe based on an iterator.
- IteratorReaderPipe(Iterator<T>) - Constructor for class org.pipecraft.pipes.sync.source.IteratorReaderPipe
-
Constructor
- IteratorReaderPipe(Iterator<T>, Integer) - Constructor for class org.pipecraft.pipes.sync.source.IteratorReaderPipe
-
Constructor
J
- JdbcPipeException - Exception in org.pipecraft.pipes.exceptions
-
A pipe exception due to JDBC related errors
- JdbcPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.JdbcPipeException
- JdbcPipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.JdbcPipeException
- JdbcPipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.JdbcPipeException
- JdbcQueryResultsPipe<T> - Class in org.pipecraft.pipes.sync.source
-
A source pipe reading rows from a DB query result set, and converting them to some entity type
- JdbcQueryResultsPipe(FailableSupplier<Connection, SQLException>, String, FailableFunction<ResultSet, T, SQLException>) - Constructor for class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
-
Constructor
- JoinMode - Enum in org.pipecraft.pipes.sync.inter.join
-
The different join modes supported by join pipes In LEFT mode, all keys from the left pipe (and only them) will be included in the results.
- joinPaths(String, String) - Static method in class org.pipecraft.infra.io.FileUtils
- JoinRecord<K,L,R> - Class in org.pipecraft.pipes.sync.inter.join
-
An item returned by the
SortedJoinPipe. - JsonMonitorable - Interface in org.pipecraft.infra.monitoring
-
To be implemented by classes that can "export" their state (or part of it) as Json.
- JsonMonitorableMerger - Class in org.pipecraft.infra.monitoring
-
A simple JsonMonitorable implementation that joins a set of other JsonMonitorables.
- JsonMonitorableMerger(JsonMonitorable...) - Constructor for class org.pipecraft.infra.monitoring.JsonMonitorableMerger
-
Constructor
- JsonMonitorableWrapper - Class in org.pipecraft.infra.monitoring
-
A simple JsonMonitorable implementation that wraps a set of child monitorables and adds own metrics.
- JsonMonitorableWrapper(Map<String, ? extends JsonMonitorable>) - Constructor for class org.pipecraft.infra.monitoring.JsonMonitorableWrapper
- JsonMonitorableWrapper(JSONObject) - Constructor for class org.pipecraft.infra.monitoring.JsonMonitorableWrapper
- JsonMonitorableWrapper(JSONObject, Map<String, ? extends JsonMonitorable>) - Constructor for class org.pipecraft.infra.monitoring.JsonMonitorableWrapper
L
- LEFT - org.pipecraft.pipes.sync.inter.join.JoinMode
- lineCount(File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Counts lines in a file, which is assumed to be UTF8, not compressed.
- lineCount(File, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
- listenTo(ListenableFuture<T>, Consumer<? super T>, Consumer<Throwable>) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
-
Adds a completion listener to a given
ListenableFuture. - listenTo(ListenableFuture<T>, Consumer<? super T>, Consumer<Throwable>, Executor) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
-
Adds a completion listener to a given
ListenableFuture - listenTo(ListenableFuture<T>, Logger, Level, Level, String) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionLogger
-
Adds a logging listener (SLF4J) to a given
ListenableFuture. - listenToError(ListenableFuture<?>, Consumer<Throwable>) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
-
Adds an error listener to a given
ListenableFuture. - listenToError(ListenableFuture<?>, Consumer<Throwable>, Executor) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
-
Adds an error listener to a given
ListenableFuture - listenToError(ListenableFuture<T>, Logger, Level, String) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionLogger
-
Adds a logging listener (SLF4J) on error events to a given
ListenableFuture. - listenToSuccess(ListenableFuture<T>, Consumer<? super T>) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
-
Adds a successful completion listener to a given
ListenableFuture. - listenToSuccess(ListenableFuture<T>, Consumer<? super T>, Executor) - Static method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
-
Adds a successful completion listener to a given
ListenableFuture - listFiles(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Lists all files directly under the given path (excluding folders)
- listFiles(String, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Lists all files directly under the given path that match the regular expression.
- listFiles(String, Pattern) - Method in class org.pipecraft.infra.storage.Bucket
-
Lists all files that match the regex pattern and are located directly under the given path
- listFilesRecursive(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Returns an iterator for all the files in a given remote folder, recursively.
- listFilesRecursive(String, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Returns an iterator for all the files in a given remote folder matching the pattern, recursively.
- listFilesRecursive(String, Pattern) - Method in class org.pipecraft.infra.storage.Bucket
-
Returns an iterator for all the files in a given remote folder matching a regex pattern, recursively.
- listFolders(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Lists all sub-folders in the given path
- listObjects(String) - Method in class org.pipecraft.infra.storage.Bucket
- listObjects(String, boolean) - Method in class org.pipecraft.infra.storage.Bucket
- listObjects(String, boolean) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- listObjects(String, Predicate<T>) - Method in class org.pipecraft.infra.storage.Bucket
-
Creates an iterator of all objects directly under provided path that satisfy the provided condition
- ListReductorPipe<S,T> - Class in org.pipecraft.pipes.sync.inter.reduct
-
Scans the input pipe and groups sequential items based on some discriminating property.
- ListReductorPipe(Pipe<S>, FailableFunction<S, ?, PipeException>, Function<List<S>, T>) - Constructor for class org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe
-
Constructor Creates a sequence reductor pipe with no protective threshold on group sizes.
- ListReductorPipe(Pipe<S>, FailableFunction<S, ?, PipeException>, Function<List<S>, T>, int, ListReductorPipe.GroupSizeLimitPolicy) - Constructor for class org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe
-
Constructor
- ListReductorPipe.GroupSizeLimitPolicy - Enum in org.pipecraft.pipes.sync.inter.reduct
- LocalDiskBucket - Class in org.pipecraft.infra.storage.local
-
A bucket implementation pointing to a local disk folder.
- LocalDiskStorage - Class in org.pipecraft.infra.storage.local
-
A storage implementation for working on local disk.
- LocalDiskStorage(File) - Constructor for class org.pipecraft.infra.storage.local.LocalDiskStorage
-
Constructor
- LocalMultiFileReaderConfig<T> - Class in org.pipecraft.pipes.utils.multi
-
A builder + configuration for pipes reading multiple local files.
- LocalMultiFileReaderConfig.Builder<T> - Class in org.pipecraft.pipes.utils.multi
- LockFreeBlockingQueue<E> - Class in org.pipecraft.infra.concurrent
-
A blocking queue implementation which wraps the efficient ConcurrentLinkedQueue, and adds adaptive yields/sleeps in order to achieve a blocking behavior without using locks.
- LockFreeBlockingQueue(int) - Constructor for class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
-
Constructor
- LookupJoinPipe<K,L,R> - Class in org.pipecraft.pipes.sync.inter.join
-
A pipe performing a join operation between a 'left' pipe of type L, and a list of 'right' pipes of type R.
- LookupJoinPipe(List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
-
Constructor A constructor for the case of no left pipe.
- LookupJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>, JoinMode) - Constructor for class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
-
Constructor
- LookupJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, Pipe<R>, FailableFunction<R, K, PipeException>, JoinMode) - Constructor for class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
-
Constructor To be used when there's a single right pipe.
- LZ4 - org.pipecraft.infra.io.Compression
M
- map(Exception) - Method in class org.pipecraft.infra.concurrent.AbstractCheckedFuture
-
Maps a checked exception originating from the underlying computation into the standard exception type E.
- map(Exception) - Method in class org.pipecraft.infra.concurrent.ImmediateFuture
- MapPipe<S,T> - Class in org.pipecraft.pipes.sync.inter
-
A pipe transforming each item in the input pipe into another, possibly with a different type.
- MapPipe(Pipe<S>, FailableFunction<? super S, T, PipeException>) - Constructor for class org.pipecraft.pipes.sync.inter.MapPipe
-
constructor
- mark(int) - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
- MonitoringTree - Class in org.pipecraft.infra.monitoring
-
A hierarchy of JsonMonitorable objects.
- MonitoringTree() - Constructor for class org.pipecraft.infra.monitoring.MonitoringTree
- moveFolderRecursive(String, String, int) - Method in class org.pipecraft.infra.storage.Bucket
-
Moves all files from one folder to another, recursively.
- moveFolderRecursive(String, String, int, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Moves all files from one folder to another, recursively.
- moveInterruptibly(String, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Moves a file from one location to another, using retries with default settings.
- moveInterruptibly(String, String, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Moves a file from one location to another, using retries.
- MultiFileReaderPipe<T> - Class in org.pipecraft.pipes.sync.source
-
A source pipe reading multiple local binary files.
- MultiFileReaderPipe(LocalMultiFileReaderConfig<T>) - Constructor for class org.pipecraft.pipes.sync.source.MultiFileReaderPipe
-
Constructor
- MultiFileReaderUtils - Class in org.pipecraft.pipes.utils.multi
-
Shared helper methods for multi-file reader pipes.
- MultiFileReaderUtils() - Constructor for class org.pipecraft.pipes.utils.multi.MultiFileReaderUtils
- MultiQuantileDigest - Class in org.pipecraft.infra.monitoring.quantile
-
Thread Safe high-throughput quantile and cdf estimation.
- MultiQuantileDigest(int) - Constructor for class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Constructor with default values
- MultiQuantileDigest(int, double) - Constructor for class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Constructor with default values
- MultiQuantileDigest(int, double, double) - Constructor for class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Fully specified constructor
- MultiSortedBasePipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A base class for pipes performing some set operation on a collection of sorted input pipes.
- MultiSortedBasePipe(Comparator<? super T>, Pipe<T>...) - Constructor for class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
-
Constructor
- MultiSortedBasePipe(List<? extends Pipe<T>>, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
-
Constructor
- MultiTxtFileReaderPipe - Class in org.pipecraft.pipes.sync.source
-
Reads data from multiple files in local disk under some folder, as if they were concatenated using some predefined order.
- MultiTxtFileReaderPipe(File) - Constructor for class org.pipecraft.pipes.sync.source.MultiTxtFileReaderPipe
-
Constructor Assumes UTF8, no file filtering, default buffer size and lexicographic order of files
- MultiTxtFileReaderPipe(File, Charset, int, String, Comparator<File>) - Constructor for class org.pipecraft.pipes.sync.source.MultiTxtFileReaderPipe
-
Constructor
- MultiTxtFileReaderPipe(File, Comparator<File>) - Constructor for class org.pipecraft.pipes.sync.source.MultiTxtFileReaderPipe
-
Constructor Assumes UTF8, no file filtering and default buffer size
N
- NDJSON_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
- negate() - Method in interface org.pipecraft.infra.concurrent.FailablePredicate
- newByteArrayDecoder() - Method in interface org.pipecraft.pipes.serialization.DecoderFactory
- newByteArrayDecoder() - Method in class org.pipecraft.pipes.serialization.SimpleDecoderFactory
- newByteArrayDecoder() - Method in class org.pipecraft.pipes.serialization.TxtDecoderFactory
- newByteArrayEncoder() - Method in interface org.pipecraft.pipes.serialization.EncoderFactory
- newByteArrayEncoder() - Method in class org.pipecraft.pipes.serialization.SimpleEncoderFactory
- newByteArrayEncoder() - Method in class org.pipecraft.pipes.serialization.TxtEncoderFactory
- newDecoder(InputStream) - Method in interface org.pipecraft.pipes.serialization.DecoderFactory
- newDecoder(InputStream, FileReadOptions) - Method in class org.pipecraft.pipes.serialization.AvroCodecFactory
- newDecoder(InputStream, FileReadOptions) - Method in interface org.pipecraft.pipes.serialization.DecoderFactory
- newDecoder(InputStream, FileReadOptions) - Method in class org.pipecraft.pipes.serialization.DelegatingCodecFactory
- newDecoder(InputStream, FileReadOptions) - Method in class org.pipecraft.pipes.serialization.SimpleDecoderFactory
- newDecoder(InputStream, FileReadOptions) - Method in class org.pipecraft.pipes.serialization.TxtDecoderFactory
- newEncoder(OutputStream) - Method in interface org.pipecraft.pipes.serialization.EncoderFactory
- newEncoder(OutputStream, FileWriteOptions) - Method in class org.pipecraft.pipes.serialization.AvroCodecFactory
- newEncoder(OutputStream, FileWriteOptions) - Method in class org.pipecraft.pipes.serialization.DelegatingCodecFactory
- newEncoder(OutputStream, FileWriteOptions) - Method in interface org.pipecraft.pipes.serialization.EncoderFactory
- newEncoder(OutputStream, FileWriteOptions) - Method in class org.pipecraft.pipes.serialization.SimpleEncoderFactory
- newEncoder(OutputStream, FileWriteOptions) - Method in class org.pipecraft.pipes.serialization.TxtEncoderFactory
- newEvent(E) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
-
Reports a new event
- newEvent(E, R) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
-
Reports a new event to be appended into a given time slot record
- newEvent(Long, SlotRecord) - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
- newEvent(Void, AtomicInteger) - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
- newFixedRecSizeDecoder(InputStream, FileReadOptions, int) - Method in interface org.pipecraft.pipes.serialization.ByteArrayDecoder
-
Returns an efficient
ItemDecoderbased on this byte array decoder, assuming a fixed record size. - newRecord() - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
- newRecord() - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
- newRecord() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
- newRecordArray(int) - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
- newRecordArray(int) - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
- newRecordArray(int) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
- newValue(T) - Method in class org.pipecraft.infra.monitoring.sampling.BlockingSampler
-
Notifies about a new value
- newValue(T) - Method in class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
- newValue(T) - Method in interface org.pipecraft.infra.monitoring.sampling.Sampler
-
Notifies about a new value
- next() - Method in class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.CallbackPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.ConcatPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.CountPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
- next() - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
- next() - Method in class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.HeadPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.IntermediateBinFileWriterPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.MapPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
- next() - Method in class org.pipecraft.pipes.sync.inter.OrderValidationPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.ProgressPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.SkipPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.SortedMergePipe
- next() - Method in class org.pipecraft.pipes.sync.inter.SortPipe
- next() - Method in class org.pipecraft.pipes.sync.inter.TopKPipe
- next() - Method in interface org.pipecraft.pipes.sync.Pipe
- next() - Method in class org.pipecraft.pipes.sync.source.BinInputReaderPipe
- next() - Method in class org.pipecraft.pipes.sync.source.EmptyPipe
- next() - Method in class org.pipecraft.pipes.sync.source.ErrorPipe
- next() - Method in class org.pipecraft.pipes.sync.source.IteratorReaderPipe
- next() - Method in class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
- next() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
- next() - Method in class org.pipecraft.pipes.sync.source.ReaderPipe
- next() - Method in class org.pipecraft.pipes.sync.source.SeqGenPipe
- next() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
- next() - Method in class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
- next() - Method in class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
- next(int) - Method in class org.pipecraft.infra.math.FastRandom
- next(T) - Method in interface org.pipecraft.pipes.async.AsyncPipeListener
-
Notifies that a new item has been produced by the async pipe.
- NonBlockingActionStatsCollector<E extends Enum<E>> - Class in org.pipecraft.infra.monitoring.collectors
-
A statistics collector which uses a non-blocking approach to improve performance.
- NonBlockingActionStatsCollector(Class<E>) - Constructor for class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
-
Constructor
- NONE - org.pipecraft.infra.io.Compression
- normalizeFolderPath(String) - Method in class org.pipecraft.infra.storage.Bucket
-
appends to path "/" if not exist already
- notifyDone() - Method in class org.pipecraft.pipes.async.AsyncPipe
-
Fires the event indicating a successful end of item generation
- notifyError(PipeException) - Method in class org.pipecraft.pipes.async.AsyncPipe
-
Fires the event indicating a non-successful termination of the pipe's work
- notifyNext(T) - Method in class org.pipecraft.pipes.async.AsyncPipe
-
Fires the event indicating a new item.
O
- ofError(E) - Static method in class org.pipecraft.infra.concurrent.ImmediateFuture
- offer(E) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- offer(E, long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- ofValue(V) - Static method in class org.pipecraft.infra.concurrent.ImmediateFuture
- or(FailablePredicate<? super T, ? extends E>) - Method in interface org.pipecraft.infra.concurrent.FailablePredicate
-
Returns a composed predicate that represents a short-circuiting logical OR of this predicate and another.
- OrderValidationPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
An intermediate pipe that validates the order of the consumed elements by a comparator
- OrderValidationPipe(Pipe<T>, Comparator<T>) - Constructor for class org.pipecraft.pipes.sync.inter.OrderValidationPipe
-
Constructor
- org.pipecraft.infra.concurrent - package org.pipecraft.infra.concurrent
- org.pipecraft.infra.io - package org.pipecraft.infra.io
- org.pipecraft.infra.math - package org.pipecraft.infra.math
- org.pipecraft.infra.monitoring - package org.pipecraft.infra.monitoring
- org.pipecraft.infra.monitoring.collectors - package org.pipecraft.infra.monitoring.collectors
- org.pipecraft.infra.monitoring.graphite - package org.pipecraft.infra.monitoring.graphite
- org.pipecraft.infra.monitoring.quantile - package org.pipecraft.infra.monitoring.quantile
- org.pipecraft.infra.monitoring.sampling - package org.pipecraft.infra.monitoring.sampling
- org.pipecraft.infra.monitoring.sliding - package org.pipecraft.infra.monitoring.sliding
- org.pipecraft.infra.net - package org.pipecraft.infra.net
- org.pipecraft.infra.sets - package org.pipecraft.infra.sets
- org.pipecraft.infra.storage - package org.pipecraft.infra.storage
- org.pipecraft.infra.storage.local - package org.pipecraft.infra.storage.local
- org.pipecraft.pipes - package org.pipecraft.pipes
- org.pipecraft.pipes.async - package org.pipecraft.pipes.async
- org.pipecraft.pipes.async.inter - package org.pipecraft.pipes.async.inter
- org.pipecraft.pipes.async.inter.distributed - package org.pipecraft.pipes.async.inter.distributed
- org.pipecraft.pipes.async.source - package org.pipecraft.pipes.async.source
- org.pipecraft.pipes.exceptions - package org.pipecraft.pipes.exceptions
- org.pipecraft.pipes.serialization - package org.pipecraft.pipes.serialization
- org.pipecraft.pipes.sync - package org.pipecraft.pipes.sync
- org.pipecraft.pipes.sync.inter - package org.pipecraft.pipes.sync.inter
- org.pipecraft.pipes.sync.inter.join - package org.pipecraft.pipes.sync.inter.join
- org.pipecraft.pipes.sync.inter.reduct - package org.pipecraft.pipes.sync.inter.reduct
- org.pipecraft.pipes.sync.inter.sample - package org.pipecraft.pipes.sync.inter.sample
- org.pipecraft.pipes.sync.source - package org.pipecraft.pipes.sync.source
- org.pipecraft.pipes.terminal - package org.pipecraft.pipes.terminal
- org.pipecraft.pipes.utils - package org.pipecraft.pipes.utils
- org.pipecraft.pipes.utils.multi - package org.pipecraft.pipes.utils.multi
- os - Variable in class org.pipecraft.pipes.serialization.AbstractOutputStreamItemEncoder
- OUTER - org.pipecraft.pipes.sync.inter.join.JoinMode
- OutOfOrderPipeException - Exception in org.pipecraft.pipes.exceptions
-
Indicates that the ordering of items in a pipe was not as expected
- OutOfOrderPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.OutOfOrderPipeException
-
Constructor
- OutOfOrderPipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.OutOfOrderPipeException
-
Constructor
- OutOfOrderPipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.OutOfOrderPipeException
-
Constructor
P
- ParallelConsumerPipe - Class in org.pipecraft.pipes.terminal
-
A terminal pipe that consumes multiple input pipes in a parallel manner, with a configurable number of threads.
- ParallelConsumerPipe(int, Collection<? extends BasePipe>) - Constructor for class org.pipecraft.pipes.terminal.ParallelConsumerPipe
-
Constructor
- ParallelConsumerPipe(int, Collection<? extends BasePipe>, Runnable) - Constructor for class org.pipecraft.pipes.terminal.ParallelConsumerPipe
-
Constructor
- ParallelConsumerPipe(int, BasePipe...) - Constructor for class org.pipecraft.pipes.terminal.ParallelConsumerPipe
-
Constructor
- ParallelTaskProcessor - Class in org.pipecraft.infra.concurrent
-
Processes a heavy task (typically with IO involved) in parallel.
- ParallelTaskProcessor() - Constructor for class org.pipecraft.infra.concurrent.ParallelTaskProcessor
- parseFullyQualifiedPath(String) - Static method in class org.pipecraft.infra.storage.PathUtils
-
Parses a fully qualified path and returns the protocol+bucket+key triplet.
- paths(File...) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- paths(String) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- paths(String) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- paths(String...) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- paths(String...) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- paths(String, boolean) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- paths(String, boolean) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- paths(Collection<String>) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- paths(Collection<String>) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- paths(Collection<String>, boolean) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- paths(Collection<String>, boolean) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- PathUtils - Class in org.pipecraft.infra.storage
-
A set of utility methods for working with storage paths
- PathUtils() - Constructor for class org.pipecraft.infra.storage.PathUtils
- peek() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- peek() - Method in class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.CallbackPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.ConcatPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.CountPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.HeadPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.MapPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.OrderValidationPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.ProgressPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.SkipPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.SortedMergePipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.SortPipe
- peek() - Method in class org.pipecraft.pipes.sync.inter.TopKPipe
- peek() - Method in interface org.pipecraft.pipes.sync.Pipe
- peek() - Method in class org.pipecraft.pipes.sync.source.BinInputReaderPipe
- peek() - Method in class org.pipecraft.pipes.sync.source.EmptyPipe
- peek() - Method in class org.pipecraft.pipes.sync.source.ErrorPipe
- peek() - Method in class org.pipecraft.pipes.sync.source.IteratorReaderPipe
- peek() - Method in class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
- peek() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
- peek() - Method in class org.pipecraft.pipes.sync.source.ReaderPipe
- peek() - Method in class org.pipecraft.pipes.sync.source.SeqGenPipe
- peek() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
- peek() - Method in class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
- peek() - Method in class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
- PercentilePipe<T,C extends Comparable<C>> - Class in org.pipecraft.pipes.terminal
-
A terminal pipe that finds a given percentile p in the input pipe.
- PercentilePipe(Pipe<T>, double, Function<T, C>) - Constructor for class org.pipecraft.pipes.terminal.PercentilePipe
-
Constructor
- Pipe<T> - Interface in org.pipecraft.pipes.sync
-
The interface to be implemented by synchronous pipes, which are passive and items are "pulled" from them.
- PipeException - Exception in org.pipecraft.pipes.exceptions
-
Indicates an error during data fetching/processing/writing of a pipeline This is the surertype for all pipe exceptions.
- PipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.PipeException
-
Constructor
- PipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.PipeException
-
Constructor
- PipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.PipeException
-
Constructor
- PipeFactory<P,T> - Interface in org.pipecraft.pipes.utils
-
An interface for pipe creation based on some parameter.
- PipeReaderSupplier<T,M> - Interface in org.pipecraft.pipes.utils
-
An interface for reader pipe creators.
- PipeSupplier<T> - Interface in org.pipecraft.pipes.utils
-
An interface for pipe creators.
- PipeUtils - Class in org.pipecraft.pipes.utils
-
A collection of pipe utility functions
- PipeUtils() - Constructor for class org.pipecraft.pipes.utils.PipeUtils
- poll() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- poll(long, TimeUnit) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- port(int) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
- PortionSamplerPipe<T> - Class in org.pipecraft.pipes.sync.inter.sample
-
A pipe sampling about x% of the incoming items.
- PortionSamplerPipe(Pipe<T>, double) - Constructor for class org.pipecraft.pipes.sync.inter.sample.PortionSamplerPipe
-
Constructor
- PortionSamplerPipe(Pipe<T>, double, Random) - Constructor for class org.pipecraft.pipes.sync.inter.sample.PortionSamplerPipe
-
Constructor
- postProcessor(Function<G, O>) - Method in class org.pipecraft.pipes.sync.inter.reduct.ReductorConfig.Builder
- prepareNext() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
- ProgressPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A no-op pipe with only one side effect - progress tracking.
- ProgressPipe(Pipe<T>, int, Consumer<Integer>) - Constructor for class org.pipecraft.pipes.sync.inter.ProgressPipe
-
Constructor
- ProgressTransformer - Class in org.pipecraft.pipes.utils
-
A progress listener wrapping another progress listener, allowing filtering of progress events and changing the reported progress range.
- ProgressTransformer(Consumer<Integer>, int) - Constructor for class org.pipecraft.pipes.utils.ProgressTransformer
-
Constructor
- ProgressTransformer(Consumer<Integer>, int, int) - Constructor for class org.pipecraft.pipes.utils.ProgressTransformer
-
Constructor
- ProgressTransformer(Consumer<Integer>, int, int, int) - Constructor for class org.pipecraft.pipes.utils.ProgressTransformer
-
Constructor
- publishToJournal() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Squash live digest(s) and add to journal as latest entry.
- put(E) - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- put(String, InputStream, long, String, boolean) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads data into a remote file from a given
InputStream. - put(String, InputStream, long, String, boolean, boolean) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads data into a remote file from a given
InputStream - put(String, InputStream, long, String, boolean, boolean) - Method in class org.pipecraft.infra.storage.local.LocalDiskBucket
- putAllInterruptibly(String, File, int, boolean) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads all regular files from a given folder.
- putAllInterruptibly(String, File, int, boolean, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads all regular files from a given folder.
- putAllRecursiveInterruptibly(String, File, int, boolean) - Method in class org.pipecraft.infra.storage.Bucket
-
uploads a complete local folder to the cloud, recursively.
- putAllRecursiveInterruptibly(String, File, int, boolean, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
uploads a complete local folder to the cloud, recursively.
- putDoneFile(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Put a _DONE file in a given cloud folder.
- putEmptyFile(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Writes an empty file to the given path, setting private access.
- putFile(String, File, boolean) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads file to given path
- putFileInterruptibly(String, File, boolean) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads file to given path, with retries.
- putFileInterruptibly(String, File, boolean, int, int, double) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads file to given path, with retries
- putLockFile(String) - Method in class org.pipecraft.infra.storage.Bucket
-
Writes a file in an exclusive manner, providing lock semantics.
- putPrivate(String, File) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads file to given path and sets private read access
- putPrivate(String, InputStream, long, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads file from InputStream and sets private read access
- putPublic(String, File) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads file to given path and sets public read access
- putPublic(String, InputStream, long, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads file from InputStream and sets public read access
- putUniquePrivate(String, File) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads file, using an auto generated key, to given remote folder and sets private read access
- putUniquePrivate(String, InputStream, long, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads file from InputStream to unique key under given path and sets private read access
- putUniquePrivate(String, InputStream, String, long, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads a file from InputStream to a unique key under the given path and sets private read access.
- putUniquePublic(String, File) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads file, using an auto generated key, to given remote folder and sets public read access
- putUniquePublic(String, InputStream, long, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads file from InputStream to unique key under given path and sets public read access
- putUniquePublic(String, InputStream, String, long, String) - Method in class org.pipecraft.infra.storage.Bucket
-
Uploads a file from InputStream to a unique key under the given path and sets public read access.
Q
- quantile(double) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
-
Get an estimate of the quantile at
q. - quantile(double) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Get an estimate of the quantile at
q. - quantile(double) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Get an estimate of the quantile at
q. - quantile(double) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Get an estimate of the quantile at
q. - quantile(List<Double>) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
-
Get an estimated quantile for every value in the input list.
- quantile(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Get an estimated quantile for every value in the input list.
- quantile(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Get an estimated quantile for every value in the input list.
- quantile(List<Double>) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Get an estimated quantile for every value in the input list.
- QuantileDigest - Class in org.pipecraft.infra.monitoring.quantile
-
A synchronized wrapper for
com.tdunning.math.stats.MergingDigestwhich is an implementation of t-digests. - QuantileDigest(double) - Constructor for class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Constructor
- query() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
- query(int) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
- query(AtomicInteger[]) - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
- query(TimeUnit) - Method in class org.pipecraft.infra.monitoring.sliding.EventRateSlidingWindow
- query(SlotRecord[]) - Method in class org.pipecraft.infra.monitoring.sliding.AverageSlidingWindow
- query(R[]) - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
- QueuePipeException - Exception in org.pipecraft.pipes.exceptions
-
Indicates an error found during the pipeline while interacting with producer/consumer queues.
- QueuePipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.QueuePipeException
- QueuePipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.QueuePipeException
- QueuePipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.QueuePipeException
- QueueReaderPipe<T> - Class in org.pipecraft.pipes.sync.source
-
A source pipe reading the contents of a
BlockingQueue. - QueueReaderPipe(BlockingQueue<T>, T, T) - Constructor for class org.pipecraft.pipes.sync.source.QueueReaderPipe
-
Constructor
- QueueWriterPipe<T> - Class in org.pipecraft.pipes.terminal
-
A terminal pipe writing items to a
BlockingQueue. - QueueWriterPipe(Pipe<T>, BlockingQueue<T>, T, T) - Constructor for class org.pipecraft.pipes.terminal.QueueWriterPipe
-
Constructor
R
- read() - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
- read(byte[], int, int) - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
- read(InputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Reads a single mandatory byte from a given stream
- read(InputStream, byte[], int, int) - Static method in class org.pipecraft.infra.io.Coding
-
Reads a given number of bytes from the stream into a given buffer
- read(InputStream, int) - Static method in class org.pipecraft.infra.io.Coding
-
Reads a given number of bytes from the stream into a new buffer
- readBigEndian16(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- readBigEndian16(InputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Reads a 16 bit int from the input stream.
- readBigEndian32(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- readBigEndian32(InputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Reads a 32 bit int from the input stream.
- readBigEndian64(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- readBigEndian64(InputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Reads a 64 bit int from the input stream.
- readCSV(File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Reads and parses a CSV file with no headers.
- readCSV(File, Charset, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Reads and parses a CSV file with no headers.
- readCSV(File, FileReadOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Reads and parses a CSV file with no headers.
- readCSV(Reader) - Static method in class org.pipecraft.infra.io.FileUtils
-
Reads and parses a CSV file with no headers.
- ReaderPipe - Class in org.pipecraft.pipes.sync.source
-
A source pipe that reads lines from a given reader.
- ReaderPipe(Reader) - Constructor for class org.pipecraft.pipes.sync.source.ReaderPipe
-
Constructor
- ReaderPipe(Reader, int) - Constructor for class org.pipecraft.pipes.sync.source.ReaderPipe
-
Constructor
- readLittleEndian16(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- readLittleEndian16(InputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Reads a 16 bit int from the input stream.
- readLittleEndian32(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- readLittleEndian32(InputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Reads a 32 bit int from the input stream.
- readLittleEndian64(byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- readLittleEndian64(InputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Reads a 64 bit int from the input stream.
- readVarint32(byte[], MutableInt) - Static method in class org.pipecraft.infra.io.Coding
-
Reads a varint from a given byte array
- readVarint32(InputStream, MutableInt) - Static method in class org.pipecraft.infra.io.Coding
-
Reads a varint from a given input stream.
- ReductorConfig<I,F,G,O> - Class in org.pipecraft.pipes.sync.inter.reduct
-
A configuration for a reduction operation.
- ReductorConfig.Builder<I,F,G,O> - Class in org.pipecraft.pipes.sync.inter.reduct
- remainingCapacity() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- removeCSVExtension(String) - Static method in class org.pipecraft.infra.io.FileUtils
- removeDotlessExtension(String) - Static method in class org.pipecraft.infra.io.FileUtils
- removeExtension(String) - Static method in class org.pipecraft.infra.io.FileUtils
- reset() - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
- reset() - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Reset the digest.
- reset() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Resets the digest to size zero and returns the final state prior to resetting.
- reset(T) - Method in class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
-
Resets a counter.
- resolveProgress(Pipe<?>, Collection<? extends Pipe<?>>) - Method in enum org.pipecraft.pipes.sync.inter.join.JoinMode
- Retrier - Class in org.pipecraft.infra.io
-
Runs a
FailableInterruptibleRunnableorFailableInterruptibleSupplierwith configurable retries. - Retrier(int, double, int) - Constructor for class org.pipecraft.infra.io.Retrier
-
Constructor
- run() - Method in interface org.pipecraft.infra.concurrent.FailableInterruptibleRunnable
-
Runs the runnable's task
- run() - Method in interface org.pipecraft.infra.concurrent.FailableRunnable
-
Runs the runnable's task
- run() - Method in class org.pipecraft.infra.concurrent.FutureCompletionHandler
- run(Collection<T>, int, Consumer<? super T>) - Static method in class org.pipecraft.infra.concurrent.ParallelTaskProcessor
-
Processed the items in parallel by running a given processor on them.
- run(ExecutorService, Collection<T>, Consumer<? super T>) - Static method in class org.pipecraft.infra.concurrent.ParallelTaskProcessor
-
Processed the items in parallel, by running a given processor on them, using the provided executor.
- run(FailableInterruptibleRunnable<E>) - Method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the retry configuration as defined in the constructor, and using only
RuntimeExceptionandErroras early exit errors. - run(FailableInterruptibleRunnable<E>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the given retry configuration
- run(FailableInterruptibleRunnable<E>, Collection<Class<? extends E>>) - Method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the retry configuration as defined in the constructor
- run(FailableInterruptibleRunnable<E>, Collection<Class<? extends E>>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the given retry configuration
- run(FailableInterruptibleRunnable<E>, Predicate<E>) - Method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the retry configuration as defined in the constructor
- run(FailableInterruptibleRunnable<E>, Predicate<E>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the given retry configuration
- run(FailableInterruptibleSupplier<T, E>) - Method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the retry configuration as defined in the constructor, and using only
RuntimeExceptionandErroras early exit errors. - run(FailableInterruptibleSupplier<T, E>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the given retry configuration
- run(FailableInterruptibleSupplier<T, E>, Collection<Class<? extends E>>) - Method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the retry configuration as defined in the constructor
- run(FailableInterruptibleSupplier<T, E>, Collection<Class<? extends E>>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the given retry configuration
- run(FailableInterruptibleSupplier<T, E>, Predicate<E>) - Method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the retry configuration as defined in the constructor
- run(FailableInterruptibleSupplier<T, E>, Predicate<E>, int, double, int) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the given retry configuration
- runFailable(Collection<T>, int, FailableInterruptibleConsumer<? super T, E>) - Static method in class org.pipecraft.infra.concurrent.ParallelTaskProcessor
-
Processed the items in parallel by running a given processor on them.
- runFailable(ExecutorService, Collection<T>, FailableInterruptibleConsumer<? super T, E>) - Static method in class org.pipecraft.infra.concurrent.ParallelTaskProcessor
-
Processed the items in parallel, by running a given processor on them, using the provided executor.
- runWithDefaults(FailableInterruptibleRunnable<E>) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the default retry configuration
- runWithDefaults(FailableInterruptibleRunnable<E>, Collection<Class<? extends E>>) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the default retry configuration
- runWithDefaults(FailableInterruptibleRunnable<E>, Predicate<E>) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the default retry configuration
- runWithDefaults(FailableInterruptibleSupplier<T, E>) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the default retry configuration
- runWithDefaults(FailableInterruptibleSupplier<T, E>, Collection<Class<? extends E>>) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the default retry configuration
- runWithDefaults(FailableInterruptibleSupplier<T, E>, Predicate<E>) - Static method in class org.pipecraft.infra.io.Retrier
-
Runs the given task with the default retry configuration
S
- sampleLines(File, int, File, int) - Static method in class org.pipecraft.infra.io.FileUtils
-
Uses a streaming sampling algorithm to select M lines from a given file, guaranteeing equal probability for all subsets of the requested sample size (See https://eyalsch.wordpress.com/2010/04/01/random-sample/ for details).
- Sampler<T> - Interface in org.pipecraft.infra.monitoring.sampling
-
Allows sampling values from a stream
- SampleTextualizer<T> - Interface in org.pipecraft.infra.monitoring.sampling
-
Converts sample items into a text representation
- saveFileHead(File, int, File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Saves the head of a given file in another new file/
- schedule(int) - Method in class org.pipecraft.infra.math.StaticJobScheduler
-
Performs the job scheduling, returning the full assignment of jobs to workers.
- sendMetric(String, Number) - Method in class org.pipecraft.infra.monitoring.graphite.GraphiteClient
-
Sends the metric to graphite, under environment root path, in the current timestamp.
- sendMetric(String, Number, long) - Method in class org.pipecraft.infra.monitoring.graphite.GraphiteClient
-
Sends the metric to graphite, under environment root path, in the given timestamp.
- sendMetrics(Map<String, ? extends Number>) - Method in class org.pipecraft.infra.monitoring.graphite.GraphiteClient
-
Sends the metrics to graphite, under environment root path, in the current timestamp.
- sendMetrics(Map<String, ? extends Number>, long) - Method in class org.pipecraft.infra.monitoring.graphite.GraphiteClient
-
Sends the metric to graphite, under environment root path
- SeqGenPipe<T> - Class in org.pipecraft.pipes.sync.source
-
A pipe based on a given sequence generator function.
- SeqGenPipe(Function<Long, T>) - Constructor for class org.pipecraft.pipes.sync.source.SeqGenPipe
-
Constructor
- SeqGenPipe(Function<Long, T>, long) - Constructor for class org.pipecraft.pipes.sync.source.SeqGenPipe
-
Constructor
- SequenceReductorPipe<I,O> - Class in org.pipecraft.pipes.sync.inter.reduct
-
Scans the input pipe and performs a reduction operation on a sequence of items with some discriminating property.
- SequenceReductorPipe(Pipe<I>, ReductorConfig<I, ?, ?, O>) - Constructor for class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
-
Constructor
- set(T) - Method in class org.pipecraft.infra.concurrent.SettableListenableFuture
- setCategoryCounts(E, long) - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
-
Sets the count for a specific category.
- setCategoryStats(E, long, long) - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
-
Sets the statistics for a specific category.
- setCompression(Compression) - Method in class org.pipecraft.infra.io.FileReadOptions
-
Sets the compression of the file
- setCompression(Compression) - Method in class org.pipecraft.infra.io.FileWriteOptions
-
Sets the compression of the file
- setCompression(Compression, int) - Method in class org.pipecraft.infra.io.FileWriteOptions
-
Sets the compression of the file
- setException(Throwable) - Method in class org.pipecraft.infra.concurrent.SettableListenableFuture
- setListener(AsyncPipeListener<? super T>) - Method in class org.pipecraft.pipes.async.AsyncPipe
-
Sets the listener on produced items and other lifecycle events.
- setRunningCount(int) - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
- SettableListenableFuture<T> - Class in org.pipecraft.infra.concurrent
-
The future implementation to be used in cases where a class is responsible for setting the Future's outcome (value/exception), and the future should be a
ListenableFuture. - SettableListenableFuture() - Constructor for class org.pipecraft.infra.concurrent.SettableListenableFuture
- shard(ShardSpecifier) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- shard(ShardSpecifier) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- shard(ShardSpecifier, boolean) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- shard(ShardSpecifier, boolean) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- shardBy(Function<T, Object>) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
- SharderByHashPipe<T> - Class in org.pipecraft.pipes.terminal
-
A terminal pipe that splits the contents of the input pipe into multiple files, according to a hash on a some feature of the item.
- SharderByHashPipe(Pipe<T>, EncoderFactory<T>, FailableFunction<? super T, ?, PipeException>, int, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.SharderByHashPipe
-
Constructor
- SharderByHashPipe(Pipe<T>, EncoderFactory<T>, FailableFunction<? super T, ?, PipeException>, Function<Integer, String>, int, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.SharderByHashPipe
-
Constructor
- SharderByItemPipe<T> - Class in org.pipecraft.pipes.terminal
-
A terminal pipe that splits the contents of the input pipe into multiple files, according to some sharding criteria based on each item.
- SharderByItemPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File) - Constructor for class org.pipecraft.pipes.terminal.SharderByItemPipe
-
Constructor
- SharderByItemPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.SharderByItemPipe
-
Constructor
- SharderBySeqPipe<T> - Class in org.pipecraft.pipes.terminal
-
A terminal pipe that splits the contents of the input pipe according to some criteria which breaks the input pipe into disjoint contiguous sequences.
- SharderBySeqPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File) - Constructor for class org.pipecraft.pipes.terminal.SharderBySeqPipe
-
Constructor Uses default file write options
- SharderBySeqPipe(Pipe<T>, EncoderFactory<? super T>, FailableFunction<? super T, String, PipeException>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.SharderBySeqPipe
-
Constructor
- shardFunc(Function<T, Integer>) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
- ShardSpecifier - Class in org.pipecraft.pipes.utils
-
Specifies a shard index and a total number of shards.
- ShardSpecifier(int, int) - Constructor for class org.pipecraft.pipes.utils.ShardSpecifier
-
Constructor
- shouldOutput(JoinRecord<?, ?, ?>, int) - Method in enum org.pipecraft.pipes.sync.inter.join.JoinMode
- shouldOutput(T, BitSet) - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
-
The method to override for determining whether a visited value should be part of the output or not
- shouldOutput(T, BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedIntersectionPipe
- shouldOutput(T, BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedSubtractionPipe
- shouldOutput(T, BitSet) - Method in class org.pipecraft.pipes.sync.inter.SortedUnionPipe
- shouldSelect(T) - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
- shouldSelect(T) - Method in class org.pipecraft.pipes.sync.inter.FilterPipe
- shouldSelect(T) - Method in class org.pipecraft.pipes.sync.inter.sample.ExactSamplerPipe
- shouldSelect(T) - Method in class org.pipecraft.pipes.sync.inter.sample.PortionSamplerPipe
- shutdown() - Method in class org.pipecraft.infra.monitoring.sliding.SlidingWindow
-
Terminates the sliding window.
- SimpleDecoderFactory<T> - Class in org.pipecraft.pipes.serialization
-
A simple generic decoder factory implementation.
- SimpleDecoderFactory(FailableFunction<InputStream, T, ? extends IOException>) - Constructor for class org.pipecraft.pipes.serialization.SimpleDecoderFactory
-
Constructor
- SimpleDecoderFactory(FailableFunction<InputStream, T, ? extends IOException>, ByteArrayDecoder<T>) - Constructor for class org.pipecraft.pipes.serialization.SimpleDecoderFactory
-
Constructor
- SimpleEncoderFactory<T> - Class in org.pipecraft.pipes.serialization
-
A simple generic encoder factory implementation.
- SimpleEncoderFactory(FailableBiConsumer<T, OutputStream, ? extends IOException>) - Constructor for class org.pipecraft.pipes.serialization.SimpleEncoderFactory
-
Constructor
- SimpleEncoderFactory(FailableBiConsumer<T, OutputStream, ? extends IOException>, ByteArrayEncoder<T>) - Constructor for class org.pipecraft.pipes.serialization.SimpleEncoderFactory
-
Constructor
- SimpleSampleTextualizer<T> - Class in org.pipecraft.infra.monitoring.sampling
-
A sample textualizer that uses the items toString().
- SimpleSampleTextualizer() - Constructor for class org.pipecraft.infra.monitoring.sampling.SimpleSampleTextualizer
- size() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- size() - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
-
Returns the number of samples added to the current Estimator.
- size() - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Returns the number of samples added to the current Estimator.
- size() - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Returns the number of samples added to the current Estimator.
- size() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Returns the number of samples added to the current Estimator.
- size() - Method in class org.pipecraft.infra.monitoring.sampling.BlockingSampler
- size() - Method in class org.pipecraft.infra.monitoring.sampling.InaccurateSampler
- size() - Method in interface org.pipecraft.infra.monitoring.sampling.Sampler
- SizedInputStream - Class in org.pipecraft.infra.io
-
A simple
InputStreamwrapper, that adds awareness to the stream size - SizedInputStream(InputStream, Long) - Constructor for class org.pipecraft.infra.io.SizedInputStream
-
Package protected constructor
- skip(long) - Method in class org.pipecraft.infra.io.ThreadSafeCountingInputStream
- SkipPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A pipe skipping the first K items of its input pipe.
- SkipPipe(Pipe<T>, int) - Constructor for class org.pipecraft.pipes.sync.inter.SkipPipe
-
Constructor
- SlidingWindow<E,R,Q> - Class in org.pipecraft.infra.monitoring.sliding
-
An abstract sliding window.
- SlidingWindow(int, int, TimeUnit, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.sliding.SlidingWindow
-
Constructor
- SlidingWindowQuantileDigest - Class in org.pipecraft.infra.monitoring.quantile
-
High throughput, thread safe, quantile and cdf estimation with a sliding window of time.
- SlidingWindowQuantileDigest(int, double, double, int, int, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Fully specified constructor
- SlidingWindowQuantileDigest(int, double, int, int, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Instantiate with default compressionInflation value
- SlidingWindowQuantileDigest(int, int, int, ScheduledExecutorService) - Constructor for class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Instantiate with default compression and default compressionInflation values
- sort(File, FilenameFilter, File, File, int) - Static method in class org.pipecraft.infra.io.FileUtils
-
Same as {@link this#sort(File, FilenameFilter, File, File, int)}, but enables to supply a
FilenameFilterto exclude files from the provided directory from being sorted. - sort(File, File, File, int) - Static method in class org.pipecraft.infra.io.FileUtils
-
Serves for sorting large files on the file system, limiting the memory used in the process.
- SortedIntersectionPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
An intermediate pipe performing set intersection operation on a collection of sorted input pipes.
- SortedIntersectionPipe(Comparator<? super T>, Pipe<T>...) - Constructor for class org.pipecraft.pipes.sync.inter.SortedIntersectionPipe
-
Constructor
- SortedIntersectionPipe(List<? extends Pipe<T>>, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortedIntersectionPipe
-
Constructor
- SortedJoinPipe<K,L,R> - Class in org.pipecraft.pipes.sync.inter.join
-
A pipe performing a join operation between a 'left' pipe of type L, and a list of 'right' pipes of type R.
- SortedJoinPipe(List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>, Comparator<? super K>) - Constructor for class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
-
Constructor A constructor for the case of no left pipe.
- SortedJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, List<? extends Pipe<R>>, FailableFunction<R, K, PipeException>, Comparator<? super K>, JoinMode) - Constructor for class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
-
Constructor
- SortedJoinPipe(Pipe<L>, FailableFunction<L, K, PipeException>, Pipe<R>, FailableFunction<R, K, PipeException>, Comparator<? super K>, JoinMode) - Constructor for class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
-
Constructor To be used when there's a single right pipe.
- SortedMergePipe<T> - Class in org.pipecraft.pipes.sync.inter
-
An intermediate pipe sort-merging the contents of a collection of sorted input pipes.
- SortedMergePipe(Comparator<? super T>, Pipe<T>...) - Constructor for class org.pipecraft.pipes.sync.inter.SortedMergePipe
-
Constructor
- SortedMergePipe(List<? extends Pipe<T>>, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortedMergePipe
-
Constructor
- SortedSubtractionPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
An intermediate pipe performing a set subtraction operation on two given pipes (i.e.
- SortedSubtractionPipe(Pipe<T>, Pipe<T>, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortedSubtractionPipe
-
Constructor
- SortedUnionPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
An intermediate pipe performing set union operation on a collection of sorted input pipes.
- SortedUnionPipe(Comparator<? super T>, Pipe<T>...) - Constructor for class org.pipecraft.pipes.sync.inter.SortedUnionPipe
-
Constructor
- SortedUnionPipe(List<? extends Pipe<T>>, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortedUnionPipe
-
Constructor
- SortPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
An intermediate pipe performing a sort on an input pipe, without deduping.
- SortPipe(Pipe<T>, int, File, CodecFactory<T>, Comparator<T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortPipe
-
Constructor Uses compression on temp files.
- SortPipe(Pipe<T>, int, File, EncoderFactory<? super T>, DecoderFactory<T>, Comparator<T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortPipe
-
Constructor Uses compression on temp files.
- SortPipe(Pipe<T>, int, File, EncoderFactory<? super T>, DecoderFactory<T>, Comparator<T>, Compression) - Constructor for class org.pipecraft.pipes.sync.inter.SortPipe
-
Constructor
- SortPipe(Pipe<T>, int, CodecFactory<T>, Comparator<T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortPipe
-
Constructor Uses compression on temp files, and uses system default temp folder
- SortPipe(Pipe<T>, Comparator<T>) - Constructor for class org.pipecraft.pipes.sync.inter.SortPipe
-
Constructor Use this constructor for disabling disk usage and sorting in-memory only.
- start() - Method in class org.pipecraft.infra.monitoring.collectors.AbstractActionStatsCollector
- start() - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
-
Indicates that an action has started.
- start() - Method in class org.pipecraft.pipes.async.inter.AsyncCallbackPipe
- start() - Method in class org.pipecraft.pipes.async.inter.AsyncCompoundPipe
- start() - Method in class org.pipecraft.pipes.async.inter.AsyncFilterPipe
- start() - Method in class org.pipecraft.pipes.async.inter.AsyncFlexibleMapPipe
- start() - Method in class org.pipecraft.pipes.async.inter.AsyncHeadPipe
- start() - Method in class org.pipecraft.pipes.async.inter.AsyncMapPipe
- start() - Method in class org.pipecraft.pipes.async.inter.AsyncProgressPipe
- start() - Method in class org.pipecraft.pipes.async.inter.AsyncTimeoutPipe
- start() - Method in class org.pipecraft.pipes.async.inter.AsyncUnionPipe
- start() - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerPipe
- start() - Method in class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
- start() - Method in class org.pipecraft.pipes.async.source.AsyncEmptyPipe
- start() - Method in class org.pipecraft.pipes.async.source.AsyncSeqGenPipe
- start() - Method in interface org.pipecraft.pipes.BasePipe
-
Performs pre-processing prior to item flow throw the pipe.
- start() - Method in class org.pipecraft.pipes.sync.inter.AsyncToSyncPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.CompoundPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.ConcatPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.CountPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.CSVMapperPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.DelegatePipe
- start() - Method in class org.pipecraft.pipes.sync.inter.FilterBasePipe
- start() - Method in class org.pipecraft.pipes.sync.inter.FlexibleMapPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.HeadPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.IntermediateBinFileWriterPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.IntermediateSharderBySeqPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.IntermediateTxtFileWriterPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.join.LookupJoinPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.join.SortedJoinPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.MapPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.MultiSortedBasePipe
- start() - Method in class org.pipecraft.pipes.sync.inter.OrderValidationPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.ProgressPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.reduct.SequenceReductorPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.SkipPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.SortedMergePipe
- start() - Method in class org.pipecraft.pipes.sync.inter.SortPipe
- start() - Method in class org.pipecraft.pipes.sync.inter.TopKPipe
- start() - Method in class org.pipecraft.pipes.sync.source.BinInputReaderPipe
- start() - Method in class org.pipecraft.pipes.sync.source.EmptyPipe
- start() - Method in class org.pipecraft.pipes.sync.source.ErrorPipe
- start() - Method in class org.pipecraft.pipes.sync.source.InputStreamPipe
- start() - Method in class org.pipecraft.pipes.sync.source.IteratorReaderPipe
- start() - Method in class org.pipecraft.pipes.sync.source.JdbcQueryResultsPipe
- start() - Method in class org.pipecraft.pipes.sync.source.QueueReaderPipe
- start() - Method in class org.pipecraft.pipes.sync.source.ReaderPipe
- start() - Method in class org.pipecraft.pipes.sync.source.SeqGenPipe
- start() - Method in class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
- start() - Method in class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
- start() - Method in class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
- start() - Method in class org.pipecraft.pipes.terminal.AsyncCollectionWriterPipe
- start() - Method in class org.pipecraft.pipes.terminal.AsyncConsumerPipe
- start() - Method in class org.pipecraft.pipes.terminal.AsyncEnqueuingSharderPipe
- start() - Method in class org.pipecraft.pipes.terminal.AsyncSharderPipe
- start() - Method in class org.pipecraft.pipes.terminal.CollectionWriterPipe
- start() - Method in class org.pipecraft.pipes.terminal.CompoundTerminalPipe
- start() - Method in class org.pipecraft.pipes.terminal.ConsumerPipe
- start() - Method in class org.pipecraft.pipes.terminal.ParallelConsumerPipe
- start() - Method in class org.pipecraft.pipes.terminal.PercentilePipe
- start() - Method in class org.pipecraft.pipes.terminal.QueueWriterPipe
- start() - Method in class org.pipecraft.pipes.terminal.SharderByItemPipe
- start() - Method in class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
- start() - Method in class org.pipecraft.pipes.terminal.TxtFileWriterPipe
- start() - Method in class org.pipecraft.pipes.terminal.WriterPipe
- startAndEnd(E) - Method in interface org.pipecraft.infra.monitoring.collectors.ActionStatsCollector
-
Indicates the starting and termination of an "instant" action (duration = 0)
- startAndEnd(E) - Method in class org.pipecraft.infra.monitoring.collectors.BlockingActionStatsCollector
- startAndEnd(E) - Method in class org.pipecraft.infra.monitoring.collectors.NonBlockingActionStatsCollector
- StaticJobScheduler<J> - Class in org.pipecraft.infra.math
-
Schedules n "jobs" among m "workers", trying to minimize the makespan.
- StaticJobScheduler(Collection<J>, Function<J, Double>) - Constructor for class org.pipecraft.infra.math.StaticJobScheduler
-
Constructor
- Storage<S extends Bucket<T>,T> - Interface in org.pipecraft.infra.storage
-
A parent interface for all remote/local storage implementations
- StorageMultiFileReaderConfig<T,B> - Class in org.pipecraft.pipes.utils.multi
-
A builder + configuration for pipes reading multiple remote files from storage.
- StorageMultiFileReaderConfig.Builder<T,B> - Class in org.pipecraft.pipes.utils.multi
- StorageMultiFileReaderPipe<T,B> - Class in org.pipecraft.pipes.sync.source
-
A source pipe reading multiple remote binary files from the cloud.
- StorageMultiFileReaderPipe(StorageMultiFileReaderConfig<T, B>) - Constructor for class org.pipecraft.pipes.sync.source.StorageMultiFileReaderPipe
-
Constructor
- StorageMultiTxtFileReaderPipe<B> - Class in org.pipecraft.pipes.sync.source
-
Reads data from multiple files in cloud storage under some folder, as if they were concatenated using some predefined order.
- StorageMultiTxtFileReaderPipe(Storage<?, B>, String, String) - Constructor for class org.pipecraft.pipes.sync.source.StorageMultiTxtFileReaderPipe
-
Constructor Scans the remote files in lexicographic name order.
- StorageMultiTxtFileReaderPipe(Storage<?, B>, String, String, Charset, int, String, Comparator<B>) - Constructor for class org.pipecraft.pipes.sync.source.StorageMultiTxtFileReaderPipe
-
Constructor
- StorageMultiTxtFileReaderPipe(Storage<?, B>, String, String, Comparator<B>) - Constructor for class org.pipecraft.pipes.sync.source.StorageMultiTxtFileReaderPipe
-
Constructor Assumes UTF8 encoding of all files, and doesn't apply any filter on files to read from.
- StoragePath - Class in org.pipecraft.infra.storage
-
A data class pointing to a specific protocol (e.g.
- StoragePath(String, String, String) - Constructor for class org.pipecraft.infra.storage.StoragePath
-
Constructor
- StorageTxtFileFetcherReaderPipe - Class in org.pipecraft.pipes.sync.source
-
A source pipe providing the lines of a text file from cloud storage.
- StorageTxtFileFetcherReaderPipe(Storage<?, ?>, String, String, File) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
-
Constructor Uses the default read chunk size and default read options, and assumes UTF8
- StorageTxtFileFetcherReaderPipe(Storage<?, ?>, String, String, Charset, int, FileReadOptions, File) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
-
Constructor
- StorageTxtFileFetcherReaderPipe(Storage<?, ?>, String, String, Charset, File) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
-
Constructor Uses the default read chunk size and default read options
- StorageTxtFileFetcherReaderPipe(Storage<?, ?>, String, String, FileReadOptions, File) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileFetcherReaderPipe
-
Constructor Uses the default read chunk size and assumes UTF8
- StorageTxtFileReaderPipe - Class in org.pipecraft.pipes.sync.source
-
A source pipe providing the lines of a text file in some
Storage, in a streaming manner. - StorageTxtFileReaderPipe(Storage<?, ?>, String, String) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
-
Constructor Uses the default read chunk size and default read options, and assumes UTF8
- StorageTxtFileReaderPipe(Storage<?, ?>, String, String, Charset) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
-
Constructor Uses the default read chunk size and default read options
- StorageTxtFileReaderPipe(Storage<?, ?>, String, String, Charset, int, FileReadOptions) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
-
Constructor
- StorageTxtFileReaderPipe(Storage<?, ?>, String, String, FileReadOptions) - Constructor for class org.pipecraft.pipes.sync.source.StorageTxtFileReaderPipe
-
Constructor Uses the default read chunk size and assumes UTF8
- StorageTxtFileWriterPipe - Class in org.pipecraft.pipes.terminal
-
A terminal pipe writing text lines from the input pipe into a remote cloud storage file.
- StorageTxtFileWriterPipe(Pipe<String>, Storage<?, ?>, String, String) - Constructor for class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
-
Constructor Uses default write options and chunk size, and assumes UTF8
- StorageTxtFileWriterPipe(Pipe<String>, Storage<?, ?>, String, String, Charset) - Constructor for class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
-
Constructor Uses the default write options and chunk size
- StorageTxtFileWriterPipe(Pipe<String>, Storage<?, ?>, String, String, Charset, int, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
-
Constructor
- StorageTxtFileWriterPipe(Pipe<String>, Storage<?, ?>, String, String, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.StorageTxtFileWriterPipe
-
Constructor Uses default chunk size and UTF8
- StreamSampler - Class in org.pipecraft.infra.sets
-
A random sampler on a stream of a known size.
- StreamSampler(Random, int, int) - Constructor for class org.pipecraft.infra.sets.StreamSampler
-
Constructor
- summarize() - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Merge internal digests into a single
QuantileDigest. - summarize() - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Get an aggregate view of the current state of this object as a
QuantileDigest. - summarize(int) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Get an aggregate view of the current state of the
lookbackmost recent journal entries as aQuantileDigest. - SyncToAsyncPipe<T> - Class in org.pipecraft.pipes.async.inter
-
A pipe converting multiple sync pipes into a single async one.
- SyncToAsyncPipe(Collection<PipeSupplier<T>>, int) - Constructor for class org.pipecraft.pipes.async.inter.SyncToAsyncPipe
-
Constructor
- SystemHealthMonitorable - Class in org.pipecraft.infra.monitoring
-
A monitorable covering different JVM and runtime aspects TODO(Eyal): Consider implementing a generic JMXBean->JSON converter, so that any MXBean can be exposed as a JsonMonitorable easily.
- SystemHealthMonitorable() - Constructor for class org.pipecraft.infra.monitoring.SystemHealthMonitorable
T
- take() - Method in class org.pipecraft.infra.concurrent.LockFreeBlockingQueue
- temp() - Method in class org.pipecraft.infra.io.FileWriteOptions
-
Sets the file to be temporary, meaning that it will be deleted once the JVM exits gracefully (by default it's false)
- temp(boolean) - Method in class org.pipecraft.infra.io.FileWriteOptions
-
if true, sets compression the flag on file write options.
- TerminalPipe - Class in org.pipecraft.pipes.terminal
-
Base class for terminal pipes, i.e.
- TerminalPipe() - Constructor for class org.pipecraft.pipes.terminal.TerminalPipe
- test(T) - Method in interface org.pipecraft.infra.concurrent.FailablePredicate
-
Evaluates this predicate on the given argument.
- threadNum(int) - Method in class org.pipecraft.pipes.utils.multi.LocalMultiFileReaderConfig.Builder
- threadNum(int) - Method in class org.pipecraft.pipes.utils.multi.StorageMultiFileReaderConfig.Builder
- ThreadSafeCountingInputStream - Class in org.pipecraft.infra.io
-
Copied from Guava's
CountingInputStream. - ThreadSafeCountingInputStream(InputStream) - Constructor for class org.pipecraft.infra.io.ThreadSafeCountingInputStream
-
Wraps another input stream, counting the number of bytes read.
- ThrowableTextualizer - Class in org.pipecraft.infra.monitoring.sampling
-
A sample textualizer for throwable objects.
- ThrowableTextualizer() - Constructor for class org.pipecraft.infra.monitoring.sampling.ThrowableTextualizer
- TimeoutPipeException - Exception in org.pipecraft.pipes.exceptions
-
A pipe exception resulting from a timeout
- TimeoutPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.TimeoutPipeException
- TimeoutPipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.TimeoutPipeException
- TimeoutPipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.TimeoutPipeException
- toHex(byte[]) - Static method in class org.pipecraft.infra.io.Coding
-
convert byte array to hex
- toJson() - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
- TopKPipe<T> - Class in org.pipecraft.pipes.sync.inter
-
A pipe returning the top K items of the input pipe, according to some predefined order relation.
- TopKPipe(Pipe<T>, int, Comparator<? super T>) - Constructor for class org.pipecraft.pipes.sync.inter.TopKPipe
-
Constructor
- toString() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStats
- toString() - Method in class org.pipecraft.infra.monitoring.collectors.ActionStatsMap
- toString() - Method in class org.pipecraft.infra.monitoring.collectors.EventStatsMap
- toString() - Method in class org.pipecraft.infra.net.HostPort
- toString() - Method in class org.pipecraft.infra.storage.StoragePath
- toString() - Method in class org.pipecraft.pipes.sync.inter.join.JoinRecord
- toString() - Method in class org.pipecraft.pipes.utils.ShardSpecifier
- toText(Throwable) - Method in class org.pipecraft.infra.monitoring.sampling.ThrowableTextualizer
- toText(T) - Method in interface org.pipecraft.infra.monitoring.sampling.SampleTextualizer
- toText(T) - Method in class org.pipecraft.infra.monitoring.sampling.SimpleSampleTextualizer
- TRUNCATE - org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe.GroupSizeLimitPolicy
- tryAdd(double) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
-
Attempts to add an unweighted sample to this estimator.
- tryAdd(double, int) - Method in interface org.pipecraft.infra.monitoring.quantile.ConcurrentQuantileEstimator
-
Attempts to add a weighted sample to this estimator.
- tryAdd(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.MultiQuantileDigest
-
Attempts to add a weighted sample to this estimator.
- tryAdd(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Attempts to add a weighted sample to this estimator.
- tryAdd(double, int) - Method in class org.pipecraft.infra.monitoring.quantile.SlidingWindowQuantileDigest
-
Attempts to add a weighted sample to this estimator.
- tryRead(InputStream, byte[], int, int) - Static method in class org.pipecraft.infra.io.Coding
-
Tries to read a given number of bytes from the stream into a given buffer.
- TxtCodecFactory<T> - Class in org.pipecraft.pipes.serialization
-
A textual encoder-decoder
- TxtCodecFactory(Function<T, String>, FailableFunction<String, T, ? extends ValidationPipeException>) - Constructor for class org.pipecraft.pipes.serialization.TxtCodecFactory
-
Constructor Assumes UTF8 in encoded form
- TxtCodecFactory(Function<T, String>, FailableFunction<String, T, ? extends ValidationPipeException>, Charset) - Constructor for class org.pipecraft.pipes.serialization.TxtCodecFactory
-
Constructor
- TxtDecoderFactory<T> - Class in org.pipecraft.pipes.serialization
-
An
DecoderFactorythat decodes items from a textual form, assuming that items are delimited by "\n". - TxtDecoderFactory(FailableFunction<String, T, ? extends ValidationPipeException>) - Constructor for class org.pipecraft.pipes.serialization.TxtDecoderFactory
-
Constructor Assumes UTF8 text encoding.
- TxtDecoderFactory(FailableFunction<String, T, ? extends ValidationPipeException>, Charset) - Constructor for class org.pipecraft.pipes.serialization.TxtDecoderFactory
-
Constructor
- TxtEncoderFactory<T> - Class in org.pipecraft.pipes.serialization
-
An
EncoderFactorythat encodes items as text, delimiting them by "\n". - TxtEncoderFactory() - Constructor for class org.pipecraft.pipes.serialization.TxtEncoderFactory
-
Constructor Assumes UTF8 text encoding and textualization based on the object's toString()
- TxtEncoderFactory(Function<T, String>) - Constructor for class org.pipecraft.pipes.serialization.TxtEncoderFactory
-
Constructor Assumes UTF8 text encoding
- TxtEncoderFactory(Function<T, String>, Charset) - Constructor for class org.pipecraft.pipes.serialization.TxtEncoderFactory
-
Constructor
- TxtFileReaderPipe - Class in org.pipecraft.pipes.sync.source
-
A source pipe reading lines from a given local text file or input stream containing text content.
- TxtFileReaderPipe(File) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
-
Constructor Detects the compression type by the filename extension
- TxtFileReaderPipe(File, Charset) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
-
Constructor Detects the compression type by the filename extension
- TxtFileReaderPipe(File, Charset, FileReadOptions) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
-
Constructor
- TxtFileReaderPipe(File, FileReadOptions) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
-
Constructor
- TxtFileReaderPipe(FailableInterruptibleSupplier<SizedInputStream, IOException>, Charset, int, Compression) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
-
Constructor
- TxtFileReaderPipe(SizedInputStream, Charset, int, Compression) - Constructor for class org.pipecraft.pipes.sync.source.TxtFileReaderPipe
-
Constructor
- TxtFileWriterPipe - Class in org.pipecraft.pipes.terminal
-
A terminal pipe writing text lines from the input pipe into a file.
- TxtFileWriterPipe(Pipe<String>, File) - Constructor for class org.pipecraft.pipes.terminal.TxtFileWriterPipe
-
Constructor Uses default file write options and UTF8 charset encoding.
- TxtFileWriterPipe(Pipe<String>, File, Charset) - Constructor for class org.pipecraft.pipes.terminal.TxtFileWriterPipe
-
Constructor Uses default file write options.
- TxtFileWriterPipe(Pipe<String>, File, Charset, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.TxtFileWriterPipe
-
Constructor
- TxtFileWriterPipe(Pipe<String>, File, FileWriteOptions) - Constructor for class org.pipecraft.pipes.terminal.TxtFileWriterPipe
-
Constructor Uses UTF8 charset encoding.
U
- UnboundedEventsCollector<T> - Class in org.pipecraft.infra.monitoring.collectors
-
Collects counts on an unbounded set of categories.
- UnboundedEventsCollector() - Constructor for class org.pipecraft.infra.monitoring.collectors.UnboundedEventsCollector
- UnboundedEventStatsMap<T> - Class in org.pipecraft.infra.monitoring.collectors
-
An EventStatsMap with no predefined set of possible categories.
- UnboundedEventStatsMap() - Constructor for class org.pipecraft.infra.monitoring.collectors.UnboundedEventStatsMap
-
Constructor
- URLTxtReaderPipe - Class in org.pipecraft.pipes.sync.source
-
A source pipe providing the lines of a text resource defined by a URL.
- URLTxtReaderPipe(URL) - Constructor for class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
-
Constructor Uses defaults: UTF8 charset, no compression, and default timeouts.
- URLTxtReaderPipe(URL, Charset, FileReadOptions, int, int) - Constructor for class org.pipecraft.pipes.sync.source.URLTxtReaderPipe
-
Constructor
- UTF8 - Static variable in class org.pipecraft.infra.io.FileUtils
- UUIDRangeSplitter - Class in org.pipecraft.infra.math
-
Splits the UUID value range into K equal sized continuous shards, and returns the thresholds.
- UUIDRangeSplitter(int) - Constructor for class org.pipecraft.infra.math.UUIDRangeSplitter
-
Constructor
V
- validateFolderNotEmpty(File) - Static method in class org.pipecraft.infra.io.FileUtils
-
throws exception if folder is invalid or empty.
- validateNotFolderPath(String) - Method in class org.pipecraft.infra.storage.Bucket
- ValidationPipeException - Exception in org.pipecraft.pipes.exceptions
-
Indicates that the contents of a pipe were found to be invalid
- ValidationPipeException(String) - Constructor for exception org.pipecraft.pipes.exceptions.ValidationPipeException
-
Constructor
- ValidationPipeException(String, Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.ValidationPipeException
-
Constructor
- ValidationPipeException(Throwable) - Constructor for exception org.pipecraft.pipes.exceptions.ValidationPipeException
-
Constructor
- valueOf(String) - Static method in enum org.pipecraft.infra.io.Compression
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.pipecraft.pipes.async.AsyncPipe.Status
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.pipecraft.pipes.sync.inter.join.JoinMode
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe.GroupSizeLimitPolicy
-
Returns the enum constant of this type with the specified name.
- values() - Static method in enum org.pipecraft.infra.io.Compression
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.pipecraft.pipes.async.AsyncPipe.Status
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.pipecraft.pipes.sync.inter.join.JoinMode
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.pipecraft.pipes.sync.inter.reduct.ListReductorPipe.GroupSizeLimitPolicy
-
Returns an array containing the constants of this enum type, in the order they are declared.
W
- withExtension(String) - Method in enum org.pipecraft.infra.io.Compression
- workers(Set<HostPort>) - Method in class org.pipecraft.pipes.async.inter.distributed.DistributedShufflerConfig.Builder
- WORKING - org.pipecraft.pipes.async.AsyncPipe.Status
- wrap(MergingDigest) - Static method in class org.pipecraft.infra.monitoring.quantile.QuantileDigest
-
Wrap a
MergingDigestin order to make it thread safe. - writeBigEndian16(int, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- writeBigEndian16(int, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Writes a 16 bit int into the output stream.
- writeBigEndian32(int, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- writeBigEndian32(int, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Writes a 32 bit int into the output stream.
- writeBigEndian64(long, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- writeBigEndian64(long, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Writes a 64 bit int into the output stream.
- writeCSV(Collection<T>, File, Function<T, Object[]>) - Static method in class org.pipecraft.infra.io.FileUtils
-
Writes CSV file with no headers.
- writeCSV(Collection<T>, File, Function<T, Object[]>, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Writes CSV file with no headers.
- writeCSV(Iterator<T>, File, Function<T, Object[]>, FileWriteOptions, String...) - Static method in class org.pipecraft.infra.io.FileUtils
-
Writes items from iterator into the given csv file.
- writeCSV(List<List<String>>, File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Writes CSV file with no headers.
- writeJSONListToFile(List<JSONObject>, File) - Static method in class org.pipecraft.infra.io.FileUtils
- writeJSONToFile(JSONObject, File) - Static method in class org.pipecraft.infra.io.FileUtils
- writeLines(Collection<String>, File) - Static method in class org.pipecraft.infra.io.FileUtils
-
Writes the given lines to a file, using default file write options
- writeLines(Collection<String>, File, FileWriteOptions) - Static method in class org.pipecraft.infra.io.FileUtils
-
Writes the given lines to a file.
- writeLittleEndian16(int, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- writeLittleEndian16(int, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Writes a 16 bit int into the output stream.
- writeLittleEndian32(int, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- writeLittleEndian32(int, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Writes a 32 bit int into the output stream.
- writeLittleEndian64(long, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
- writeLittleEndian64(long, OutputStream) - Static method in class org.pipecraft.infra.io.Coding
-
Writes a 64 bit int into the output stream.
- WriterPipe - Class in org.pipecraft.pipes.terminal
-
A terminal pipe writing textual items to a given
Writer, one item per line. - WriterPipe(Pipe<String>, Writer) - Constructor for class org.pipecraft.pipes.terminal.WriterPipe
-
Constructor
- WriterPipe(Pipe<String>, Writer, int) - Constructor for class org.pipecraft.pipes.terminal.WriterPipe
-
Constructor
- writeVarint32(int, byte[], int) - Static method in class org.pipecraft.infra.io.Coding
Z
- ZSTD - org.pipecraft.infra.io.Compression
- ZSTD_EXTENSION - Static variable in class org.pipecraft.infra.io.FileUtils
All Classes All Packages