All Classes Interface Summary Class Summary Enum Summary Exception Summary
| Class |
Description |
| AbstractActionStatsCollector<E extends Enum<E>> |
A baseline for statistics collector implementations.
|
| AbstractCheckedFuture<V,E extends Exception> |
An abstract decorator on ListenableFuture which adds checkedGet() methods which simplify Future's error handling.
|
| AbstractInputStreamItemDecoder<T> |
A base class for item decoders whose pre-processing on the input streams consists only
on buffering and decompression, providing the transformed input stream for the decode method to work on.
|
| AbstractOutputStreamItemEncoder<T> |
A base class for item encoders whose pre-processing on the output streams consists only
on buffering and compression, providing the transformed output stream for the encode method to work on.
|
| ActionStats |
Simple action statistics bean referring to a specific action type.
|
| ActionStatsCollector<E extends Enum<E>> |
A common interface to all action statistics collectors.
|
| ActionStatsMap<E extends Enum<E>> |
A collection of simple statistics gathered on multiple categories.
|
| ArithmeticUtils |
Arithmetics and math utilities
|
| AsyncCallbackPipe<T> |
A no-op async pipe that "spies" on data passing through it.
|
| AsyncCollectionWriterPipe<T> |
A terminal async pipe writing all contents from an input pipe into a given collection.
|
| AsyncCompoundPipe<T> |
A pipe encapsulating a pipeline.
|
| AsyncConsumerPipe<T> |
Consumes the contents of an AsyncPipe, blocking in the start() method until all data is read.
|
| AsyncEmptyPipe<T> |
An async source pipe returning no data.
|
| AsyncEnqueuingSharderPipe<T> |
A terminal pipe that receives an async pipe as input, and shards the contents of the input pipe into multiple queues
according to some sharding criteria based on item values.
|
| AsyncFilterPipe<T> |
An async version of the filter pipe (See FilterPipe.
|
| AsyncFlexibleMapPipe<S,T> |
|
| AsyncHeadPipe<T> |
An async version of the head pipe (See HeadPipe.
|
| AsyncMapPipe<S,T> |
An async version of the mapper pipe (See MapPipe.
|
| AsyncMultiFileReaderPipe<T> |
An async source pipe reading multiple local binary files.
|
| AsyncPipe<T> |
A pipe that produces items asynchronously.
|
| AsyncPipe.Status |
|
| AsyncPipeListener<T> |
|
| AsyncProgressPipe<T> |
A no-op async pipe that reports progress.
|
| AsyncSeqGenPipe<T> |
An async source pipe, producing a fixed number of items using a fixed number of threads.
|
| AsyncSharderByHashPipe<T> |
An async sharder pipe, writing items to files based on the hash value of individual items.
|
| AsyncSharderPipe<T> |
A terminal pipe that receives an async pipe as input, and splits the contents of the input pipe into multiple files
according to some sharding criteria based on individual items.
|
| AsyncStorageMultiFileReaderPipe<T,B> |
An async source pipe reading multiple remote binary files from the cloud.
|
| AsyncTimeoutPipe<T> |
An async pipe enforcing a timeout on completion of its async input pipe.
|
| AsyncToSyncPipe<T> |
A pipe which acts as a converter from async pipe/s to a sync pipe.
|
| AsyncUnionPipe<T> |
An intermediate async pipe fed by a set of other async pipes.
|
| AverageSlidingWindow |
A sliding window used for calculating the average of a stream of numbers, in a given time frame
|
| AvroCodecFactory<T> |
A codec factory for AVRO format.
|
| AvroDecoder<T> |
An ItemDecoder that decodes objects encoded in avro format.
|
| AvroEncoder<T> |
An ItemEncoder that encode any java class to bytes using avro.
|
| BasePipe |
A base interface containing minimal API for sync, async and terminal pipes
|
| BinFileWriterPipe<T> |
A terminal pipe writing items to a local file in a binary format.
|
| BinInputReaderPipe<T> |
A source pipe reading items from a given binary input (file or input stream).
|
| BlockingActionStatsCollector<E extends Enum<E>> |
A statistics collector which uses synchronization locks for guaranteeing data consistency.
|
| BlockingSampler<T> |
A utility for sampling of recent values, using a blocking approach for guaranteeing k latest events in a FIFO order.
|
| Bucket<T> |
A base class for a storage bucket implementations.
|
| ByteArrayCodec<T> |
An interface for byte array encoder and decoder
|
| ByteArrayDecoder<T> |
A functional interface for decoders working on byte arrays
representing single items.
|
| ByteArrayEncoder<T> |
A functional interface for encoders producing byte arrays
representing single items.
|
| CallbackPipe<T> |
A pipe invoking a callback method per item passed through it.
|
| CheckedFuture<V,E extends Exception> |
Extends ListenableFuture and adds checkedGet() methods which simplify Future's error handling.
|
| CheckedFutureTransformer<S,T,E extends Exception> |
A CheckedFuture decorator converting a checked future with value type S to a checked future with value type T.
|
| CodecFactory<T> |
A factory of both encoders and decoders
|
| Coding |
General encoding/decoding utility functions
|
| CollectionReaderPipe<T> |
A pipe based on a given collection of items.
|
| CollectionWriterPipe<T> |
A terminal pipe writing all contents from an input pipe into a given collection.
|
| CompoundPipe<T> |
A pipe encapsulating a pipeline.
|
| CompoundTerminalPipe |
A terminal pipe encapsulating a pipeline.
|
| Compression |
Supported compression types
|
| ConcatPipe<T> |
An intermediate pipe consisting of concatenating the contents of a series of pipes
|
| ConcurrentQuantileEstimator |
Thread-safe quantile and cdf estimation
|
| ConsumerPipe<T> |
A terminal pipe that consumes all contents of the input pipe in a synchronous manner.
|
| CountPipe |
A pipe counting the items in the input pipe, and returning the count as a single output item.
|
| CSVDecoder<T> |
|
| CSVEncoder<T> |
An ItemEncoder that encodes objects as compliant CSV rows.
|
| CSVMapperPipe<T> |
An intermediate pipe that parses strings in CSV format, and binds each line to an object
|
| DecoderFactory<T> |
Allows creating ItemDecoder instances of some specific type.
|
| DedupPipe<T> |
Uses item equality (equals() method) in input pipe items for performing a dedup operation.
|
| DelegatePipe<T> |
A pipe delegating all work to another pipe given in the constructor.
|
| DelegatingByteArrayCodec<T> |
Wraps a given byte array encoder and byte array decoder, and delegates encoding/decoding
requests to them.
|
| DelegatingCodecFactory<T> |
Wraps a given encoder and decoder factories, and delegates encoding/decoding creation
requests to them.
|
| DistributedShufflerConfig<T> |
|
| DistributedShufflerConfig.Builder<T> |
|
| DistributedShufflerPipe<T> |
An async pipe that takes input and shuffle it across multiple workers.
|
| EmptyPipe<T> |
A source pipe with no data in it.
|
| EncoderFactory<T> |
Allows creating ItemEncoder instances of some specific type.
|
| EnumEventStatsMap<T extends Enum<T>> |
An EventStatsMap based on an enum
|
| ErrorPipe<T> |
A source pipe with no data in it, which only produces a predefined PipeException.
|
| EventRateSlidingWindow |
A simple sliding window used for calculating events rate in a given time frame
|
| EventsCollector<E extends Enum<E>> |
Counts events that fall into one of a predefined set of categories.
|
| EventStatsMap<E> |
A mapping between event categories and their respective counts.
|
| ExactSamplerPipe<T> |
A pipe sampling exactly m items of an input pipe containing n items, where n is known in advance.
|
| ExcessiveResourcesUsagePipeException |
A pipe exception due to resource usage beyond some threshold
|
| FailableBiConsumer<A,B,E extends Exception> |
A bi-consumer that may fail with a checked exception during the execution of the accept(..) method.
|
| FailableConsumer<T,E extends Exception> |
A consumer that may fail with a checked exception during the execution of the accept(..) method.
|
| FailableFunction<T,R,E extends Exception> |
A function that may fail with a checked exception during the execution of the apply(..) method.
|
| FailableInterruptibleConsumer<T,E extends Exception> |
An interreuptible consumer that may also fail with a checked exception during the execution of the accept(..) method.
|
| FailableInterruptibleRunnable<E extends Exception> |
A runnable that is interruptible and may also fail with a checked exception during the execution of the run() method.
|
| FailableInterruptibleSupplier<T,E extends Exception> |
A supplier that is interruptible and may also fail with a checked exception during the execution of the get() method.
|
| FailablePredicate<T,E extends Exception> |
|
| FailableRunnable<E extends Exception> |
A runnable that may fail with a checked exception during the execution of the run() method.
|
| FailableSupplier<T,E extends Exception> |
A supplier that may fail with a checked exception during the execution of the get() method.
|
| FastRandom |
A fast version of Random, which extends from it but eliminates thread safety.
|
| FileReadOptions |
Encapsulates file reading settings, with defaults.
|
| FileUtils |
A set of utility methods for manipulating files
|
| FileWriteOptions |
Encapsulates file writing settings, with defaults.
|
| FilterBasePipe<T> |
A base-class pipe implementation for pipes that filter an input pipe using some criteria.
|
| FilterPipe<T> |
A pipe filtering an input pipe by some predicate on the pipe items.
|
| FlexibleMapPipe<S,T> |
An intermediate pipe that maps an input item into zero or more items of another type.
|
| FutureCompletionHandler<T> |
To be set as a listener on ListenableFutures.
|
| FutureCompletionLogger |
To be set as a listener on ListenableFutures.
|
| GraphiteClient |
A simple graphite client that sends metrics to graphite server.
|
| GraphiteException |
Graphite exception
|
| GrouperPipe<T> |
Splits the input items into different families, and emits items from the same family sequentially.
|
| HashJoinPipe<K,L,R> |
A pipe performing a join operation between a 'left' pipe of type L, and a list of 'right' pipes of type R.
|
| HashReductorPipe<I,O> |
Scans the input pipe and performs a reduction operation on families of items based on some discriminating property.
|
| HeadPipe<T> |
A pipe returning the first K items of its input pipe.
|
| HostPort |
A util class for representing network : Immutable.
|
| HttpPipeException |
An IO pipe exception indicating an error reported by an HTTP server
Includes the HTTP status code.
|
| IllegalJsonException |
A storage exception meaning that a remote json file has illegal structure and can't be deserialized properly.
|
| ImmediateFuture<V,E extends Exception> |
A checked listenable future that returns a predefined value or throws a predifined exception.
|
| InaccurateSampler<T> |
A utility for sampling of recent values, using a non-blocking approach for improved performance.
|
| InputStreamPipe<T> |
A base class for source pipes based on some input stream.
|
| IntDecoders |
A collection of decoder factories for reading 16, 32 and 64 bit integers
|
| IntEncoders |
A collection of encoder factories for writing 16, 32 and 64 bit integers
|
| IntermediateBinFileWriterPipe<T> |
|
| IntermediateSharderBySeqPipe<T> |
|
| IntermediateTxtFileWriterPipe<T> |
A pipe write to a text file any item passed through it.
|
| InternalPipeException |
A pipe exception resulting from a runtime error.
|
| IOPipeException |
A pipe exception resulting from an IO error
|
| ItemDecoder<T> |
A functional interface for stateful decoders, decoding object from some binary source.
|
| ItemEncoder<T> |
A functional interface for stateful encoders, encoding object into some binary destination.
|
| IteratorReaderPipe<T> |
A pipe based on an iterator.
|
| JdbcPipeException |
A pipe exception due to JDBC related errors
|
| JdbcQueryResultsPipe<T> |
A source pipe reading rows from a DB query result set, and converting them to some entity type
|
| JoinMode |
The different join modes supported by join pipes
In LEFT mode, all keys from the left pipe (and only them) will be included in the results.
|
| JoinRecord<K,L,R> |
|
| JsonMonitorable |
To be implemented by classes that can "export" their state (or part of it) as Json.
|
| JsonMonitorableMerger |
A simple JsonMonitorable implementation that joins a set of other JsonMonitorables.
|
| JsonMonitorableWrapper |
A simple JsonMonitorable implementation that wraps a set of child monitorables and adds own metrics.
|
| ListReductorPipe<S,T> |
Scans the input pipe and groups sequential items based on some discriminating property.
|
| ListReductorPipe.GroupSizeLimitPolicy |
|
| LocalDiskBucket |
A bucket implementation pointing to a local disk folder.
|
| LocalDiskStorage |
A storage implementation for working on local disk.
|
| LocalMultiFileReaderConfig<T> |
A builder + configuration for pipes reading multiple local files.
|
| LocalMultiFileReaderConfig.Builder<T> |
|
| LockFreeBlockingQueue<E> |
A blocking queue implementation which wraps the efficient ConcurrentLinkedQueue,
and adds adaptive yields/sleeps in order to achieve a blocking behavior without
using locks.
|
| LookupJoinPipe<K,L,R> |
A pipe performing a join operation between a 'left' pipe of type L, and a list of 'right' pipes of type R.
|
| MapPipe<S,T> |
A pipe transforming each item in the input pipe into another, possibly with a different type.
|
| MonitoringTree |
A hierarchy of JsonMonitorable objects.
|
| MultiFileReaderPipe<T> |
A source pipe reading multiple local binary files.
|
| MultiFileReaderUtils |
Shared helper methods for multi-file reader pipes.
|
| MultiQuantileDigest |
Thread Safe high-throughput quantile and cdf estimation.
|
| MultiSortedBasePipe<T> |
A base class for pipes performing some set operation on a collection of sorted input pipes.
|
| MultiTxtFileReaderPipe |
Reads data from multiple files in local disk under some folder, as if they were concatenated using some predefined order.
|
| NonBlockingActionStatsCollector<E extends Enum<E>> |
A statistics collector which uses a non-blocking approach to improve performance.
|
| OrderValidationPipe<T> |
An intermediate pipe that validates the order of the consumed elements by a comparator
|
| OutOfOrderPipeException |
Indicates that the ordering of items in a pipe was not as expected
|
| ParallelConsumerPipe |
A terminal pipe that consumes multiple input pipes in a parallel manner, with a configurable number of threads.
|
| ParallelTaskProcessor |
Processes a heavy task (typically with IO involved) in parallel.
|
| PathUtils |
A set of utility methods for working with storage paths
|
| PercentilePipe<T,C extends Comparable<C>> |
A terminal pipe that finds a given percentile p in the input pipe.
|
| Pipe<T> |
The interface to be implemented by synchronous pipes, which are passive and items are "pulled" from them.
|
| PipeException |
Indicates an error during data fetching/processing/writing of a pipeline
This is the surertype for all pipe exceptions.
|
| PipeFactory<P,T> |
An interface for pipe creation based on some parameter.
|
| PipeReaderSupplier<T,M> |
An interface for reader pipe creators.
|
| PipeSupplier<T> |
An interface for pipe creators.
|
| PipeUtils |
A collection of pipe utility functions
|
| PortionSamplerPipe<T> |
A pipe sampling about x% of the incoming items.
|
| ProgressPipe<T> |
A no-op pipe with only one side effect - progress tracking.
|
| ProgressTransformer |
A progress listener wrapping another progress listener, allowing filtering of progress events and changing the reported progress range.
|
| QuantileDigest |
A synchronized wrapper for com.tdunning.math.stats.MergingDigest which
is an implementation of t-digests.
|
| QueuePipeException |
Indicates an error found during the pipeline while interacting with
producer/consumer queues.
|
| QueueReaderPipe<T> |
|
| QueueWriterPipe<T> |
|
| ReaderPipe |
A source pipe that reads lines from a given reader.
|
| ReductorConfig<I,F,G,O> |
A configuration for a reduction operation.
|
| ReductorConfig.Builder<I,F,G,O> |
|
| Retrier |
|
| Sampler<T> |
Allows sampling values from a stream
|
| SampleTextualizer<T> |
Converts sample items into a text representation
|
| SeqGenPipe<T> |
A pipe based on a given sequence generator function.
|
| SequenceReductorPipe<I,O> |
Scans the input pipe and performs a reduction operation on a sequence of items with some discriminating property.
|
| SettableListenableFuture<T> |
The future implementation to be used in cases where a class is responsible for setting the Future's outcome (value/exception),
and the future should be a ListenableFuture.
|
| SharderByHashPipe<T> |
A terminal pipe that splits the contents of the input pipe into multiple files, according to a hash on a some feature of the item.
|
| SharderByItemPipe<T> |
A terminal pipe that splits the contents of the input pipe into multiple files, according to some sharding criteria based on each item.
|
| SharderBySeqPipe<T> |
A terminal pipe that splits the contents of the input pipe according to some criteria which breaks the input pipe into disjoint contiguous sequences.
|
| ShardSpecifier |
Specifies a shard index and a total number of shards.
|
| SimpleDecoderFactory<T> |
A simple generic decoder factory implementation.
|
| SimpleEncoderFactory<T> |
A simple generic encoder factory implementation.
|
| SimpleSampleTextualizer<T> |
A sample textualizer that uses the items toString().
|
| SizedInputStream |
A simple InputStream wrapper, that adds awareness to the stream size
|
| SkipPipe<T> |
A pipe skipping the first K items of its input pipe.
|
| SlidingWindow<E,R,Q> |
An abstract sliding window.
|
| SlidingWindowQuantileDigest |
High throughput, thread safe, quantile and cdf estimation with a sliding window of time.
|
| SortedIntersectionPipe<T> |
An intermediate pipe performing set intersection operation on a collection of sorted input pipes.
|
| SortedJoinPipe<K,L,R> |
A pipe performing a join operation between a 'left' pipe of type L, and a list of 'right' pipes of type R.
|
| SortedMergePipe<T> |
An intermediate pipe sort-merging the contents of a collection of sorted input pipes.
|
| SortedSubtractionPipe<T> |
An intermediate pipe performing a set subtraction operation on two given pipes (i.e.
|
| SortedUnionPipe<T> |
An intermediate pipe performing set union operation on a collection of sorted input pipes.
|
| SortPipe<T> |
An intermediate pipe performing a sort on an input pipe, without deduping.
|
| StaticJobScheduler<J> |
Schedules n "jobs" among m "workers", trying to minimize the makespan.
|
| Storage<S extends Bucket<T>,T> |
A parent interface for all remote/local storage implementations
|
| StorageMultiFileReaderConfig<T,B> |
A builder + configuration for pipes reading multiple remote files from storage.
|
| StorageMultiFileReaderConfig.Builder<T,B> |
|
| StorageMultiFileReaderPipe<T,B> |
A source pipe reading multiple remote binary files from the cloud.
|
| StorageMultiTxtFileReaderPipe<B> |
Reads data from multiple files in cloud storage under some folder, as if they were concatenated using some predefined order.
|
| StoragePath |
A data class pointing to a specific protocol (e.g.
|
| StorageTxtFileFetcherReaderPipe |
A source pipe providing the lines of a text file from cloud storage.
|
| StorageTxtFileReaderPipe |
A source pipe providing the lines of a text file in some Storage, in a streaming manner.
|
| StorageTxtFileWriterPipe |
A terminal pipe writing text lines from the input pipe into a remote cloud storage file.
|
| StreamSampler |
A random sampler on a stream of a known size.
|
| SyncToAsyncPipe<T> |
A pipe converting multiple sync pipes into a single async one.
|
| SystemHealthMonitorable |
A monitorable covering different JVM and runtime aspects
TODO(Eyal): Consider implementing a generic JMXBean->JSON converter, so that any MXBean can be exposed
as a JsonMonitorable easily.
|
| TerminalPipe |
Base class for terminal pipes, i.e.
|
| ThreadSafeCountingInputStream |
Copied from Guava's CountingInputStream.
|
| ThrowableTextualizer |
A sample textualizer for throwable objects.
|
| TimeoutPipeException |
A pipe exception resulting from a timeout
|
| TopKPipe<T> |
A pipe returning the top K items of the input pipe, according to some predefined order relation.
|
| TxtCodecFactory<T> |
A textual encoder-decoder
|
| TxtDecoderFactory<T> |
An DecoderFactory that decodes items from a textual form, assuming that items are delimited by "\n".
|
| TxtEncoderFactory<T> |
An EncoderFactory that encodes items as text, delimiting them by "\n".
|
| TxtFileReaderPipe |
A source pipe reading lines from a given local text file or input stream
containing text content.
|
| TxtFileWriterPipe |
A terminal pipe writing text lines from the input pipe into a file.
|
| UnboundedEventsCollector<T> |
Collects counts on an unbounded set of categories.
|
| UnboundedEventStatsMap<T> |
An EventStatsMap with no predefined set of possible categories.
|
| URLTxtReaderPipe |
A source pipe providing the lines of a text resource defined by a URL.
|
| UUIDRangeSplitter |
Splits the UUID value range into K equal sized continuous shards, and returns the thresholds.
|
| ValidationPipeException |
Indicates that the contents of a pipe were found to be invalid
|
| WriterPipe |
A terminal pipe writing textual items to a given Writer, one item per line.
|