Package org.pipecraft.pipes.sync.source

Class MultiFileReaderPipe<T>

java.lang.Object

org.pipecraft.pipes.sync.inter.CompoundPipe<T>

org.pipecraft.pipes.sync.source.MultiFileReaderPipe<T>

Type Parameters:

T - The output item data type

All Implemented Interfaces:

Closeable, AutoCloseable, BasePipe, Pipe<T>

public class MultiFileReaderPipe<T>
extends CompoundPipe<T>

A source pipe reading multiple local binary files. Supports file filtering and ordering, as well as automatic sharding of the data.

Author:

Eyal Schneider

Constructor Summary

Constructors

Constructor	Description
MultiFileReaderPipe(LocalMultiFileReaderConfig<T> config)	Constructor

Method Summary

Modifier and Type	Method	Description
protected Pipe<T>	createPipeline()

Methods inherited from class org.pipecraft.pipes.sync.inter.CompoundPipe

close, getProgress, next, peek, start

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiFileReaderPipe

public MultiFileReaderPipe(LocalMultiFileReaderConfig<T> config)

Constructor

Parameters:

config - The multi reader config

Method Detail

createPipeline

protected Pipe<T> createPipeline()
                          throws PipeException,
                                 InterruptedException

Specified by:

createPipeline in class CompoundPipe<T>

Returns:

A new pipeline to represent the logic of this pipe

Throws:

PipeException - In case of a pipeline creation error

InterruptedException - In case that the thread is interrupted