Uses of Class
org.pipecraft.infra.io.FileReadOptions
-
Packages that use FileReadOptions Package Description org.pipecraft.infra.io org.pipecraft.pipes.serialization org.pipecraft.pipes.sync.source org.pipecraft.pipes.utils.multi -
-
Uses of FileReadOptions in org.pipecraft.infra.io
Methods in org.pipecraft.infra.io that return FileReadOptions Modifier and Type Method Description FileReadOptionsFileReadOptions. buffer(int bufferSize)Sets the buffer size (default = 8192)FileReadOptionsFileReadOptions. detectCompression(String filename)Sets the compression of the file by its extensionFileReadOptionsFileReadOptions. setCompression(Compression compression)Sets the compression of the fileMethods in org.pipecraft.infra.io with parameters of type FileReadOptions Modifier and Type Method Description static BufferedInputStreamFileUtils. getInputStream(File f, FileReadOptions options)Creates an input stream that reads from a file, using the givenFileReadOptions.static BufferedInputStreamFileUtils. getInputStream(InputStream is, FileReadOptions options)Wraps an input stream, adding the features defined by the givenFileReadOptions.static List<String>FileUtils. getLinesFromFile(File file, Charset charset, FileReadOptions options)Utility for loading the lines of a local text filestatic Set<String>FileUtils. getLinesFromFileAsSet(File file, Charset charset, FileReadOptions options)Utility for loading the lines of a local text file into a setstatic BufferedReaderFileUtils. getReader(File f, Charset charset, FileReadOptions options)Creates a new buffered reader from a given file.static BufferedReaderFileUtils. getReader(File f, FileReadOptions options)Creates a new buffered reader from a given file, using UTF8.static BufferedReaderFileUtils. getReader(InputStream is, Charset charset, FileReadOptions options)Wraps an input stream and converts it to a reader.static BufferedReaderFileUtils. getReaderFromClasspath(String path, Charset charset, FileReadOptions options)Creates a new buffered reader from a given file.static BufferedReaderFileUtils. getReaderFromClasspath(String path, FileReadOptions options)Creates a new buffered reader from a given file, using UTF8.static intFileUtils. lineCount(File source, FileReadOptions options)static List<List<String>>FileUtils. readCSV(File file, Charset charset, FileReadOptions options)Reads and parses a CSV file with no headers.static List<List<String>>FileUtils. readCSV(File file, FileReadOptions options)Reads and parses a CSV file with no headers. -
Uses of FileReadOptions in org.pipecraft.pipes.serialization
Methods in org.pipecraft.pipes.serialization with parameters of type FileReadOptions Modifier and Type Method Description ItemDecoder<T>AvroCodecFactory. newDecoder(InputStream is, FileReadOptions readOptions)ItemDecoder<T>DecoderFactory. newDecoder(InputStream is, FileReadOptions readOptions)ItemDecoder<T>DelegatingCodecFactory. newDecoder(InputStream is, FileReadOptions readOptions)ItemDecoder<T>SimpleDecoderFactory. newDecoder(InputStream is, FileReadOptions readOptions)ItemDecoder<T>TxtDecoderFactory. newDecoder(InputStream is, FileReadOptions readOptions)default ItemDecoder<T>ByteArrayDecoder. newFixedRecSizeDecoder(InputStream is, FileReadOptions readOptions, int recSize)Returns an efficientItemDecoderbased on this byte array decoder, assuming a fixed record size.Constructors in org.pipecraft.pipes.serialization with parameters of type FileReadOptions Constructor Description AbstractInputStreamItemDecoder(InputStream is, FileReadOptions readOptions)ConstructorCSVDecoder(InputStream is, FailableFunction<String[],T,ValidationPipeException> itemDetextualizer, Charset charset, char delimiter, int rowsToSkip, FileReadOptions readOptions)Constructor -
Uses of FileReadOptions in org.pipecraft.pipes.sync.source
Constructors in org.pipecraft.pipes.sync.source with parameters of type FileReadOptions Constructor Description BinInputReaderPipe(File inputFile, FileReadOptions options, DecoderFactory<T> decoderFactory)ConstructorBinInputReaderPipe(SizedInputStream is, DecoderFactory<T> decoderFactory, FileReadOptions readOptions)ConstructorStorageTxtFileFetcherReaderPipe(Storage<?,?> storage, String bucket, String path, Charset charset, int chunkSize, FileReadOptions options, File tempFolder)ConstructorStorageTxtFileFetcherReaderPipe(Storage<?,?> storage, String bucket, String path, FileReadOptions options, File tempFolder)Constructor Uses the default read chunk size and assumes UTF8StorageTxtFileReaderPipe(Storage<?,?> storageConnector, String bucketName, String path, Charset charset, int chunkSize, FileReadOptions options)ConstructorStorageTxtFileReaderPipe(Storage<?,?> storageConnector, String bucket, String path, FileReadOptions options)Constructor Uses the default read chunk size and assumes UTF8TxtFileReaderPipe(File f, Charset charset, FileReadOptions options)ConstructorTxtFileReaderPipe(File f, FileReadOptions options)ConstructorURLTxtReaderPipe(URL url, Charset charset, FileReadOptions options, int connectTimeoutMs, int readTimeoutMs)Constructor -
Uses of FileReadOptions in org.pipecraft.pipes.utils.multi
Methods in org.pipecraft.pipes.utils.multi with parameters of type FileReadOptions Modifier and Type Method Description static <T> LocalMultiFileReaderConfig.Builder<T>LocalMultiFileReaderConfig. builder(DecoderFactory<T> decoderFactory, FileReadOptions readOptions)Creates a builder set up with the given file data decoder and additional defaults.static <T,B>
StorageMultiFileReaderConfig.Builder<T,B>StorageMultiFileReaderConfig. builder(DecoderFactory<T> decoderFactory, FileReadOptions readOptions)Creates a builder set up with the given file data decoder and additional defaults.
-