Package cormoran.pepper.parquet

Class ParquetBytesToStream

java.lang.Object

cormoran.pepper.parquet.ParquetBytesToStream

All Implemented Interfaces:

IBinaryToAvroStream, cormoran.pepper.io.IBinaryToStream<org.apache.avro.generic.GenericRecord>

public class ParquetBytesToStream
extends Object
implements IBinaryToAvroStream

Automatic transformation of a Parquet InputStream to a Stream of objects. It requires to write the file first on the file-system

Author:

Benoit Lacelle

Field Summary

Fields

Modifier and Type	Field	Description
protected boolean	deleteOnExit
protected static org.slf4j.Logger	LOGGER

Constructor Summary

Constructors

Modifier	Constructor	Description
	ParquetBytesToStream()	By default, the InputStream is flushed to a temporary file which will be deleted with the JVM
protected	ParquetBytesToStream(boolean deleteOnExit)

Method Summary

Modifier and Type	Method	Description
protected Path	pathWhereToDumpBytes()
protected URI	persist(InputStream inputStream)
Stream<org.apache.avro.generic.GenericRecord>	stream(InputStream inputStream)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface cormoran.pepper.io.IBinaryToStream

toStream

Field Detail

LOGGER

protected static final org.slf4j.Logger LOGGER

deleteOnExit

protected final boolean deleteOnExit

Constructor Detail

ParquetBytesToStream

public ParquetBytesToStream()

By default, the InputStream is flushed to a temporary file which will be deleted with the JVM

See Also:

File.deleteOnExit

ParquetBytesToStream

protected ParquetBytesToStream(boolean deleteOnExit)

Method Detail

persist

protected URI persist(InputStream inputStream)
               throws IOException

Throws:

IOException

pathWhereToDumpBytes

protected Path pathWhereToDumpBytes()
                             throws IOException

Throws:

IOException

stream

public Stream<org.apache.avro.generic.GenericRecord> stream(InputStream inputStream)
                                                     throws IOException

Specified by:

stream in interface cormoran.pepper.io.IBinaryToStream<org.apache.avro.generic.GenericRecord>

Throws:

IOException