org.bytedeco.parquet

Class ParquetFileReader

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.parquet.ParquetFileReader

All Implemented Interfaces:

AutoCloseable

@Namespace(value="parquet")
 @NoOffset
 @Properties(inherit=parquet.class)
public class ParquetFileReader
extends Pointer

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ParquetFileReader.Contents

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
ParquetFileReader()
ParquetFileReader(long size) Native array allocator.
ParquetFileReader(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
void	Close()
ParquetFileReader	getPointer(long i)
FileMetaData	metadata()
void	Open(ParquetFileReader.Contents contents)
static ParquetFileReader	Open(RandomAccessFile source)
static ParquetFileReader	Open(RandomAccessFile source, ReaderProperties props, FileMetaData metadata)
static ParquetFileReader	OpenFile(BytePointer path)
static ParquetFileReader	OpenFile(BytePointer path, boolean memory_map, ReaderProperties props, FileMetaData metadata)
static ParquetFileReader	OpenFile(String path)
static ParquetFileReader	OpenFile(String path, boolean memory_map, ReaderProperties props, FileMetaData metadata)
ParquetFileReader	position(long position)
Future	PreBuffer(int[] row_groups, int[] column_indices, IOContext ctx, CacheOptions options)
Future	PreBuffer(IntBuffer row_groups, IntBuffer column_indices, IOContext ctx, CacheOptions options)
Future	PreBuffer(IntPointer row_groups, IntPointer column_indices, IOContext ctx, CacheOptions options) Pre-buffer the specified column indices in all row groups.
RowGroupReader	RowGroup(int i)

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getPointer, getPointer, getPointer, hashCode, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ParquetFileReader

public ParquetFileReader(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

ParquetFileReader

public ParquetFileReader(long size)

Native array allocator. Access with Pointer.position(long).

ParquetFileReader

public ParquetFileReader()

Method Detail

position

public ParquetFileReader position(long position)

Overrides:

position in class Pointer

getPointer

public ParquetFileReader getPointer(long i)

Overrides:

getPointer in class Pointer

Open

@UniquePtr
public static ParquetFileReader Open(@SharedPtr @Cast(value={"","std::shared_ptr<arrow::io::RandomAccessFile>"})
                                                RandomAccessFile source,
                                                @Const @ByRef(nullValue="parquet::ReaderProperties(parquet::default_reader_properties())")
                                                ReaderProperties props,
                                                @SharedPtr
                                                FileMetaData metadata)

Open

@UniquePtr
public static ParquetFileReader Open(@SharedPtr @Cast(value={"","std::shared_ptr<arrow::io::RandomAccessFile>"})
                                                RandomAccessFile source)

OpenFile

@UniquePtr
public static ParquetFileReader OpenFile(@StdString
                                                    String path,
                                                    @Cast(value="bool")
                                                    boolean memory_map,
                                                    @Const @ByRef(nullValue="parquet::ReaderProperties(parquet::default_reader_properties())")
                                                    ReaderProperties props,
                                                    @SharedPtr
                                                    FileMetaData metadata)

OpenFile

@UniquePtr
public static ParquetFileReader OpenFile(@StdString
                                                    String path)

OpenFile

@UniquePtr
public static ParquetFileReader OpenFile(@StdString
                                                    BytePointer path,
                                                    @Cast(value="bool")
                                                    boolean memory_map,
                                                    @Const @ByRef(nullValue="parquet::ReaderProperties(parquet::default_reader_properties())")
                                                    ReaderProperties props,
                                                    @SharedPtr
                                                    FileMetaData metadata)

OpenFile

@UniquePtr
public static ParquetFileReader OpenFile(@StdString
                                                    BytePointer path)

Open

public void Open(@UniquePtr
                 ParquetFileReader.Contents contents)

Close

public void Close()

RowGroup

@SharedPtr
public RowGroupReader RowGroup(int i)

metadata

@SharedPtr
public FileMetaData metadata()

PreBuffer

@ByVal
public Future PreBuffer(@StdVector
                               IntPointer row_groups,
                               @StdVector
                               IntPointer column_indices,
                               @Const @ByRef
                               IOContext ctx,
                               @Const @ByRef
                               CacheOptions options)

Pre-buffer the specified column indices in all row groups. Readers can optionally call this to cache the necessary slices of the file in-memory before deserialization. Arrow readers can automatically do this via an option. This is intended to increase performance when reading from high-latency filesystems (e.g. Amazon S3). After calling this, creating readers for row groups/column indices that were not buffered may fail. Creating multiple readers for the a subset of the buffered regions is acceptable. This may be called again to buffer a different set of row groups/columns. If memory usage is a concern, note that data will remain buffered in memory until either \a PreBuffer() is called again, or the reader itself is destructed. Reading - and buffering - only one row group at a time may be useful.

PreBuffer

@ByVal
public Future PreBuffer(@StdVector
                               IntBuffer row_groups,
                               @StdVector
                               IntBuffer column_indices,
                               @Const @ByRef
                               IOContext ctx,
                               @Const @ByRef
                               CacheOptions options)

PreBuffer

@ByVal
public Future PreBuffer(@StdVector
                               int[] row_groups,
                               @StdVector
                               int[] column_indices,
                               @Const @ByRef
                               IOContext ctx,
                               @Const @ByRef
                               CacheOptions options)