org.bytedeco.parquet

Class ParquetFileReader

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.parquet.ParquetFileReader

All Implemented Interfaces:

AutoCloseable

@Namespace(value="parquet")
 @NoOffset
 @Properties(inherit=parquet.class)
public class ParquetFileReader
extends Pointer

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ParquetFileReader.Contents

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
ParquetFileReader()
ParquetFileReader(long size) Native array allocator.
ParquetFileReader(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
void	Close()
ParquetFileReader	getPointer(long i)
FileMetaData	metadata()
void	Open(ParquetFileReader.Contents contents)
static ParquetFileReader	Open(RandomAccessFile source)
static ParquetFileReader	Open(RandomAccessFile source, ReaderProperties props, FileMetaData metadata)
static ParquetFileReader	Open(RandomAccessSource source)
static ParquetFileReader	Open(RandomAccessSource source, ReaderProperties props, FileMetaData metadata)
static ParquetFileReader	OpenFile(BytePointer path)
static ParquetFileReader	OpenFile(BytePointer path, boolean memory_map, ReaderProperties props, FileMetaData metadata)
static ParquetFileReader	OpenFile(String path)
static ParquetFileReader	OpenFile(String path, boolean memory_map, ReaderProperties props, FileMetaData metadata)
ParquetFileReader	position(long position)
void	PreBuffer(int[] row_groups, int[] column_indices, AsyncContext ctx, CacheOptions options)
void	PreBuffer(IntBuffer row_groups, IntBuffer column_indices, AsyncContext ctx, CacheOptions options)
void	PreBuffer(IntPointer row_groups, IntPointer column_indices, AsyncContext ctx, CacheOptions options) Pre-buffer the specified column indices in all row groups.
RowGroupReader	RowGroup(int i)

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getPointer, getPointer, getPointer, hashCode, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetof, offsetof, parseBytes, physicalBytes, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ParquetFileReader

public ParquetFileReader(Pointer p)

Pointer cast constructor. Invokes Pointer.Pointer(Pointer).

ParquetFileReader

public ParquetFileReader(long size)

Native array allocator. Access with Pointer.position(long).

ParquetFileReader

public ParquetFileReader()

Method Detail

position

public ParquetFileReader position(long position)

Overrides:

position in class Pointer

getPointer

public ParquetFileReader getPointer(long i)

Overrides:

getPointer in class Pointer

Open

@UniquePtr
public static ParquetFileReader Open(@UniquePtr
                                                 RandomAccessSource source,
                                                 @Const @ByRef(nullValue="parquet::ReaderProperties(parquet::default_reader_properties())")
                                                 ReaderProperties props,
                                                 @SharedPtr
                                                 FileMetaData metadata)

Open

@UniquePtr
public static ParquetFileReader Open(@UniquePtr
                                                 RandomAccessSource source)

Open

@UniquePtr
public static ParquetFileReader Open(@SharedPtr @Cast(value={"","std::shared_ptr<arrow::io::RandomAccessFile>"})
                                                 RandomAccessFile source,
                                                 @Const @ByRef(nullValue="parquet::ReaderProperties(parquet::default_reader_properties())")
                                                 ReaderProperties props,
                                                 @SharedPtr
                                                 FileMetaData metadata)

Open

@UniquePtr
public static ParquetFileReader Open(@SharedPtr @Cast(value={"","std::shared_ptr<arrow::io::RandomAccessFile>"})
                                                 RandomAccessFile source)

OpenFile

@UniquePtr
public static ParquetFileReader OpenFile(@StdString
                                                     String path,
                                                     @Cast(value="bool")
                                                     boolean memory_map,
                                                     @Const @ByRef(nullValue="parquet::ReaderProperties(parquet::default_reader_properties())")
                                                     ReaderProperties props,
                                                     @SharedPtr
                                                     FileMetaData metadata)

OpenFile

@UniquePtr
public static ParquetFileReader OpenFile(@StdString
                                                     String path)

OpenFile

@UniquePtr
public static ParquetFileReader OpenFile(@StdString
                                                     BytePointer path,
                                                     @Cast(value="bool")
                                                     boolean memory_map,
                                                     @Const @ByRef(nullValue="parquet::ReaderProperties(parquet::default_reader_properties())")
                                                     ReaderProperties props,
                                                     @SharedPtr
                                                     FileMetaData metadata)

OpenFile

@UniquePtr
public static ParquetFileReader OpenFile(@StdString
                                                     BytePointer path)

Open

public void Open(@UniquePtr
                 ParquetFileReader.Contents contents)

Close

public void Close()

RowGroup

@SharedPtr
public RowGroupReader RowGroup(int i)

metadata

@SharedPtr
public FileMetaData metadata()

PreBuffer

public void PreBuffer(@StdVector
                      IntPointer row_groups,
                      @StdVector
                      IntPointer column_indices,
                      @Const @ByRef
                      AsyncContext ctx,
                      @Const @ByRef
                      CacheOptions options)

Pre-buffer the specified column indices in all row groups. Readers can optionally call this to cache the necessary slices of the file in-memory before deserialization. Arrow readers can automatically do this via an option. This is intended to increase performance when reading from high-latency filesystems (e.g. Amazon S3). After calling this, creating readers for row groups/column indices that were not buffered may fail. Creating multiple readers for the a subset of the buffered regions is acceptable. This may be called again to buffer a different set of row groups/columns. If memory usage is a concern, note that data will remain buffered in memory until either \a PreBuffer() is called again, or the reader itself is destructed. Reading - and buffering - only one row group at a time may be useful.

PreBuffer

public void PreBuffer(@StdVector
                      IntBuffer row_groups,
                      @StdVector
                      IntBuffer column_indices,
                      @Const @ByRef
                      AsyncContext ctx,
                      @Const @ByRef
                      CacheOptions options)

PreBuffer

public void PreBuffer(@StdVector
                      int[] row_groups,
                      @StdVector
                      int[] column_indices,
                      @Const @ByRef
                      AsyncContext ctx,
                      @Const @ByRef
                      CacheOptions options)