org.bytedeco.arrow_dataset

Class Fragment

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.arrow_dataset.Fragment

All Implemented Interfaces:

AutoCloseable

Direct Known Subclasses:

FileFragment, InMemoryFragment

@Namespace(value="arrow::dataset")
 @NoOffset
 @Properties(inherit=arrow_dataset.class)
public class Fragment
extends Pointer

\brief A granular piece of a Dataset, such as an individual file, which can be read/scanned separately from other fragments. A Fragment yields a collection of RecordBatch, encapsulated in one or more ScanTasks.

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
Fragment(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
Expression	partition_expression() \brief An expression which evaluates to true for all data viewed by this Fragment.
ScanOptions	scan_options() \brief Filtering, schema reconciliation, and partition options to use when scanning this fragment.
ScanTaskIteratorResult	Scan(ScanContext context) \brief Scan returns an iterator of ScanTasks, each of which yields RecordBatches from this Fragment.
boolean	splittable() \brief Return true if the fragment can benefit from parallel scanning

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, hashCode, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetof, parseBytes, physicalBytes, position, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, toString, totalBytes, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

Fragment

public Fragment(Pointer p)

Pointer cast constructor. Invokes Pointer.Pointer(Pointer).

Method Detail

Scan

@ByVal
public ScanTaskIteratorResult Scan(@SharedPtr
                                          ScanContext context)

\brief Scan returns an iterator of ScanTasks, each of which yields RecordBatches from this Fragment.

splittable

@Cast(value="bool")
public boolean splittable()

\brief Return true if the fragment can benefit from parallel scanning

scan_options

@SharedPtr
public ScanOptions scan_options()

\brief Filtering, schema reconciliation, and partition options to use when scanning this fragment. May be nullptr, which indicates that no filtering or schema reconciliation will be performed and all partitions will be scanned.

partition_expression

@Const
 @SharedPtr
 @ByRef
public Expression partition_expression()

\brief An expression which evaluates to true for all data viewed by this Fragment. May be null, which indicates no information is available.