org.bytedeco.arrow_dataset

Class HivePartitioning

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.arrow_dataset.Partitioning

org.bytedeco.arrow_dataset.KeyValuePartitioning

org.bytedeco.arrow_dataset.HivePartitioning

All Implemented Interfaces:

AutoCloseable

@Namespace(value="arrow::dataset")
 @Properties(inherit=arrow_dataset.class)
public class HivePartitioning
extends KeyValuePartitioning

\brief Multi-level, directory based partitioning originating from Apache Hive with all data files stored in the leaf directories. Data is partitioned by static values of a particular column in the schema. Partition keys are represented in the form $key=$value in directory names. Field order is ignored, as are missing or unrecognized field names. For example given schema the path "/day=321/ignored=3.4/year=2009" parses to ("year"_ == 2009 and "day"_ == 321)

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.arrow_dataset.KeyValuePartitioning

KeyValuePartitioning.Key

Nested classes/interfaces inherited from class org.bytedeco.arrow_dataset.Partitioning

Partitioning.PartitionedBatches

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
HivePartitioning(Pointer p) Pointer cast constructor.
HivePartitioning(Schema schema)
HivePartitioning(Schema schema, ArrayVector dictionaries)

Method Summary

Modifier and Type	Method and Description
static PartitioningFactory	MakeFactory()
static PartitioningFactory	MakeFactory(PartitioningFactoryOptions arg0)
static Pointer	ParseKey(BytePointer segment)
static Pointer	ParseKey(String segment)
String	type_name() \brief The name identifying the kind of partitioning

Methods inherited from class org.bytedeco.arrow_dataset.KeyValuePartitioning

Format, Parse, Parse, Partition, SetDefaultValuesFromKeys

Methods inherited from class org.bytedeco.arrow_dataset.Partitioning

Default, schema

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getPointer, getPointer, getPointer, getPointer, hashCode, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetof, offsetof, parseBytes, physicalBytes, position, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

HivePartitioning

public HivePartitioning(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

HivePartitioning

public HivePartitioning(@SharedPtr @ByVal
                        Schema schema,
                        @ByVal(nullValue="arrow::ArrayVector({})")
                        ArrayVector dictionaries)

HivePartitioning

public HivePartitioning(@SharedPtr @ByVal
                        Schema schema)

Method Detail

type_name

@StdString
public String type_name()

Description copied from class: Partitioning

\brief The name identifying the kind of partitioning

Overrides:

type_name in class Partitioning

ParseKey

@ByVal
 @Cast(value="arrow::util::optional<Key>*")
public static Pointer ParseKey(@StdString
                                                                                    String segment)

ParseKey

@ByVal
 @Cast(value="arrow::util::optional<Key>*")
public static Pointer ParseKey(@StdString
                                                                                    BytePointer segment)

MakeFactory

@SharedPtr
public static PartitioningFactory MakeFactory(@ByVal(nullValue="arrow::dataset::PartitioningFactoryOptions({})")
                                                          PartitioningFactoryOptions arg0)

MakeFactory

@SharedPtr
public static PartitioningFactory MakeFactory()