org.bytedeco.arrow_dataset

Class FileSystemDatasetFactory

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.arrow_dataset.DatasetFactory

org.bytedeco.arrow_dataset.FileSystemDatasetFactory

All Implemented Interfaces:

AutoCloseable

@Namespace(value="arrow::dataset")
 @NoOffset
 @Properties(inherit=arrow_dataset.class)
public class FileSystemDatasetFactory
extends DatasetFactory

\brief FileSystemDatasetFactory creates a Dataset from a vector of fs::FileInfo or a fs::FileSelector. \ingroup dataset-filesystem

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
FileSystemDatasetFactory(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
DatasetResult	Finish(FinishOptions options) \brief Create a Dataset with the given options
SchemaVectorResult	InspectSchemas(InspectOptions options) \brief Get the schemas of the Fragments and Partitioning.
static DatasetFactoryResult	Make(BytePointer uri, FileFormat format, FileSystemFactoryOptions options)
static DatasetFactoryResult	Make(FileSystem filesystem, FileSelector selector, FileFormat format, FileSystemFactoryOptions options) If options.partition_base_dir is not provided, it will be overwritten /** with selector.base_dir.
static DatasetFactoryResult	Make(FileSystem filesystem, StringVector paths, FileFormat format, FileSystemFactoryOptions options) \brief Build a FileSystemDatasetFactory from an explicit list of paths.
static DatasetFactoryResult	Make(String uri, FileFormat format, FileSystemFactoryOptions options) \brief Build a FileSystemDatasetFactory from an uri including filesystem information.

Methods inherited from class org.bytedeco.arrow_dataset.DatasetFactory

Finish, Finish, Inspect, Inspect, root_partition, SetRootPartition

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getPointer, getPointer, getPointer, getPointer, hashCode, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, position, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

FileSystemDatasetFactory

public FileSystemDatasetFactory(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

Method Detail

Make

@ByVal
public static DatasetFactoryResult Make(@SharedPtr
                                               FileSystem filesystem,
                                               @Const @ByRef
                                               StringVector paths,
                                               @SharedPtr
                                               FileFormat format,
                                               @ByVal
                                               FileSystemFactoryOptions options)

\brief Build a FileSystemDatasetFactory from an explicit list of paths.

Parameters:

filesystem - [in] passed to FileSystemDataset

paths - [in] passed to FileSystemDataset

format - [in] passed to FileSystemDataset

options - [in] see FileSystemFactoryOptions for more information.

Make

@ByVal
public static DatasetFactoryResult Make(@SharedPtr
                                               FileSystem filesystem,
                                               @ByVal
                                               FileSelector selector,
                                               @SharedPtr
                                               FileFormat format,
                                               @ByVal
                                               FileSystemFactoryOptions options)

If options.partition_base_dir is not provided, it will be overwritten /** with selector.base_dir. /** /** @param filesystem [in] passed to FileSystemDataset /** @param selector [in] used to crawl and search files /** @param format [in] passed to FileSystemDataset /** @param options [in] see FileSystemFactoryOptions for more information.

Make

@ByVal
public static DatasetFactoryResult Make(@StdString
                                               String uri,
                                               @SharedPtr
                                               FileFormat format,
                                               @ByVal
                                               FileSystemFactoryOptions options)

\brief Build a FileSystemDatasetFactory from an uri including filesystem information.

Parameters:

uri - [in] passed to FileSystemDataset

format - [in] passed to FileSystemDataset

options - [in] see FileSystemFactoryOptions for more information.

Make

@ByVal
public static DatasetFactoryResult Make(@StdString
                                               BytePointer uri,
                                               @SharedPtr
                                               FileFormat format,
                                               @ByVal
                                               FileSystemFactoryOptions options)

InspectSchemas

@ByVal
public SchemaVectorResult InspectSchemas(@ByVal
                                                InspectOptions options)

Description copied from class: DatasetFactory

\brief Get the schemas of the Fragments and Partitioning.

Overrides:

InspectSchemas in class DatasetFactory

Finish

@ByVal
public DatasetResult Finish(@ByVal
                                   FinishOptions options)

Description copied from class: DatasetFactory

\brief Create a Dataset with the given options

Overrides:

Finish in class DatasetFactory