org.bytedeco.arrow_dataset

Class FileSystemSourceFactory

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.arrow_dataset.SourceFactory

org.bytedeco.arrow_dataset.FileSystemSourceFactory

All Implemented Interfaces:

AutoCloseable

@Namespace(value="arrow::dataset")
 @NoOffset
 @Properties(inherit=arrow_dataset.class)
public class FileSystemSourceFactory
extends SourceFactory

\brief FileSystemSourceFactory creates a Source from a vector of fs::FileStats or a fs::FileSelector.

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
FileSystemSourceFactory(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
SourceResult	Finish(Schema schema) \brief Create a Source with the given schema.
SchemaVectorResult	InspectSchemas() \brief Get the schemas of the Fragments and Partitioning.
static SourceFactoryResult	Make(FileSystem filesystem, FileSelector selector, FileFormat format, FileSystemFactoryOptions options) If options.partition_base_dir is not provided, it will be overwritten /** with selector.base_dir.
static SourceFactoryResult	Make(FileSystem filesystem, StringVector paths, FileFormat format, FileSystemFactoryOptions options) \brief Build a FileSystemSourceFactory from an explicit list of paths.

Methods inherited from class org.bytedeco.arrow_dataset.SourceFactory

Finish, Inspect, root_partition, SetRootPartition

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, hashCode, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetof, parseBytes, physicalBytes, position, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, toString, totalBytes, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

FileSystemSourceFactory

public FileSystemSourceFactory(Pointer p)

Pointer cast constructor. Invokes Pointer.Pointer(Pointer).

Method Detail

Make

@ByVal
public static SourceFactoryResult Make(@SharedPtr
                                              FileSystem filesystem,
                                              @Const @ByRef
                                              StringVector paths,
                                              @SharedPtr
                                              FileFormat format,
                                              @ByVal
                                              FileSystemFactoryOptions options)

\brief Build a FileSystemSourceFactory from an explicit list of paths.

Parameters:

filesystem - [in] passed to FileSystemSource

paths - [in] passed to FileSystemSource

format - [in] passed to FileSystemSource

options - [in] see FileSystemFactoryOptions for more information.

Make

@ByVal
public static SourceFactoryResult Make(@SharedPtr
                                              FileSystem filesystem,
                                              @ByVal
                                              FileSelector selector,
                                              @SharedPtr
                                              FileFormat format,
                                              @ByVal
                                              FileSystemFactoryOptions options)

If options.partition_base_dir is not provided, it will be overwritten /** with selector.base_dir. /** /** @param filesystem [in] passed to FileSystemSource /** @param selector [in] used to crawl and search files /** @param format [in] passed to FileSystemSource /** @param options [in] see FileSystemFactoryOptions for more information.

InspectSchemas

@ByVal
public SchemaVectorResult InspectSchemas()

Description copied from class: SourceFactory

\brief Get the schemas of the Fragments and Partitioning.

Overrides:

InspectSchemas in class SourceFactory

Finish

@ByVal
public SourceResult Finish(@Const @SharedPtr @ByRef
                                  Schema schema)

Description copied from class: SourceFactory

\brief Create a Source with the given schema.

Overrides:

Finish in class SourceFactory