org.bytedeco.arrow_dataset

Class FileSystemSource

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.arrow_dataset.Source

org.bytedeco.arrow_dataset.FileSystemSource

All Implemented Interfaces:

AutoCloseable

@Namespace(value="arrow::dataset")
 @NoOffset
 @Properties(inherit=arrow_dataset.class)
public class FileSystemSource
extends Source

\brief A Source of FileFragments.

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
FileSystemSource(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
FileFormat	format()
static SourceResult	Make(Schema schema, Expression root_partition, FileFormat format, FileSystem filesystem, FileStatsVector stats) \brief Create a FileSystemSource.
static SourceResult	Make(Schema schema, Expression root_partition, FileFormat format, FileSystem filesystem, FileStatsVector stats, ExpressionVector partitions) \brief Create a FileSystemSource with file-level partitions.
static SourceResult	Make(Schema schema, Expression root_partition, FileFormat format, FileSystem filesystem, PathForest forest, ExpressionVector partitions) \brief Create a FileSystemSource with file-level partitions.
String	ToString()
String	type_name() \brief The name identifying the kind of source

Methods inherited from class org.bytedeco.arrow_dataset.Source

GetFragments, partition_expression, schema

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, hashCode, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetof, parseBytes, physicalBytes, position, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, toString, totalBytes, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

FileSystemSource

public FileSystemSource(Pointer p)

Pointer cast constructor. Invokes Pointer.Pointer(Pointer).

Method Detail

Make

@ByVal
public static SourceResult Make(@SharedPtr @ByVal
                                       Schema schema,
                                       @SharedPtr @ByVal
                                       Expression root_partition,
                                       @SharedPtr
                                       FileFormat format,
                                       @SharedPtr
                                       FileSystem filesystem,
                                       @ByVal
                                       FileStatsVector stats)

\brief Create a FileSystemSource.

Parameters:

schema - [in] the top-level schema of the DataSource

root_partition - [in] the top-level partition of the DataSource

format - [in] file format to create fragments from.

filesystem - [in] the filesystem which files are from.

stats - [in] a list of files/directories to consume. attach additional partition expressions to FileStats found in stats. The caller is not required to provide a complete coverage of nodes and partitions.

Make

@ByVal
public static SourceResult Make(@SharedPtr @ByVal
                                       Schema schema,
                                       @SharedPtr @ByVal
                                       Expression root_partition,
                                       @SharedPtr
                                       FileFormat format,
                                       @SharedPtr
                                       FileSystem filesystem,
                                       @ByVal
                                       FileStatsVector stats,
                                       @ByVal
                                       ExpressionVector partitions)

\brief Create a FileSystemSource with file-level partitions.

Parameters:

schema - [in] the top-level schema of the DataSource

root_partition - [in] the top-level partition of the DataSource

format - [in] file format to create fragments from.

filesystem - [in] the filesystem which files are from.

stats - [in] a list of files/directories to consume.

partitions - [in] partition information associated with stats. attach additional partition expressions to FileStats found in stats. The caller is not required to provide a complete coverage of nodes and partitions.

Make

@ByVal
public static SourceResult Make(@SharedPtr @ByVal
                                       Schema schema,
                                       @SharedPtr @ByVal
                                       Expression root_partition,
                                       @SharedPtr
                                       FileFormat format,
                                       @SharedPtr
                                       FileSystem filesystem,
                                       @ByVal
                                       PathForest forest,
                                       @ByVal
                                       ExpressionVector partitions)

\brief Create a FileSystemSource with file-level partitions.

Parameters:

schema - [in] the top-level schema of the DataSource

root_partition - [in] the top-level partition of the DataSource

format - [in] file format to create fragments from.

filesystem - [in] the filesystem which files are from.

forest - [in] a PathForest of files/directories to consume.

partitions - [in] partition information associated with forest. attach additional partition expressions to FileStats found in forest. The caller is not required to provide a complete coverage of nodes and partitions.

type_name

@StdString
public String type_name()

Description copied from class: Source

\brief The name identifying the kind of source

Overrides:

type_name in class Source

ToString

@StdString
public String ToString()

format

@SharedPtr
public FileFormat format()