| Package | Description |
|---|---|
| org.bytedeco.arrow | |
| org.bytedeco.arrow_dataset | |
| org.bytedeco.arrow.global |
| Modifier and Type | Class and Description |
|---|---|
class |
LocalFileSystem
\brief A FileSystem implementation accessing files on the local machine.
|
class |
MockFileSystem
A mock FileSystem implementation that holds its contents in memory.
|
class |
SlowFileSystem
\brief A FileSystem implementation that delegates to another
implementation but inserts latencies at various points.
|
class |
SubTreeFileSystem
\brief A FileSystem implementation that delegates to another
implementation after prepending a fixed base path.
|
| Modifier and Type | Method and Description |
|---|---|
FileSystem |
SubTreeFileSystem.base_fs() |
FileSystem |
FileLocator.filesystem() |
FileSystem |
FileSystemResult.MoveValueUnsafe() |
FileSystem |
FileSystemResult.multiply() |
FileSystem |
FileSystemResult.ValueOrDie()
Gets a mutable reference to the stored
T value. |
FileSystem |
FileSystemResult.ValueUnsafe()
Cast the internally stored value to produce a new result or propagate the stored
error.
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
SubTreeFileSystem.Equals(FileSystem other) |
boolean |
SlowFileSystem.Equals(FileSystem other) |
boolean |
MockFileSystem.Equals(FileSystem other) |
boolean |
LocalFileSystem.Equals(FileSystem other) |
boolean |
FileSystem.Equals(FileSystem other) |
FileLocator |
FileLocator.filesystem(FileSystem setter) |
| Constructor and Description |
|---|
FileSystemResult(FileSystem value)
Constructs a Result object that contains
value. |
SlowFileSystem(FileSystem base_fs,
double average_latency) |
SlowFileSystem(FileSystem base_fs,
double average_latency,
int seed) |
SlowFileSystem(FileSystem base_fs,
LatencyGenerator latencies) |
SubTreeFileSystem(BytePointer base_path,
FileSystem base_fs) |
SubTreeFileSystem(String base_path,
FileSystem base_fs) |
| Modifier and Type | Method and Description |
|---|---|
FileSystem |
FileSystemDatasetWriteOptions.filesystem()
FileSystem into which a dataset will be written.
|
FileSystem |
FileSystemDataset.filesystem()
\brief Return the filesystem.
|
FileSystem |
FileSource.filesystem()
\brief Return the filesystem, if any.
|
| Modifier and Type | Method and Description |
|---|---|
FileSystemDatasetWriteOptions |
FileSystemDatasetWriteOptions.filesystem(FileSystem setter) |
static FileSource |
FileSource.FromPaths(FileSystem fs,
StringVector paths) |
static DatasetFactoryResult |
ParquetDatasetFactory.Make(BytePointer metadata_path,
FileSystem filesystem,
ParquetFileFormat format,
ParquetFactoryOptions options) |
static DatasetFactoryResult |
ParquetDatasetFactory.Make(FileSource metadata,
BytePointer base_path,
FileSystem filesystem,
ParquetFileFormat format,
ParquetFactoryOptions options) |
static DatasetFactoryResult |
ParquetDatasetFactory.Make(FileSource metadata,
String base_path,
FileSystem filesystem,
ParquetFileFormat format,
ParquetFactoryOptions options)
\brief Create a ParquetDatasetFactory from a metadata source.
|
static DatasetFactoryResult |
FileSystemDatasetFactory.Make(FileSystem filesystem,
FileSelector selector,
FileFormat format,
FileSystemFactoryOptions options)
If options.partition_base_dir is not provided, it will be overwritten
/** with selector.base_dir.
|
static DatasetFactoryResult |
FileSystemDatasetFactory.Make(FileSystem filesystem,
StringVector paths,
FileFormat format,
FileSystemFactoryOptions options)
\brief Build a FileSystemDatasetFactory from an explicit list of
paths.
|
static FileSystemDatasetResult |
FileSystemDataset.Make(Schema schema,
Expression root_partition,
FileFormat format,
FileSystem filesystem,
FileFragmentVector fragments)
\brief Create a FileSystemDataset.
|
static DatasetFactoryResult |
ParquetDatasetFactory.Make(String metadata_path,
FileSystem filesystem,
ParquetFileFormat format,
ParquetFactoryOptions options)
\brief Create a ParquetDatasetFactory from a metadata path.
|
| Constructor and Description |
|---|
FileSource(BytePointer path,
FileSystem filesystem) |
FileSource(BytePointer path,
FileSystem filesystem,
int compression) |
FileSource(FileInfo info,
FileSystem filesystem) |
FileSource(FileInfo info,
FileSystem filesystem,
Compression.type compression) |
FileSource(FileInfo info,
FileSystem filesystem,
int compression) |
FileSource(String path,
FileSystem filesystem) |
FileSource(String path,
FileSystem filesystem,
Compression.type compression) |
| Modifier and Type | Method and Description |
|---|---|
static Status |
arrow.CopyFiles(FileSystem source_fs,
FileSelector source_sel,
FileSystem destination_fs,
BytePointer destination_base_dir) |
static Status |
arrow.CopyFiles(FileSystem source_fs,
FileSelector source_sel,
FileSystem destination_fs,
BytePointer destination_base_dir,
long chunk_size,
boolean use_threads) |
static Status |
arrow.CopyFiles(FileSystem source_fs,
FileSelector source_sel,
FileSystem destination_fs,
String destination_base_dir) |
static Status |
arrow.CopyFiles(FileSystem source_fs,
FileSelector source_sel,
FileSystem destination_fs,
String destination_base_dir,
long chunk_size,
boolean use_threads)
\brief Copy selected files, including from one FileSystem to another
Directories will be created under the destination base directory as needed.
|
Copyright © 2021. All rights reserved.