ingest

Type Members

abstract class AbstractIngest extends Runnable with LazyLogging

Base class for handling ingestion of local or distributed files
abstract class AbstractIngestJob extends AnyRef

Abstract class that handles configuration and tracking of the remote job
class AutoIngest extends AbstractIngest

Attempts to ingest files based on metadata stored in the file itself.
Attempts to ingest files based on metadata stored in the file itself. Operates on csv, tsv, and avro files.
class AvroIngestConverter extends LocalIngestConverter

These classes operate on files in the specific avro format used by org.locationtech.geomesa.features.avro.AvroDataFileWriter.
These classes operate on files in the specific avro format used by org.locationtech.geomesa.features.avro.AvroDataFileWriter. The format is used by the geomesa tools export, for convenience.
class AvroIngestJob extends AbstractIngestJob

Distributed job to ingest files in the specific avro format.
class ConverterIngest extends AbstractIngest

Ingestion that uses geomesa converters to process input files
class ConverterIngestJob extends AbstractIngestJob

Distributed job that uses converters to process input files
class DelimitedIngestConverter extends LocalIngestConverter

Takes a specially formatted file and turns it into simple features.
Takes a specially formatted file and turns it into simple features. Will create the simple feature type if it does not already exist.
class DelimitedIngestInputFormat extends FileStreamInputFormat
class DelimitedIngestJob extends AbstractIngestJob

Takes specially formatted files and turns them into simple features.
Takes specially formatted files and turns them into simple features. Will create the simple feature type if it does not already exist.
class DelimitedIngestRecordReader extends FileStreamRecordReader
trait IngestCommand[DS <: DataStore] extends DataStoreCommand[DS]
class IngestMapper extends Mapper[LongWritable, SimpleFeature, Text, SimpleFeature] with LazyLogging

Takes the input and writes it to the output - all our main work is done in the input format
trait IngestParams extends OptionalTypeNameParam with OptionalFeatureSpecParam with OptionalConverterConfigParam with OptionalInputFormatParam
trait LocalIngestConverter extends Closeable
class ShapefileIngest extends Runnable

Value Members

object AbstractIngest
object AutoIngestDelimited

These classes operate on files in a specific format.
These classes operate on files in a specific format. The format is used by the geomesa tools export, for convenience.
The first line of each file is expected to be a delimited (tab or comma) list of attributes for a simple feature type, starting with the reserved word 'id'. For example:
id,name:String,dtg:Date,geom:Point:srid=4326
The first line of the file will be used to create a simple feature type. All subsequent lines must be type convertible to the appropriate simple feature attribute.
object IngestCommand

package ingest

Type Members

abstract class AbstractIngest extends Runnable with LazyLogging

abstract class AbstractIngestJob extends AnyRef

class AutoIngest extends AbstractIngest

class AvroIngestConverter extends LocalIngestConverter

class AvroIngestJob extends AbstractIngestJob

class ConverterIngest extends AbstractIngest

class ConverterIngestJob extends AbstractIngestJob

class DelimitedIngestConverter extends LocalIngestConverter

class DelimitedIngestInputFormat extends FileStreamInputFormat

class DelimitedIngestJob extends AbstractIngestJob

class DelimitedIngestRecordReader extends FileStreamRecordReader

trait IngestCommand[DS <: DataStore] extends DataStoreCommand[DS]

class IngestMapper extends Mapper[LongWritable, SimpleFeature, Text, SimpleFeature] with LazyLogging

trait IngestParams extends OptionalTypeNameParam with OptionalFeatureSpecParam with OptionalConverterConfigParam with OptionalInputFormatParam

trait LocalIngestConverter extends Closeable

class ShapefileIngest extends Runnable

Value Members

object AbstractIngest

object AutoIngestDelimited

object IngestCommand

Ungrouped