org.locationtech.geowave.format.avro

Class GeoWaveAvroIngestPlugin

java.lang.Object

org.locationtech.geowave.adapter.vector.ingest.AbstractSimpleFeatureIngestPlugin<AvroSimpleFeatureCollection>

org.locationtech.geowave.format.avro.GeoWaveAvroIngestPlugin

All Implemented Interfaces:

org.locationtech.geowave.core.index.persist.Persistable, GeoWaveAvroFormatPlugin<AvroSimpleFeatureCollection,org.opengis.feature.simple.SimpleFeature>, GeoWaveAvroPluginBase<AvroSimpleFeatureCollection>, GeoWaveAvroSchemaProvider, IngestFromHdfsPlugin<AvroSimpleFeatureCollection,org.opengis.feature.simple.SimpleFeature>, org.locationtech.geowave.core.store.ingest.DataAdapterProvider<org.opengis.feature.simple.SimpleFeature>, org.locationtech.geowave.core.store.ingest.IndexProvider, org.locationtech.geowave.core.store.ingest.IngestPluginBase<URL,org.opengis.feature.simple.SimpleFeature>, org.locationtech.geowave.core.store.ingest.LocalFileIngestPlugin<org.opengis.feature.simple.SimpleFeature>, org.locationtech.geowave.core.store.ingest.LocalPluginBase

public class GeoWaveAvroIngestPlugin
extends AbstractSimpleFeatureIngestPlugin<AvroSimpleFeatureCollection>

This plugin is used for ingesting any GPX formatted data from a local file system into GeoWave as GeoTools' SimpleFeatures. It supports the default configuration of spatial and spatial-temporal indices and it will support wither directly ingesting GPX data from a local file system to GeoWave or to stage the data in an intermediate format in HDFS and then to ingest it into GeoWave using a map-reduce job. It supports OSM metadata.xml files if the file is directly in the root base directory that is passed in command-line to the ingest framework.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	GeoWaveAvroIngestPlugin.IngestAvroFeaturesFromHdfs

Nested classes/interfaces inherited from class org.locationtech.geowave.adapter.vector.ingest.AbstractSimpleFeatureIngestPlugin

AbstractSimpleFeatureIngestPlugin.AbstractIngestSimpleFeatureWithMapper<I>

Field Summary

Fields inherited from class org.locationtech.geowave.adapter.vector.ingest.AbstractSimpleFeatureIngestPlugin

filterOptionProvider, serializationFormatOptionProvider, simpOptionProvider, typeNameProvider

Constructor Summary

Constructors

Constructor and Description
GeoWaveAvroIngestPlugin()

Method Summary

Modifier and Type	Method and Description
org.apache.avro.Schema	getAvroSchema()
org.locationtech.geowave.core.store.api.DataTypeAdapter<org.opengis.feature.simple.SimpleFeature>[]	getDataAdapters(URL url)
String[]	getFileExtensionFilters()
org.locationtech.geowave.core.store.ingest.IngestPluginBase<AvroSimpleFeatureCollection,org.opengis.feature.simple.SimpleFeature>	getIngestWithAvroPlugin()
org.locationtech.geowave.core.store.api.Index[]	getRequiredIndices()
String[]	getSupportedIndexTypes()
protected org.opengis.feature.simple.SimpleFeatureType[]	getTypes()
IngestWithMapper<AvroSimpleFeatureCollection,org.opengis.feature.simple.SimpleFeature>	ingestWithMapper()
IngestWithReducer<AvroSimpleFeatureCollection,?,?,org.opengis.feature.simple.SimpleFeature>	ingestWithReducer()
void	init(URL baseDirectory)
boolean	isUseReducerPreferred()
boolean	supportsFile(URL file)
org.locationtech.geowave.core.store.CloseableIterator<AvroSimpleFeatureCollection>	toAvroObjects(URL input)
protected org.locationtech.geowave.core.store.CloseableIterator<org.locationtech.geowave.core.store.ingest.GeoWaveData<org.opengis.feature.simple.SimpleFeature>>	toGeoWaveDataInternal(AvroSimpleFeatureCollection featureCollection, String[] indexNames)

Methods inherited from class org.locationtech.geowave.adapter.vector.ingest.AbstractSimpleFeatureIngestPlugin

fromBinary, getDataAdapters, newAdapter, setFilterProvider, setGeometrySimpOptionProvider, setSerializationFormatProvider, setTypeNameProvider, toBinary, toGeoWaveData, wrapIteratorWithFilters

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GeoWaveAvroIngestPlugin

public GeoWaveAvroIngestPlugin()

Method Detail

getFileExtensionFilters

public String[] getFileExtensionFilters()

init

public void init(URL baseDirectory)

supportsFile

public boolean supportsFile(URL file)

getTypes

protected org.opengis.feature.simple.SimpleFeatureType[] getTypes()

Specified by:

getTypes in class AbstractSimpleFeatureIngestPlugin<AvroSimpleFeatureCollection>

getAvroSchema

public org.apache.avro.Schema getAvroSchema()

toAvroObjects

public org.locationtech.geowave.core.store.CloseableIterator<AvroSimpleFeatureCollection> toAvroObjects(URL input)

isUseReducerPreferred

public boolean isUseReducerPreferred()

ingestWithMapper

public IngestWithMapper<AvroSimpleFeatureCollection,org.opengis.feature.simple.SimpleFeature> ingestWithMapper()

ingestWithReducer

public IngestWithReducer<AvroSimpleFeatureCollection,?,?,org.opengis.feature.simple.SimpleFeature> ingestWithReducer()

getDataAdapters

public org.locationtech.geowave.core.store.api.DataTypeAdapter<org.opengis.feature.simple.SimpleFeature>[] getDataAdapters(URL url)

toGeoWaveDataInternal

protected org.locationtech.geowave.core.store.CloseableIterator<org.locationtech.geowave.core.store.ingest.GeoWaveData<org.opengis.feature.simple.SimpleFeature>> toGeoWaveDataInternal(AvroSimpleFeatureCollection featureCollection,
                                                                                                                                                                                        String[] indexNames)

Specified by:

toGeoWaveDataInternal in class AbstractSimpleFeatureIngestPlugin<AvroSimpleFeatureCollection>

getRequiredIndices

public org.locationtech.geowave.core.store.api.Index[] getRequiredIndices()

getIngestWithAvroPlugin

public org.locationtech.geowave.core.store.ingest.IngestPluginBase<AvroSimpleFeatureCollection,org.opengis.feature.simple.SimpleFeature> getIngestWithAvroPlugin()

getSupportedIndexTypes

public String[] getSupportedIndexTypes()