de.unibonn.iai.eis.luzzu.io.impl

Class SparkStreamProcessor

java.lang.Object

de.unibonn.iai.eis.luzzu.io.impl.SparkStreamProcessor

All Implemented Interfaces:

IOProcessor, Serializable

public class SparkStreamProcessor
extends Object
implements IOProcessor, Serializable

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
SparkStreamProcessor(String datasetURI, boolean genQualityReport, com.hp.hpl.jena.rdf.model.Model configuration)

Method Summary

Methods

Modifier and Type	Method and Description
void	cancelMetricAssessment() Cancels the metric assessment and closes all open threads
void	cleanUp() Cleans up memory from unused objects after processing is finished
static void	close()
List<IOStats>	getIOStats() Returns statistics related to the IO processor such as the number of processed statements
void	processorWorkFlow() A workflow initiating the whole assessment process.
com.hp.hpl.jena.rdf.model.Model	retreiveQualityReport()
void	setUpProcess() Initialise the io processor with the necessary in-memory objects and metrics
void	startProcessing() Process the dataset for quality assessment

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkStreamProcessor

public SparkStreamProcessor(String datasetURI,
                    boolean genQualityReport,
                    com.hp.hpl.jena.rdf.model.Model configuration)

Method Detail

processorWorkFlow

public void processorWorkFlow()

Description copied from interface: IOProcessor

A workflow initiating the whole assessment process. Such method usually executes the setUpProcess and startProcessing methods.

Specified by:

processorWorkFlow in interface IOProcessor

setUpProcess

public void setUpProcess()

Description copied from interface: IOProcessor

Initialise the io processor with the necessary in-memory objects and metrics

Specified by:

setUpProcess in interface IOProcessor

cleanUp

public void cleanUp()
             throws ProcessorNotInitialised

Description copied from interface: IOProcessor

Cleans up memory from unused objects after processing is finished

Specified by:

cleanUp in interface IOProcessor

Throws:

ProcessorNotInitialised

close

public static void close()

startProcessing

public void startProcessing()
                     throws ProcessorNotInitialised

Description copied from interface: IOProcessor

Process the dataset for quality assessment

Specified by:

startProcessing in interface IOProcessor

Throws:

ProcessorNotInitialised

retreiveQualityReport

public com.hp.hpl.jena.rdf.model.Model retreiveQualityReport()

Specified by:

retreiveQualityReport in interface IOProcessor

getIOStats

public List<IOStats> getIOStats()
                         throws ProcessorNotInitialised

Description copied from interface: IOProcessor

Returns statistics related to the IO processor such as the number of processed statements

Specified by:

getIOStats in interface IOProcessor

Returns:

Throws:

ProcessorNotInitialised

cancelMetricAssessment

public void cancelMetricAssessment()
                            throws ProcessorNotInitialised

Description copied from interface: IOProcessor

Cancels the metric assessment and closes all open threads

Specified by:

cancelMetricAssessment in interface IOProcessor

Throws:

ProcessorNotInitialised