alluxio.checker

Class SparkIntegrationChecker

java.lang.Object

alluxio.checker.SparkIntegrationChecker

All Implemented Interfaces:

Serializable

public class SparkIntegrationChecker
extends Object
implements scala.Serializable

The Spark integration checker includes a Spark job to test the integration of Spark with Alluxio. This class will be triggered in client and cluster mode through spark-submit. This checker requires a running Spark cluster, but does not require a running Alluxio cluster. It will check whether Alluxio classes and Alluxio filesystem can be recognized in Spark driver and executors.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
SparkIntegrationChecker()

Method Summary

Modifier and Type	Method and Description
static void	main(String[] args) Main function will be triggered via spark-submit.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkIntegrationChecker

public SparkIntegrationChecker()

Method Detail

main

public static void main(String[] args)
                 throws Exception

Main function will be triggered via spark-submit.

Parameters:

args - optional argument mPartitions may be passed in

Throws:

Exception