org.antipathy.scoozie.action

SparkAction

final class SparkAction extends Action

Oozie Spark action definition

Linear Supertypes
Action, OozieProperties, Nameable, XmlSerializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. SparkAction
  2. Action
  3. OozieProperties
  4. Nameable
  5. XmlSerializable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SparkAction(name: String, sparkSettings: String, sparkMasterURL: String, sparkMode: String, sparkJobName: String, mainClass: String, sparkJar: String, sparkOptions: String, commandLineArgs: Seq[String], files: Seq[String], prepareOption: Option[Prepare] = scala.None, configuration: Configuration, yarnConfig: YarnConfig)

    name

    the name of the action

    sparkSettings

    the spark settings location

    sparkMasterURL

    the url of the spark master

    sparkMode

    the mode the spark job should run in

    sparkJobName

    the name of the spark job

    mainClass

    the main class of the spark job

    sparkJar

    the location of the spark jar

    sparkOptions

    options for the spark job

    commandLineArgs

    command line arguments for the spark job

    prepareOption

    an optional prepare phase for the action

    configuration

    additional config for this action

    yarnConfig

    Yarn configuration for this action

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def buildSequenceProperties(actionName: String, propName: String, valueSequence: Seq[String]): Map[String, String]

    Convert a sequence of property values to a map of KV pairs

    Convert a sequence of property values to a map of KV pairs

    actionName

    The name of the action to insert into the property name

    valueSequence

    The property values

    Attributes
    protected
    Definition Classes
    OozieProperties

  8. def buildStringOptionProperty(actionName: String, propName: String, option: Option[String]): Map[_ <: String, String]

    Attributes
    protected
    Definition Classes
    OozieProperties

  9. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  10. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  11. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  12. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  13. def formatProperty(property: String): String

    format predicates to expected pattern

    format predicates to expected pattern

    Attributes
    protected
    Definition Classes
    OozieProperties

  14. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  15. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  16. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  17. val name: String

    the name of the action

    the name of the action

    Definition Classes
    SparkAction → Nameable

  18. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  19. final def notify(): Unit

    Definition Classes
    AnyRef

  20. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  21. def properties: Map[String, String]

    Get the Oozie properties for this object

    Get the Oozie properties for this object

    Definition Classes
    SparkAction → OozieProperties

  22. def requiresCredentials: Boolean

    Does this action require yarn credentials in Kerberos environments

    Does this action require yarn credentials in Kerberos environments

    Definition Classes
    Action

  23. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  24. def toString(): String

    Definition Classes
    AnyRef → Any

  25. def toXML: Elem

    The XML for this node

    The XML for this node

    Definition Classes
    SparkAction → XmlSerializable

  26. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  27. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  28. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  29. val xmlns: Option[String]

    The XML namespace for an action element

    The XML namespace for an action element

    Definition Classes
    SparkAction → Action

Inherited from Action

Inherited from OozieProperties

Inherited from Nameable

Inherited from XmlSerializable

Inherited from AnyRef

Inherited from Any

Ungrouped