Class

org.apache.spark.ml.odkl.CombinedModel

LinearCombinationModelLearner

Related Doc: package CombinedModel

Permalink

class LinearCombinationModelLearner[M <: ModelWithSummary[M]] extends PerClassModelLearner[M, LinearCombinationModel[M]]

Trains a model which predicts a scalar of weighted classes or a vector which is a generalized linear combination of per-class predictions

Linear Supertypes
PerClassModelLearner[M, LinearCombinationModel[M]], HasPredictionCol, HasLabelCol, HasClassesWeights, HasClassesCol, ForkedEstimator[M, String, LinearCombinationModel[M]], ForkedModelParams, SummarizableEstimator[LinearCombinationModel[M]], Estimator[LinearCombinationModel[M]], PipelineStage, Logging, Params, Serializable, Serializable, Identifiable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. LinearCombinationModelLearner
  2. PerClassModelLearner
  3. HasPredictionCol
  4. HasLabelCol
  5. HasClassesWeights
  6. HasClassesCol
  7. ForkedEstimator
  8. ForkedModelParams
  9. SummarizableEstimator
  10. Estimator
  11. PipelineStage
  12. Logging
  13. Params
  14. Serializable
  15. Serializable
  16. Identifiable
  17. AnyRef
  18. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new LinearCombinationModelLearner(nested: SummarizableEstimator[M])

    Permalink

  2. new LinearCombinationModelLearner(nested: SummarizableEstimator[M], uid: String)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def $[T](param: Param[T]): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  4. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  6. final val classesColumn: Param[String]

    Permalink
    Definition Classes
    HasClassesCol

  7. final val classesMap: JacksonParam[Map[String, String]]

    Permalink
    Definition Classes
    PerClassModelLearner

  8. final val classesToIgnore: JacksonParam[Set[String]]

    Permalink
    Definition Classes
    PerClassModelLearner

  9. final val classesWeights: JacksonParam[Map[String, Double]]

    Permalink
    Definition Classes
    HasClassesWeights

  10. final def clear(param: Param[_]): LinearCombinationModelLearner.this.type

    Permalink
    Definition Classes
    Params

  11. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  12. def copy(extra: ParamMap): SummarizableEstimator[LinearCombinationModel[M]]

    Permalink
    Definition Classes
    LinearCombinationModelLearner → SummarizableEstimator → Estimator → PipelineStage → Params

  13. def copyValues[T <: Params](to: T, extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  14. def createForkSource(dataset: Dataset[_]): ForkSource[M, String, LinearCombinationModel[M]]

    Permalink
    Attributes
    protected
    Definition Classes
    ForkedEstimator

  15. def createForks(dataset: Dataset[_]): Seq[(String, DataFrame)]

    Permalink

    Override this method and create forks to train from the data.

    Override this method and create forks to train from the data.

    Attributes
    protected
    Definition Classes
    PerClassModelLearner → ForkedEstimator

  16. final def defaultCopy[T <: Params](extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  17. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  18. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  19. def explainParam(param: Param[_]): String

    Permalink
    Definition Classes
    Params

  20. def explainParams(): String

    Permalink
    Definition Classes
    Params

  21. final def extractParamMap(): ParamMap

    Permalink
    Definition Classes
    Params

  22. final def extractParamMap(extra: ParamMap): ParamMap

    Permalink
    Definition Classes
    Params

  23. def failFast(key: String, triedIn: Try[M]): Try[M]

    Permalink
    Attributes
    protected
    Definition Classes
    ForkedEstimator

  24. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  25. def fit(dataset: Dataset[_]): LinearCombinationModel[M]

    Permalink
    Definition Classes
    ForkedEstimator → Estimator

  26. def fit(dataset: Dataset[_], paramMaps: Array[ParamMap]): Seq[LinearCombinationModel[M]]

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )

  27. def fit(dataset: Dataset[_], paramMap: ParamMap): LinearCombinationModel[M]

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )

  28. def fit(dataset: Dataset[_], firstParamPair: ParamPair[_], otherParamPairs: ParamPair[_]*): LinearCombinationModel[M]

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" ) @varargs()

  29. def fitFork(estimator: SummarizableEstimator[M], wholeData: Dataset[_], partialData: (String, DataFrame)): (String, Try[M])

    Permalink
    Definition Classes
    ForkedEstimator

  30. final def get[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params

  31. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  32. def getClassesWeights: Map[String, Double]

    Permalink
    Definition Classes
    HasClassesWeights

  33. def getCurrentContext: Seq[String]

    Permalink
    Attributes
    protected
    Definition Classes
    ForkedEstimator

  34. final def getDefault[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params

  35. final def getLabelCol: String

    Permalink
    Definition Classes
    HasLabelCol

  36. final def getOrDefault[T](param: Param[T]): T

    Permalink
    Definition Classes
    Params

  37. def getParam(paramName: String): Param[Any]

    Permalink
    Definition Classes
    Params

  38. final def getPredictionCol: String

    Permalink
    Definition Classes
    HasPredictionCol

  39. final def hasDefault[T](param: Param[T]): Boolean

    Permalink
    Definition Classes
    Params

  40. def hasParam(paramName: String): Boolean

    Permalink
    Definition Classes
    Params

  41. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  42. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  43. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  44. final def isDefined(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params

  45. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  46. final def isSet(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params

  47. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  48. final val labelCol: Param[String]

    Permalink
    Definition Classes
    HasLabelCol

  49. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  50. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  51. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  52. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  53. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  54. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  55. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  56. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  57. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  58. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  59. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  60. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  61. def mayBePropagateKey(data: DataFrame, key: Any): DataFrame

    Permalink
    Attributes
    protected
    Definition Classes
    ForkedModelParams

  62. def mergeModels(sqlContext: SQLContext, models: Seq[(String, Try[M])]): LinearCombinationModel[M]

    Permalink

    Given models trained for each fork create a combined model.

    Given models trained for each fork create a combined model. This model is the result of the estimator.

    Attributes
    protected
    Definition Classes
    LinearCombinationModelLearner → ForkedEstimator

  63. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  64. val nested: SummarizableEstimator[M]

    Permalink

    Nested estimator to call for each fork.

    Nested estimator to call for each fork.

    Definition Classes
    ForkedEstimator

  65. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  66. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  67. final val numThreads: IntParam

    Permalink
    Definition Classes
    ForkedEstimator

  68. final val overwriteModels: BooleanParam

    Permalink
    Definition Classes
    ForkedEstimator

  69. lazy val params: Array[Param[_]]

    Permalink
    Definition Classes
    Params

  70. final val pathForTempModels: Param[String]

    Permalink
    Definition Classes
    ForkedEstimator

  71. final val persistingKeyColumns: StringArrayParam

    Permalink
    Definition Classes
    ForkedEstimator

  72. final val predictionCol: Param[String]

    Permalink
    Definition Classes
    HasPredictionCol

  73. final val propagatedKeyColumn: Param[String]

    Permalink
    Definition Classes
    ForkedModelParams

  74. final def set(paramPair: ParamPair[_]): LinearCombinationModelLearner.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  75. final def set(param: String, value: Any): LinearCombinationModelLearner.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  76. final def set[T](param: Param[T], value: T): LinearCombinationModelLearner.this.type

    Permalink
    Definition Classes
    Params

  77. def setClassesColumn(value: String): LinearCombinationModelLearner.this.type

    Permalink
    Definition Classes
    HasClassesCol

  78. def setClassesMap(values: (String, String)*): LinearCombinationModelLearner.this.type

    Permalink
    Definition Classes
    PerClassModelLearner

  79. def setClassesToIgnore(values: String*): LinearCombinationModelLearner.this.type

    Permalink
    Definition Classes
    PerClassModelLearner

  80. def setClassesWeights(weights: (String, Double)*): LinearCombinationModelLearner.this.type

    Permalink
    Definition Classes
    HasClassesWeights

  81. final def setDefault(paramPairs: ParamPair[_]*): LinearCombinationModelLearner.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  82. final def setDefault[T](param: Param[T], value: T): LinearCombinationModelLearner.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  83. def setNumThreads(value: Int): LinearCombinationModelLearner.this.type

    Permalink
    Definition Classes
    ForkedEstimator

  84. def setOverwriteModels(value: Boolean): LinearCombinationModelLearner.this.type

    Permalink
    Definition Classes
    ForkedEstimator

  85. def setPathForTempModels(value: String): LinearCombinationModelLearner.this.type

    Permalink
    Definition Classes
    ForkedEstimator

  86. def setPredictionCol(value: String): LinearCombinationModelLearner.this.type

    Permalink
    Definition Classes
    PerClassModelLearner

  87. def setPropagatedKeyColumn(value: String): LinearCombinationModelLearner.this.type

    Permalink
    Definition Classes
    ForkedModelParams

  88. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  89. def toString(): String

    Permalink
    Definition Classes
    Identifiable → AnyRef → Any

  90. def transformSchema(schema: StructType): StructType

    Permalink
    Definition Classes
    ForkedEstimator → PipelineStage
    Annotations
    @DeveloperApi()

  91. def transformSchema(schema: StructType, logging: Boolean): StructType

    Permalink
    Attributes
    protected
    Definition Classes
    PipelineStage
    Annotations
    @DeveloperApi()

  92. val uid: String

    Permalink
    Definition Classes
    LinearCombinationModelLearner → PerClassModelLearner → ForkedEstimator → Identifiable

  93. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  94. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  95. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from PerClassModelLearner[M, LinearCombinationModel[M]]

Inherited from HasPredictionCol

Inherited from HasLabelCol

Inherited from HasClassesWeights

Inherited from HasClassesCol

Inherited from ForkedEstimator[M, String, LinearCombinationModel[M]]

Inherited from ForkedModelParams

Inherited from SummarizableEstimator[LinearCombinationModel[M]]

Inherited from Estimator[LinearCombinationModel[M]]

Inherited from PipelineStage

Inherited from Logging

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

Ungrouped