case class DataSet(core: MantikItemCore[DataSetDefinition]) extends BridgedMantikItem with Product with Serializable
Represents a DataSet.
- Alphabetic
- By Inheritance
- DataSet
- Serializable
- Product
- Equals
- BridgedMantikItem
- MantikItem
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new DataSet(core: MantikItemCore[DataSetDefinition])
Type Members
- type DefinitionType = DataSetDefinition
- Definition Classes
- DataSet → BridgedMantikItem → MantikItem
- type OwnType = DataSet
- Definition Classes
- DataSet → MantikItem
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def autoAdaptOrFail(targetType: DataType): DataSet
Tries to auto convert this data set to another data type.
Tries to auto convert this data set to another data type. Conversions can only be done if they do not loose precision or cannot fail single rows.
- Annotations
- @throws("If the conversion can not be applied.")
- def autoUnion(other: DataSet, all: Boolean): DataSet
Auto UNION this and another data set
Auto UNION this and another data set
- other
the other dataset
- all
if true generate UNION ALL, otherwise duplicates are omitted.
- def bridge: Bridge
Returns the item bridge.
Returns the item bridge.
- Definition Classes
- BridgedMantikItem
- def bridgeMantikId: MantikId
Returns the type's bridge.
Returns the type's bridge.
- Definition Classes
- BridgedMantikItem
- def cached: DataSet
Returns a dataset, which will be cached.
Returns a dataset, which will be cached. Note: caching is done lazy.
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native() @HotSpotIntrinsicCandidate()
- val core: MantikItemCore[DataSetDefinition]
- Definition Classes
- DataSet → MantikItem
- def dataType: DataType
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def fetch: FetchAction
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- def isCached: Boolean
Return true if the item is requested for caching (This doesn't have to mean that the cache is evaluated)
Return true if the item is requested for caching (This doesn't have to mean that the cache is evaluated)
- Definition Classes
- MantikItem
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def itemId: ItemId
Returns the ai.mantik.elements.ItemId of the item.
Returns the ai.mantik.elements.ItemId of the item.
- Definition Classes
- MantikItem
- def join(other: DataSet, columns: Seq[String], joinType: JoinType): DataSet
Performs join with other dataset.
- def join(other: DataSet, columns: Seq[String]): DataSet
Performs inner join with other dataset
- def mantikId: MantikId
Returns the mantik id.
Returns the mantik id. (Note: if it was stored after generating, it may not reflect the name)
- Definition Classes
- MantikItem
- def mapRows(destinationType: TabularData)(rowMapper: RowMapper): DataSet
Maps rows into a new structure using the ScalaFn-Bridge.
Maps rows into a new structure using the ScalaFn-Bridge.
Note: this method is very low level, type errors are not detected.
- Annotations
- @throws("If the input data is not tabular")
- def mapRowsFn[I, O](udf: UserDefinedFunction[I, O]): DataSet
Map rows into a new structure using the ScalaFn-Bridge.
Map rows into a new structure using the ScalaFn-Bridge.
The structure of the mapping function is automatically detected. The resulting columns will be named like _1, _2, etc.
- Annotations
- @throws("If the data types can't be applied") @throws("If the input data is not tabular")
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- def productElementNames: Iterator[String]
- Definition Classes
- Product
- def push(): PushAction
Pushes an item to the registry.
Pushes an item to the registry.
- Definition Classes
- MantikItem
- def save(): SaveAction
Save an item back in the local database
Save an item back in the local database
- Definition Classes
- MantikItem
- def select(select: Select): DataSet
Derives a data set, as the result of applying a select to this dataset.
- def select(statement: String): DataSet
Prepares a select statement on this dataset.
Prepares a select statement on this dataset.
- Annotations
- @throws("if a select is applied on non tabular data or if the select could not be compiled.") @throws("On illegal selects")
- def split(fractions: Seq[Double], shuffleSeed: Option[Long] = None, cached: Boolean = true): Seq[DataSet]
Split the DataSet into multiple fractions.
Split the DataSet into multiple fractions.
- fractions
the relative size of each fraction
- shuffleSeed
if given, shuffle the dataset before extracting fractions using this Random seed
- cached
if true, cache sub results to avoid recalculation
- returns
fractions.length + 1 DataSets
- def state(implicit planningContext: PlanningContext): MantikItemState
Returns the state of the item.
Returns the state of the item.
- Definition Classes
- MantikItem
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def tag(name: NamedMantikId): OwnType
Tag the item, giving it an additional name.
Tag the item, giving it an additional name.
Note: this will only have an effect, if the Item is saved or pushed.
- returns
the tagged item.
- Definition Classes
- MantikItem
- def toString(): String
- Definition Classes
- MantikItem → AnyRef → Any
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- def withCore(core: MantikItemCore[DataSetDefinition]): DataSet
Override the current source type.
Override the current source type.
- Attributes
- protected
- Definition Classes
- DataSet → MantikItem
- def withMantikHeader(mantikHeader: MantikHeader[DefinitionType]): OwnType
Override the mantik header (not this can be dangerous).
Override the mantik header (not this can be dangerous).
- Attributes
- protected
- Definition Classes
- MantikItem
- def withMetaValue[T](name: String, value: T)(implicit arg0: ValueEncoder[T]): OwnType
Convenience function to udpate a single meta value.
Convenience function to udpate a single meta value. Types are matched automatically if possible
- Definition Classes
- MantikItem
- Annotations
- @throws("If a value is missing or of wrong type or not changeable.")
- def withMetaValues(values: (String, SingleElementBundle)*): OwnType
Update Meta Variables.
Update Meta Variables.
- Definition Classes
- MantikItem
- Annotations
- @throws("If a value is missing or of wrong type or not changeable.")