ai.databand.parameters

Class DatasetOperationPreview

java.lang.Object

ai.databand.parameters.DatasetPreview

ai.databand.parameters.DatasetOperationPreview

All Implemented Interfaces:

TaskParameterPreview<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>

public class DatasetOperationPreview
extends DatasetPreview

Constructor Summary

Constructors

Constructor and Description
DatasetOperationPreview()

Method Summary

Modifier and Type	Method and Description
java.util.List<ColumnStats>	extractColumnStats(org.apache.spark.sql.types.StructType schema, long rows)
Pair<java.lang.String,java.util.List<java.lang.Long>>	extractSchema(org.apache.spark.sql.types.StructType schema, long rows)
java.lang.Object	schema(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> input)

Methods inherited from class ai.databand.parameters.DatasetPreview

compact, dimensions, full, typeName

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DatasetOperationPreview

public DatasetOperationPreview()

Method Detail

schema

public java.lang.Object schema(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> input)

Specified by:

schema in interface TaskParameterPreview<org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>>

Overrides:

schema in class DatasetPreview

extractSchema

public Pair<java.lang.String,java.util.List<java.lang.Long>> extractSchema(org.apache.spark.sql.types.StructType schema,
                                                                           long rows)

extractColumnStats

public java.util.List<ColumnStats> extractColumnStats(org.apache.spark.sql.types.StructType schema,
                                                      long rows)