Spark Project Catalyst 3.0.1 API < Back

Packages

package root

Definition Classes
root
package org

Definition Classes
root
package apache

Definition Classes
org
package spark

Definition Classes
apache
package sql

Definition Classes
spark
package catalyst
Catalyst is a library for manipulating relational query plans.
Catalyst is a library for manipulating relational query plans. All classes in catalyst are considered an internal API to Spark SQL and are subject to change between minor releases.

Definition Classes
sql
package expressions
A set of classes that can be used to represent trees of relational expressions.
A set of classes that can be used to represent trees of relational expressions. A key goal of the expression library is to hide the details of naming and scoping from developers who want to manipulate trees of relational operators. As such, the library defines a special type of expression, a NamedExpression in addition to the standard collection of expressions.
Standard Expressions
A library of standard expressions (e.g., Add, EqualTo), aggregates (e.g., SUM, COUNT), and other computations (e.g. UDFs). Each expression type is capable of determining its output schema as a function of its children's output schema.
Named Expressions
Some expression are named and thus can be referenced by later operators in the dataflow graph. The two types of named expressions are AttributeReferences and Aliases. AttributeReferences refer to attributes of the input tuple for a given operator and form the leaves of some expression trees. Aliases assign a name to intermediate computations. For example, in the SQL statement SELECT a+b AS c FROM ..., the expressions a and b would be represented by AttributeReferences and c would be represented by an Alias.
During analysis, all named expressions are assigned a globally unique expression id, which can be used for equality comparisons. While the original names are kept around for debugging purposes, they should never be used to check if two attributes refer to the same value, as plan transformations can result in the introduction of naming ambiguity. For example, consider a plan that contains subqueries, both of which are reading from the same table. If an optimization removes the subqueries, scoping information would be destroyed, eliminating the ability to reason about which subquery produced a given attribute.
Evaluation
The result of expressions can be evaluated using the Expression.apply(Row) method.

Definition Classes
catalyst
package codegen
A collection of generators that build custom bytecode at runtime for performing the evaluation of catalyst expression.
A collection of generators that build custom bytecode at runtime for performing the evaluation of catalyst expression.

Definition Classes
expressions
BaseMutableProjection
BaseProjection
Block
ByteCodeStats
CodeAndComment
CodeBlock
CodeFormatter
CodeGenerator
CodegenContext
CodegenFallback
DumpByteCode
EmptyBlock
ExprCode
ExprValue
ExpressionCanonicalizer
FalseLiteral
GenerateMutableProjection
GenerateOrdering
GeneratePredicate
GenerateSafeProjection
GenerateUnsafeProjection
GenerateUnsafeRowJoiner
GeneratedClass
GlobalValue
Inline
JavaCode
LazilyGeneratedOrdering
LiteralValue
SimpleExprValue
SubExprCodes
SubExprEliminationState
TrueLiteral
UnsafeArrayWriter
UnsafeRowJoiner
UnsafeRowWriter
UnsafeWriter
VariableValue

org.apache.spark.sql.catalyst.expressions.codegen

LazilyGeneratedOrdering

Companion object LazilyGeneratedOrdering

class LazilyGeneratedOrdering extends Ordering[InternalRow] with KryoSerializable

A lazily generated row ordering comparator.

Linear Supertypes

KryoSerializable, Ordering[InternalRow], PartialOrdering[InternalRow], Equiv[InternalRow], Serializable, Serializable, Comparator[InternalRow], AnyRef, Any

Ordering

Alphabetic
By Inheritance

Inherited

LazilyGeneratedOrdering
KryoSerializable
Ordering
PartialOrdering
Equiv
Serializable
Serializable
Comparator
AnyRef
Any

Hide All
Show All

Visibility

Public
All

Instance Constructors

new LazilyGeneratedOrdering(ordering: Seq[SortOrder], inputSchema: Seq[Attribute])
new LazilyGeneratedOrdering(ordering: Seq[SortOrder])

Type Members

class Ops extends AnyRef

Definition Classes
Ordering

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def asInstanceOf[T0]: T0

Definition Classes
Any
def clone(): AnyRef

Attributes
protected[lang]
Definition Classes
AnyRef
Annotations
@throws( ... ) @native()
def compare(a: InternalRow, b: InternalRow): Int

Definition Classes
LazilyGeneratedOrdering → Ordering → Comparator
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def equiv(x: InternalRow, y: InternalRow): Boolean

Definition Classes
Ordering → PartialOrdering → Equiv
def finalize(): Unit

Attributes
protected[lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
Annotations
@native()
def gt(x: InternalRow, y: InternalRow): Boolean

Definition Classes
Ordering → PartialOrdering
def gteq(x: InternalRow, y: InternalRow): Boolean

Definition Classes
Ordering → PartialOrdering
def hashCode(): Int

Definition Classes
AnyRef → Any
Annotations
@native()
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
def lt(x: InternalRow, y: InternalRow): Boolean

Definition Classes
Ordering → PartialOrdering
def lteq(x: InternalRow, y: InternalRow): Boolean

Definition Classes
Ordering → PartialOrdering
def max(x: InternalRow, y: InternalRow): InternalRow

Definition Classes
Ordering
def min(x: InternalRow, y: InternalRow): InternalRow

Definition Classes
Ordering
implicit def mkOrderingOps(lhs: InternalRow): Ops

Definition Classes
Ordering
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
Annotations
@native()
final def notifyAll(): Unit

Definition Classes
AnyRef
Annotations
@native()
def on[U](f: (U) ⇒ InternalRow): Ordering[U]

Definition Classes
Ordering
val ordering: Seq[SortOrder]
def read(kryo: Kryo, in: Input): Unit

Definition Classes
LazilyGeneratedOrdering → KryoSerializable
def reverse: Ordering[InternalRow]

Definition Classes
Ordering → PartialOrdering
def reversed(): Comparator[InternalRow]

Definition Classes
Comparator
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def thenComparing[U <: Comparable[_ >: U]](arg0: Function[_ >: InternalRow, _ <: U]): Comparator[InternalRow]

Definition Classes
Comparator
def thenComparing[U](arg0: Function[_ >: InternalRow, _ <: U], arg1: Comparator[_ >: U]): Comparator[InternalRow]

Definition Classes
Comparator
def thenComparing(arg0: Comparator[_ >: InternalRow]): Comparator[InternalRow]

Definition Classes
Comparator
def thenComparingDouble(arg0: ToDoubleFunction[_ >: InternalRow]): Comparator[InternalRow]

Definition Classes
Comparator
def thenComparingInt(arg0: ToIntFunction[_ >: InternalRow]): Comparator[InternalRow]

Definition Classes
Comparator
def thenComparingLong(arg0: ToLongFunction[_ >: InternalRow]): Comparator[InternalRow]

Definition Classes
Comparator
def toString(): String

Definition Classes
AnyRef → Any
def tryCompare(x: InternalRow, y: InternalRow): Some[Int]

Definition Classes
Ordering → PartialOrdering
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... ) @native()
def write(kryo: Kryo, out: Output): Unit

Definition Classes
LazilyGeneratedOrdering → KryoSerializable

Packages

Standard Expressions

Named Expressions

Evaluation

LazilyGeneratedOrdering

Companion object LazilyGeneratedOrdering

class LazilyGeneratedOrdering extends Ordering[InternalRow] with KryoSerializable

Instance Constructors

Type Members

Value Members

Inherited from KryoSerializable

Inherited from Ordering[InternalRow]

Inherited from PartialOrdering[InternalRow]

Inherited from Equiv[InternalRow]

Inherited from Serializable

Inherited from Serializable

Inherited from Comparator[InternalRow]

Inherited from AnyRef

Inherited from Any

Ungrouped

Packages

Standard Expressions

Named Expressions

Evaluation

LazilyGeneratedOrdering 

Companion object LazilyGeneratedOrdering

class LazilyGeneratedOrdering extends Ordering[InternalRow] with KryoSerializable

Instance Constructors

Type Members

Value Members

Inherited from KryoSerializable

Inherited from Ordering[InternalRow]

Inherited from PartialOrdering[InternalRow]

Inherited from Equiv[InternalRow]

Inherited from Serializable

Inherited from Serializable

Inherited from Comparator[InternalRow]

Inherited from AnyRef

Inherited from Any

Ungrouped

LazilyGeneratedOrdering