Type Members

1.  abstract class BaseMutableProjection extends MutableProjection
2.  abstract class BaseProjection extends Projection

   Java can not access Projection (in package object)

3.  trait Block extends TreeNode[Block] with JavaCode

   A trait representing a block of java code.

4.  case class ByteCodeStats(maxMethodCodeSize: Int, maxConstPoolSize: Int, numInnerClasses: Int) extends Product with Serializable

   Java bytecode statistics of a compiled class by Janino.

5.  class CodeAndComment extends Serializable

   A wrapper for the source code to be compiled by CodeGenerator.

6.  case class CodeBlock(codeParts: Seq[String], blockInputs: Seq[JavaCode]) extends TreeNode[Block] with Block with Product with Serializable

   A block of java code.

   A block of java code. Including a sequence of code parts and some inputs to this block. The actual java code is generated by embedding the inputs into the code parts. Here we keep inputs of JavaCode instead of simply folding them as a string of code, because we need to track expressions (ExprValue) in this code block. We need to be able to manipulate the expressions later without changing the behavior of this code block in some applications, e.g., method splitting.

7.  abstract class CodeGenerator[InType <: AnyRef, OutType <: AnyRef] extends Logging

   A base class for generators of byte code to perform expression evaluation.

   A base class for generators of byte code to perform expression evaluation. Includes a set of helpers for referring to Catalyst types and building trees that perform evaluation of individual expressions.

8.  class CodegenContext extends Logging

   A context for codegen, tracking a list of objects that could be passed into generated Java function.

9.  trait CodegenFallback extends Expression

   A trait that can be used to provide a fallback mode for expression code generation.

10.  case class ExprCode(code: Block, isNull: ExprValue, value: ExprValue) extends Product with Serializable

    Java source for evaluating an Expression given a InternalRow of input.

    Java source for evaluating an Expression given a InternalRow of input.

    code

    The sequence of statements required to evaluate the expression. It should be empty string, if isNull and value are already existed, or no code needed to evaluate them (literals).

    isNull

    A term that holds a boolean value representing whether the expression evaluated to null.

    value

    A term for a (possibly primitive) value of the result of the evaluation. Not valid if isNull is set to true.

11.  trait ExprValue extends JavaCode

    A typed java fragment that must be a valid java expression.

12.  abstract class GeneratedClass extends AnyRef

    A wrapper for generated class, defines a generate method so that we can pass extra objects into generated class.

13.  case class GlobalValue(value: String, javaType: Class[_]) extends ExprValue with Product with Serializable

    A global variable java expression.

14.  case class Inline(codeString: String) extends JavaCode with Product with Serializable

    A piece of java code snippet inlines all types of input arguments into a string without tracking any reference of JavaCode instances.

15.  trait JavaCode extends AnyRef

    Trait representing an opaque fragments of java code.

16.  class LazilyGeneratedOrdering extends Ordering[InternalRow] with KryoSerializable

    A lazily generated row ordering comparator.

17.  class LiteralValue extends ExprValue with Serializable

    A literal java expression.

18.  case class SimpleExprValue(expr: String, javaType: Class[_]) extends ExprValue with Product with Serializable

    A java expression fragment.

19.  case class SubExprCodes(codes: Seq[String], states: Map[Expression, SubExprEliminationState]) extends Product with Serializable

    Codes and common subexpressions mapping used for subexpression elimination.

    Codes and common subexpressions mapping used for subexpression elimination.

    codes

    Strings representing the codes that evaluate common subexpressions.

    states

    Foreach expression that is participating in subexpression elimination, the state to use.

20.  case class SubExprEliminationState(isNull: ExprValue, value: ExprValue) extends Product with Serializable

    State used for subexpression elimination.

    State used for subexpression elimination.

    isNull

    A term that holds a boolean value representing whether the expression evaluated to null.

    value

    A term for a value of a common sub-expression. Not valid if isNull is set to true.

21.  final class UnsafeArrayWriter extends UnsafeWriter

    A helper class to write data into global row buffer using UnsafeArrayData format, used by org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeProjection.

22.  abstract class UnsafeRowJoiner extends AnyRef
23.  final class UnsafeRowWriter extends UnsafeWriter

    A helper class to write data into global row buffer using UnsafeRow format.

    A helper class to write data into global row buffer using UnsafeRow format.

    It will remember the offset of row buffer which it starts to write, and move the cursor of row buffer while writing. If new data(can be the input record if this is the outermost writer, or nested struct if this is an inner writer) comes, the starting cursor of row buffer may be changed, so we need to call UnsafeRowWriter.resetRowWriter before writing, to update the startingOffset and clear out null bits.

    Note that if this is the outermost writer, which means we will always write from the very beginning of the global row buffer, we don't need to update startingOffset and can just call zeroOutNullBytes before writing new data.

24.  abstract class UnsafeWriter extends AnyRef

    Base class for writing Unsafe* structures.

25.  case class VariableValue(variableName: String, javaType: Class[_]) extends ExprValue with Product with Serializable

    A local variable java expression.