Package net.hydromatic.morel.compile

Class CalciteCompiler

java.lang.Object

net.hydromatic.morel.compile.Compiler

net.hydromatic.morel.compile.CalciteCompiler

public class CalciteCompiler
extends Compiler

Compiles an expression to code that can be evaluated.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) static interface	CalciteCompiler.RelCode	Extension to Code that can also provide a translation to relational algebra.
(package private) static class	CalciteCompiler.RelContext	Translation context.
private static class	CalciteCompiler.VarData	How a Morel variable maps onto the columns returned from a Join.

Nested classes/interfaces inherited from class net.hydromatic.morel.compile.Compiler

Compiler.Action, Compiler.Context

Field Summary

Fields

Modifier and Type	Field	Description
(package private) static final Map<BuiltIn,org.apache.calcite.sql.SqlOperator>	BINARY_OPERATORS	Morel infix operators and their exact equivalents in Calcite.
(package private) final Calcite	calcite
(package private) static final Map<BuiltIn,org.apache.calcite.sql.SqlOperator>	UNARY_OPERATORS	Morel prefix and suffix operators and their exact equivalents in Calcite.

Fields inherited from class net.hydromatic.morel.compile.Compiler

EMPTY_ENV, typeSystem

Constructor Summary

Constructors

Constructor	Description
CalciteCompiler(TypeSystem typeSystem, Calcite calcite)

Method Summary

Modifier and Type	Method	Description
private org.apache.calcite.sql.SqlAggFunction	aggOp(Core.Exp aggregate)	Returns the Calcite operator corresponding to a Morel built-in aggregate function.
protected CalciteCompiler.RelCode	compileApply(Compiler.Context cx, Core.Apply apply)
Code	compileArg(Compiler.Context cx, Core.Exp expression)	Compiles the argument to "apply".
protected Code	compileFrom(Compiler.Context cx, Core.From from)
protected CalciteFunctions.Context	createContext(Environment env)	Creates a context.
private static EvalEnv	evalEnvOf(Environment env)
protected Code	finishCompileApply(Compiler.Context cx, Applicable fnValue, Code argCode, Type argType)
protected Code	finishCompileApply(Compiler.Context cx, Code fnCode, Code argCode, Type argType)
protected Code	finishCompileLet(Compiler.Context cx, List<Code> matchCodes_, Code resultCode_, Type resultType)
private Set<String>	getRelationalVariables(Environment env, Set<String> nameSet, AstNode node)
private static CalciteCompiler.RelContext	getRelContext(CalciteCompiler.RelContext cx, Environment env, List<String> names)
private CalciteCompiler.RelContext	group(CalciteCompiler.RelContext cx, Core.Group group)
private static void	harmonizeRowTypes(org.apache.calcite.tools.RelBuilder relBuilder, int inputCount)
private CalciteCompiler.RelContext	join(CalciteCompiler.RelContext cx, int i, Core.Scan scan)
private static org.apache.calcite.rel.core.JoinRelType	joinRelType(Op op)
private org.apache.calcite.rex.RexNode	maybeNot(CalciteCompiler.RelContext cx, org.apache.calcite.rex.RexNode e, boolean not)
private org.apache.calcite.rex.RexNode	morelApply(CalciteCompiler.RelContext cx, Type type, Type argType, org.apache.calcite.rex.RexNode fn, org.apache.calcite.rex.RexNode arg)
private org.apache.calcite.rex.RexNode	morelScalar(CalciteCompiler.RelContext cx, Core.Exp exp)
private CalciteCompiler.RelContext	order(CalciteCompiler.RelContext cx, Core.Order order)
private Type	removeTypeVars(Type type)	Converts each type variable in a type to a dummy record type, {b: bool}.
private CalciteCompiler.RelContext	skip(CalciteCompiler.RelContext cx, Core.Skip skip)
private CalciteCompiler.RelContext	take(CalciteCompiler.RelContext cx, Core.Take take)
private Core.Tuple	toRecord(CalciteCompiler.RelContext cx, Core.Id id)
@Nullable org.apache.calcite.rel.RelNode	toRel(Environment env, Core.Exp expression)
private org.apache.calcite.rel.RelNode	toRel2(CalciteCompiler.RelContext cx, Core.Exp expression)
(package private) boolean	toRel3(CalciteCompiler.RelContext cx, Core.Exp expression, boolean aggressive)
(package private) Code	toRel4(Environment env, Code code, Type type)
private org.apache.calcite.rex.RexNode	translate(CalciteCompiler.RelContext cx, Core.Exp exp)
private List<org.apache.calcite.rex.RexNode>	translateList(CalciteCompiler.RelContext cx, List<Core.Exp> exps)
private CalciteCompiler.RelContext	where(CalciteCompiler.RelContext cx, Core.Where where)
private CalciteCompiler.RelContext	yield_(CalciteCompiler.RelContext cx, List<Binding> bindings, Core.Exp exp)
private CalciteCompiler.RelContext	yield_(CalciteCompiler.RelContext cx, Core.Yield yield)

Methods inherited from class net.hydromatic.morel.compile.Compiler

compile, compile, compileArgs, compileDecl, compileStatement, createRowSinkFactory

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

UNARY_OPERATORS

static final Map<BuiltIn,org.apache.calcite.sql.SqlOperator> UNARY_OPERATORS

Morel prefix and suffix operators and their exact equivalents in Calcite.

BINARY_OPERATORS

static final Map<BuiltIn,org.apache.calcite.sql.SqlOperator> BINARY_OPERATORS

Morel infix operators and their exact equivalents in Calcite.

calcite

final Calcite calcite

Constructor Details

CalciteCompiler

public CalciteCompiler(TypeSystem typeSystem,
 Calcite calcite)

Method Details

toRel

public @Nullable org.apache.calcite.rel.RelNode toRel(Environment env,
 Core.Exp expression)

toRel2

private org.apache.calcite.rel.RelNode toRel2(CalciteCompiler.RelContext cx,
 Core.Exp expression)

toRel3

boolean toRel3(CalciteCompiler.RelContext cx,
 Core.Exp expression,
 boolean aggressive)

toRel4

Code toRel4(Environment env,
 Code code,
 Type type)

createContext

protected CalciteFunctions.Context createContext(Environment env)

Description copied from class: Compiler

Creates a context.

The whole way we provide compilation environments (including Environment) to generated code is a mess:

• This method is protected so that CalciteCompiler can override and get a Calcite type factory.
• User-defined functions should have a 'prepare' phase, where they use a type factory and environment, that is distinct from the 'eval' phase.
• We should pass compile and runtime environments via parameters, not thread-locals.
• The dummy session is there because session is mandatory, but we have not created a session yet. Lifecycle confusion.

Overrides:

createContext in class Compiler

compileArg

public Code compileArg(Compiler.Context cx,
 Core.Exp expression)

Description copied from class: Compiler

Compiles the argument to "apply".

Overrides:

compileArg in class Compiler

finishCompileLet

protected Code finishCompileLet(Compiler.Context cx,
 List<Code> matchCodes_,
 Code resultCode_,
 Type resultType)

Overrides:

finishCompileLet in class Compiler

compileApply

protected CalciteCompiler.RelCode compileApply(Compiler.Context cx,
 Core.Apply apply)

Overrides:

compileApply in class Compiler

removeTypeVars

private Type removeTypeVars(Type type)

Converts each type variable in a type to a dummy record type, {b: bool}.

finishCompileApply

protected Code finishCompileApply(Compiler.Context cx,
 Code fnCode,
 Code argCode,
 Type argType)

Overrides:

finishCompileApply in class Compiler

finishCompileApply

protected Code finishCompileApply(Compiler.Context cx,
 Applicable fnValue,
 Code argCode,
 Type argType)

Overrides:

finishCompileApply in class Compiler

harmonizeRowTypes

private static void harmonizeRowTypes(org.apache.calcite.tools.RelBuilder relBuilder,
 int inputCount)

compileFrom

protected Code compileFrom(Compiler.Context cx,
 Core.From from)

Overrides:

compileFrom in class Compiler

yield_

private CalciteCompiler.RelContext yield_(CalciteCompiler.RelContext cx,
 Core.Yield yield)

yield_

private CalciteCompiler.RelContext yield_(CalciteCompiler.RelContext cx,
 List<Binding> bindings,
 Core.Exp exp)

translate

private org.apache.calcite.rex.RexNode translate(CalciteCompiler.RelContext cx,
 Core.Exp exp)

maybeNot

private org.apache.calcite.rex.RexNode maybeNot(CalciteCompiler.RelContext cx,
 org.apache.calcite.rex.RexNode e,
 boolean not)

getRelationalVariables

private Set<String> getRelationalVariables(Environment env,
 Set<String> nameSet,
 AstNode node)

morelScalar

private org.apache.calcite.rex.RexNode morelScalar(CalciteCompiler.RelContext cx,
 Core.Exp exp)

morelApply

private org.apache.calcite.rex.RexNode morelApply(CalciteCompiler.RelContext cx,
 Type type,
 Type argType,
 org.apache.calcite.rex.RexNode fn,
 org.apache.calcite.rex.RexNode arg)

toRecord

private Core.Tuple toRecord(CalciteCompiler.RelContext cx,
 Core.Id id)

translateList

private List<org.apache.calcite.rex.RexNode> translateList(CalciteCompiler.RelContext cx,
 List<Core.Exp> exps)

join

private CalciteCompiler.RelContext join(CalciteCompiler.RelContext cx,
 int i,
 Core.Scan scan)

joinRelType

private static org.apache.calcite.rel.core.JoinRelType joinRelType(Op op)

where

private CalciteCompiler.RelContext where(CalciteCompiler.RelContext cx,
 Core.Where where)

skip

private CalciteCompiler.RelContext skip(CalciteCompiler.RelContext cx,
 Core.Skip skip)

take

private CalciteCompiler.RelContext take(CalciteCompiler.RelContext cx,
 Core.Take take)

order

private CalciteCompiler.RelContext order(CalciteCompiler.RelContext cx,
 Core.Order order)

group

private CalciteCompiler.RelContext group(CalciteCompiler.RelContext cx,
 Core.Group group)

getRelContext

private static CalciteCompiler.RelContext getRelContext(CalciteCompiler.RelContext cx,
 Environment env,
 List<String> names)

aggOp

@Nonnull
private org.apache.calcite.sql.SqlAggFunction aggOp(Core.Exp aggregate)

Returns the Calcite operator corresponding to a Morel built-in aggregate function.

Future work: rather than resolving by name, look up aggregate function in environment, and compare with standard implementation of "sum" etc.; support aggregate functions defined by expressions (e.g. lambdas).

evalEnvOf

private static EvalEnv evalEnvOf(Environment env)