Package org.projectnessie.client.tests

Class AbstractSparkTest

java.lang.Object

org.projectnessie.client.tests.AbstractSparkTest

public abstract class AbstractSparkTest
extends Object

Field Summary

Fields

Modifier and Type	Field	Description
protected static org.apache.spark.SparkConf	conf
protected static org.projectnessie.client.NessieClient	nessieClient
protected static org.apache.spark.sql.SparkSession	spark
protected static String	url

Constructor Summary

Constructors

Constructor	Description
AbstractSparkTest()

Method Summary

Modifier and Type	Method	Description
protected static void	assertEquals(String context, Object[] expectedRow, List<Object[]> actualRows)
protected static void	assertEquals(String context, List<Object[]> expectedRows, List<Object[]> actualRows)
protected void	create()
protected static Object[]	row(Object... values)	This looks weird but it gives a clear semantic way to turn a list of objects into a 'row' for spark assertions.
protected static List<Object[]>	sql(String query, Object... args)
protected static Object[]	toJava(org.apache.spark.sql.Row row)
protected static List<Object[]>	transform(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> table)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

conf

protected static org.apache.spark.SparkConf conf

spark

protected static org.apache.spark.sql.SparkSession spark

url

protected static String url

nessieClient

protected static org.projectnessie.client.NessieClient nessieClient

Constructor Detail

AbstractSparkTest

public AbstractSparkTest()

Method Detail

create

@BeforeEach
protected void create()
               throws IOException

Throws:

IOException

transform

protected static List<Object[]> transform(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> table)

assertEquals

protected static void assertEquals(String context,
                                   Object[] expectedRow,
                                   List<Object[]> actualRows)

assertEquals

protected static void assertEquals(String context,
                                   List<Object[]> expectedRows,
                                   List<Object[]> actualRows)

sql

protected static List<Object[]> sql(String query,
                                    Object... args)

toJava

protected static Object[] toJava(org.apache.spark.sql.Row row)

row

protected static Object[] row(Object... values)

This looks weird but it gives a clear semantic way to turn a list of objects into a 'row' for spark assertions.