Package org.gorpipe.spark

Class GorSparkUtilities

java.lang.Object
org.gorpipe.spark.GorSparkUtilities
public class GorSparkUtilities
extends java.lang.Object

  • Method Summary

    Modifier and Type Method Description
    static org.apache.spark.sql.SparkSession getSparkSession​(java.lang.String gorroot, java.lang.String hostMount)  
    static org.apache.spark.sql.SparkSession getSparkSession​(java.lang.String gorroot, java.lang.String hostMount, java.lang.String profile)  
    static org.apache.spark.sql.SparkSession newSparkSession​(java.lang.String gorroot, java.lang.String hostMount, java.lang.String profile)  
    static java.util.List<org.apache.spark.sql.Row> stream2SparkRowList​(java.util.stream.Stream<org.gorpipe.gor.model.Row> str, org.apache.spark.sql.types.StructType schema)  

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Method Details

    • getSparkSession

      public static org.apache.spark.sql.SparkSession getSparkSession​(java.lang.String gorroot, java.lang.String hostMount)

    • newSparkSession

      public static org.apache.spark.sql.SparkSession newSparkSession​(java.lang.String gorroot, java.lang.String hostMount, java.lang.String profile)

    • getSparkSession

      public static org.apache.spark.sql.SparkSession getSparkSession​(java.lang.String gorroot, java.lang.String hostMount, java.lang.String profile)

    • stream2SparkRowList

      public static java.util.List<org.apache.spark.sql.Row> stream2SparkRowList​(java.util.stream.Stream<org.gorpipe.gor.model.Row> str, org.apache.spark.sql.types.StructType schema)