Package gorsat.commands

Class PysparkAnalysis

  • All Implemented Interfaces:
    java.lang.AutoCloseable
    public class PysparkAnalysis
extends java.lang.Object
implements java.lang.AutoCloseable

    • Field Summary

      Fields 
      Modifier and Type Field Description
      static java.util.Map<java.lang.String,​PysparkAnalysis> datasetMap  

    • Constructor Summary

      Constructors 
      Constructor Description
      PysparkAnalysis()  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void close()  
      java.lang.String cmdString()  
      org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> getDataset()  
      void markDone()  
      org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> pyspark​(java.lang.String signature, org.apache.spark.sql.Dataset<? extends org.apache.spark.sql.Row> ds, java.lang.String cmd)  
      void setDataset​(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> ds)  
      void waitFor()  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Field Detail

      • datasetMap

        public static java.util.Map<java.lang.String,​PysparkAnalysis> datasetMap

    • Constructor Detail

      • PysparkAnalysis

        public PysparkAnalysis()

    • Method Detail

      • getDataset

        public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> getDataset()

      • setDataset

        public void setDataset​(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> ds)

      • markDone

        public void markDone()
              throws java.lang.InterruptedException
        Throws:
        java.lang.InterruptedException

      • waitFor

        public void waitFor()
             throws java.lang.InterruptedException
        Throws:
        java.lang.InterruptedException

      • pyspark

        public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> pyspark​(java.lang.String signature,
                                                                      org.apache.spark.sql.Dataset<? extends org.apache.spark.sql.Row> ds,
                                                                      java.lang.String cmd)
                                                               throws java.io.IOException,
                                                                      java.lang.InterruptedException
        Throws:
        java.io.IOException
        java.lang.InterruptedException

      • cmdString

        public java.lang.String cmdString()

      • close

        public void close()
        Specified by:
        close in interface java.lang.AutoCloseable