Package org.pipecraft.pipes.source.google_bq

Class BQQueryResultsPipe<T>

java.lang.Object

org.pipecraft.pipes.source.google_bq.BQQueryResultsPipe<T>

Type Parameters:

T - The type of each result record from BQ

All Implemented Interfaces:

Closeable, AutoCloseable, org.pipecraft.pipes.BasePipe, org.pipecraft.pipes.sync.Pipe<T>

public class BQQueryResultsPipe<T>
extends Object
implements org.pipecraft.pipes.sync.Pipe<T>

A source pipe that runs a query on BigQueryConnector and iterates over the results

Author:

Eyal Schneider

Constructor Summary

Constructors

Constructor	Description
BQQueryResultsPipe(BigQueryConnector bq, BQQuery<T,?> query, QueryExecutionConfig queryConfig)	Constructor

Method Summary

Modifier and Type	Method	Description
void	close()
float	getProgress()
T	next()
T	peek()
void	prepareNext()
void	start()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BQQueryResultsPipe

public BQQueryResultsPipe(BigQueryConnector bq,
                          BQQuery<T,?> query,
                          QueryExecutionConfig queryConfig)

Constructor

Parameters:

bq - The BQ connector

query - The query to execute

queryConfig - Query execution configuration, or null for the default one

Method Detail

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Throws:

IOException

next

public T next()
       throws org.pipecraft.pipes.exceptions.PipeException,
              InterruptedException

Specified by:

next in interface org.pipecraft.pipes.sync.Pipe<T>

Throws:

org.pipecraft.pipes.exceptions.PipeException

InterruptedException

peek

public T peek()

Specified by:

peek in interface org.pipecraft.pipes.sync.Pipe<T>

start

public void start()
           throws org.pipecraft.pipes.exceptions.PipeException,
                  InterruptedException

Specified by:

start in interface org.pipecraft.pipes.BasePipe

Throws:

org.pipecraft.pipes.exceptions.PipeException

InterruptedException

prepareNext

public void prepareNext()
                 throws BQPipeException

Throws:

BQPipeException

getProgress

public float getProgress()

Specified by:

getProgress in interface org.pipecraft.pipes.BasePipe