ai.preferred.venom.fetcher

Class AsyncFetcher

java.lang.Object

ai.preferred.venom.fetcher.AsyncFetcher

All Implemented Interfaces:

Fetcher, Interruptible, AutoCloseable

public class AsyncFetcher
extends Object
implements Fetcher

This class holds the implementation to provide how items are fetched, to fetch the item, to validate the item and to store it if specified.

Author:

Maksim Tkachenko, Truong Quoc Tuan, Ween Jiann Lee

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	AsyncFetcher.Builder A builder for async fetcher class.

Method Summary

Modifier and Type	Method and Description
static AsyncFetcher	buildDefault() Create an instance of async fetcher with default options.
static AsyncFetcher.Builder	builder() Create an instance of builder.
void	close()
Future<Response>	fetch(Request request) Fetch the desired HTTP page given in Request.
Future<Response>	fetch(Request request, Callback callback) Fetch the desired HTTP page given in Request.
void	start() Fetcher starter.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface ai.preferred.venom.Interruptible

interruptAndClose

Method Detail

buildDefault

public static AsyncFetcher buildDefault()

Create an instance of async fetcher with default options.

Returns:

A new instance of async fetcher

builder

public static AsyncFetcher.Builder builder()

Create an instance of builder.

Returns:

A new instance of builder

fetch

public Future<Response> fetch(Request request)

Description copied from interface: Fetcher

Fetch the desired HTTP page given in Request.

Specified by:

fetch in interface Fetcher

Parameters:

request - information for the page to fetch.

Returns:

Response future

fetch

public Future<Response> fetch(Request request,
                              Callback callback)

Description copied from interface: Fetcher

Fetch the desired HTTP page given in Request. Executes callback upon completion.

Specified by:

fetch in interface Fetcher

Parameters:

request - information for the page to fetch.

callback - callback

Returns:

Response future

start

public void start()

Description copied from interface: Fetcher

Fetcher starter.

Specified by:

start in interface Fetcher

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Throws:

IOException