| Package | Description |
|---|---|
| ai.preferred.venom.fetcher |
| Modifier and Type | Method and Description |
|---|---|
static HttpFetcher.Builder |
HttpFetcher.builder() |
HttpFetcher.Builder |
HttpFetcher.Builder.compressed(boolean compressed)
Set whether to request for compress pages and to decompress pages
after it is fetched.
|
HttpFetcher.Builder |
HttpFetcher.Builder.connectionRequestTimeout(int connectionRequestTimeout)
The timeout in milliseconds used when requesting a connection
from the connection manager.
|
HttpFetcher.Builder |
HttpFetcher.Builder.connectTimeout(int connectTimeout)
Determines the timeout in milliseconds until a connection is established.
|
HttpFetcher.Builder |
HttpFetcher.Builder.fileManager(FileManager fileManager)
Sets the FileManager to be used.
|
HttpFetcher.Builder |
HttpFetcher.Builder.headers(Map<String,String> headers)
Sets the headers to be used when fetching items.
|
HttpFetcher.Builder |
HttpFetcher.Builder.numIoThreads(int numIoThreads)
Number of httpclient dispatcher threads.
|
HttpFetcher.Builder |
HttpFetcher.Builder.proxyProvider(ProxyProvider proxyProvider)
Sets the ProxyProvider to be used.
|
HttpFetcher.Builder |
HttpFetcher.Builder.register(Callback callback)
Register any callbacks that will be called when a page has been fetched.
|
HttpFetcher.Builder |
HttpFetcher.Builder.router(ValidatorRouter router)
Sets ValidatorRouter to be used.
|
HttpFetcher.Builder |
HttpFetcher.Builder.socketTimeout(int socketTimeout)
Defines the socket timeout (
SO_TIMEOUT) in milliseconds,
which is the timeout for waiting for data or, put differently,
a maximum period inactivity between two consecutive data packets). |
HttpFetcher.Builder |
HttpFetcher.Builder.soTimeout(int soTimeout)
Determines the default socket timeout value for non-blocking I/O operations.
|
HttpFetcher.Builder |
HttpFetcher.Builder.stopCodes(int... codes) |
HttpFetcher.Builder |
HttpFetcher.Builder.threadFactory(ThreadFactory threadFactory)
Set the thread factory that creates the httpclient dispatcher
threads.
|
HttpFetcher.Builder |
HttpFetcher.Builder.userAgentGenerator(UserAgentGenerator userAgentGenerator)
Sets the UserAgentGenerator to be used, if not set, default will be chosen.
|
HttpFetcher.Builder |
HttpFetcher.Builder.validator(ResponseValidator validator)
Sets the ResponseValidator to be used.
|
| Constructor and Description |
|---|
HttpFetcher(HttpFetcher.Builder builder) |
Copyright © 2018. All rights reserved.