| Package | Description |
|---|---|
| ai.preferred.venom.fetcher |
| Modifier and Type | Method and Description |
|---|---|
static HttpClosableFetcher.Builder |
HttpClosableFetcher.builder() |
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.compressed(boolean compressed)
Set whether to request for compress pages and to decompress pages
after it is fetched.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.connectionRequestTimeout(int connectionRequestTimeout)
The timeout in milliseconds used when requesting a connection
from the connection manager.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.connectTimeout(int connectTimeout)
Determines the timeout in milliseconds until a connection is established.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.fileManager(@NotNull FileManager fileManager)
Sets the FileManager to be used.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.headers(@NotNull Map<String,String> headers)
Sets the headers to be used when fetching items.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.numIoThreads(int numIoThreads)
Number of httpclient dispatcher threads.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.proxyProvider(@NotNull ProxyProvider proxyProvider)
Sets the ProxyProvider to be used.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.register(@NotNull Callback callback)
Register any callbacks that will be called when a page has been fetched.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.router(@NotNull ValidatorRouter router)
Sets ValidatorRouter to be used.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.socketTimeout(int socketTimeout)
Defines the socket timeout (
SO_TIMEOUT) in milliseconds,
which is the timeout for waiting for data or, put differently,
a maximum period inactivity between two consecutive data packets). |
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.soTimeout(int soTimeout)
Determines the default socket timeout value for non-blocking I/O operations.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.stopCodes(int... codes) |
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.threadFactory(@NotNull ThreadFactory threadFactory)
Set the thread factory that creates the httpclient dispatcher
threads.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.userAgentGenerator(@NotNull UserAgentGenerator userAgentGenerator)
Sets the UserAgentGenerator to be used, if not set, default will be chosen.
|
HttpClosableFetcher.Builder |
HttpClosableFetcher.Builder.validator(@NotNull ResponseValidator validator)
Sets the ResponseValidator to be used.
|
| Constructor and Description |
|---|
HttpClosableFetcher(HttpClosableFetcher.Builder builder) |
Copyright © 2018. All rights reserved.