static Crawler.Builder |
Crawler.builder() |
Creates a new instance of Builder.
|
Crawler.Builder |
Crawler.Builder.setFetcher(@NotNull Fetcher fetcher) |
Sets the Fetcher to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.setHandlerRouter(@NotNull HandlerRouter router) |
Sets HandlerRouter to be used.
|
Crawler.Builder |
Crawler.Builder.setMaxConnections(int maxConnections) |
The number of concurrent connections allowed out of the client.
|
Crawler.Builder |
Crawler.Builder.setMaxTries(int maxTries) |
Sets number of times to retry for a request.
|
Crawler.Builder |
Crawler.Builder.setName(@NotNull java.lang.String name) |
Sets the name for crawler thread.
|
Crawler.Builder |
Crawler.Builder.setParallelism(int parallelism) |
Sets the parallelism level.
|
Crawler.Builder |
Crawler.Builder.setPropRetainProxy(double propRetainProxy) |
Sets the proportion of max tries where a specified proxy, if specified will be used.
|
Crawler.Builder |
Crawler.Builder.setScheduler(@NotNull AbstractQueueScheduler scheduler) |
Sets the Scheduler to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.setSession(@NotNull Session session) |
Sets the Session to be used, if not set, defaults to none.
|
Crawler.Builder |
Crawler.Builder.setSleepScheduler(SleepScheduler sleepScheduler) |
Sets the SleepScheduler to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.setWorkerManager(@NotNull WorkerManager workerManager) |
Sets the WorkerManager to be used, if not set, default will be chosen.
|