| Package | Description |
|---|---|
| ai.preferred.venom |
| Modifier and Type | Method and Description |
|---|---|
static Crawler.Builder |
Crawler.builder()
Creates a new instance of Builder.
|
Crawler.Builder |
Crawler.Builder.fetcher(@NotNull Fetcher fetcher)
Sets the Fetcher to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.maxConnections(int maxConnections)
The number of concurrent connections allowed out of the client.
|
Crawler.Builder |
Crawler.Builder.maxTries(int maxTries)
Sets number of times to retry for a request.
|
Crawler.Builder |
Crawler.Builder.name(@NotNull String name)
Sets the name for crawler thread.
|
Crawler.Builder |
Crawler.Builder.parallism(int parallelism)
Sets the parallelism level.
|
Crawler.Builder |
Crawler.Builder.propRetainProxy(double propRetainProxy)
Sets the proportion of max tries where a specified proxy, if specified will be used.
|
Crawler.Builder |
Crawler.Builder.router(@NotNull HandlerRouter router)
Sets HandlerRouter to be used.
|
Crawler.Builder |
Crawler.Builder.scheduler(@NotNull AbstractQueueScheduler scheduler)
Sets the Scheduler to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.session(@NotNull Session session)
Sets the Session to be used, if not set, defaults to none.
|
Crawler.Builder |
Crawler.Builder.sleepScheduler(@NotNull SleepScheduler sleepScheduler)
Sets the SleepScheduler to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.workerManager(@NotNull WorkerManager workerManager)
Sets the WorkerManager to be used, if not set, default will be chosen.
|
Copyright © 2018. All rights reserved.