| Package | Description |
|---|---|
| ai.preferred.venom |
| Modifier and Type | Method and Description |
|---|---|
static Crawler.Builder |
Crawler.builder()
Creates a new instance of Builder.
|
Crawler.Builder |
Crawler.Builder.setFetcher(@NotNull Fetcher fetcher)
Sets the Fetcher to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.setHandlerRouter(@NotNull HandlerRouter router)
Sets HandlerRouter to be used.
|
Crawler.Builder |
Crawler.Builder.setMaxConnections(int maxConnections)
The number of concurrent connections allowed out of the client.
|
Crawler.Builder |
Crawler.Builder.setMaxTries(int maxTries)
Sets number of times to retry for a request.
|
Crawler.Builder |
Crawler.Builder.setName(@NotNull String name)
Sets the name for crawler thread.
|
Crawler.Builder |
Crawler.Builder.setParallism(int parallelism)
Sets the parallelism level.
|
Crawler.Builder |
Crawler.Builder.setPropRetainProxy(double propRetainProxy)
Sets the proportion of max tries where a specified proxy, if specified will be used.
|
Crawler.Builder |
Crawler.Builder.setScheduler(@NotNull AbstractQueueScheduler scheduler)
Sets the Scheduler to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.setSession(@NotNull Session session)
Sets the Session to be used, if not set, defaults to none.
|
Crawler.Builder |
Crawler.Builder.setSleepScheduler(@NotNull SleepScheduler sleepScheduler)
Sets the SleepScheduler to be used, if not set, default will be chosen.
|
Crawler.Builder |
Crawler.Builder.setWorkerManager(@NotNull WorkerManager workerManager)
Sets the WorkerManager to be used, if not set, default will be chosen.
|
Copyright © 2019. All rights reserved.