Index

A B C D E F G H I J L M N O P Q R S T U V W
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

ACCEPT_REGEX_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

Recursive accept/reject options

addCrawlJob(CrawlJob) - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

Insert crawl Job into persistent store.

addCrawlsItem(CrawlStatus) - Method in class org.lockss.laaws.crawler.model.CrawlPager

addJobsItem(CrawlJob) - Method in class org.lockss.laaws.crawler.model.JobPager

addMimeTypesItem(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

addMimeTypesItem(MimeCounter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

addPagesExcludedItem(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

addPagesFetchedItem(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

addPagesNotModifiedItem(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

addPagesParsedItem(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

addPagesPendingItem(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

addPagesWithErrorsItem(CrawlWsResultPagesWithErrors) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

addReferrersItem(String) - Method in class org.lockss.laaws.crawler.model.UrlInfo

addSourcesItem(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

addSourcesItem(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

addStartingUrlsItem(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

addStartUrlsItem(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

addUrlsItem(UrlInfo) - Method in class org.lockss.laaws.crawler.model.UrlPager

addViewControllers(ViewControllerRegistry) - Method in class org.lockss.laaws.crawler.config.SwaggerUiConfiguration

ALL_KEYS - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

The keys of all the supported wget command line options.

ApiOriginFilter - Class in org.lockss.laaws.crawler.api

ApiOriginFilter() - Constructor for class org.lockss.laaws.crawler.api.ApiOriginFilter

ApiResponseMessage - Class in org.lockss.laaws.crawler.api

ApiResponseMessage() - Constructor for class org.lockss.laaws.crawler.api.ApiResponseMessage

ApiResponseMessage(int, String) - Constructor for class org.lockss.laaws.crawler.api.ApiResponseMessage

ApiUtils - Class in org.lockss.laaws.crawler.impl

ApiUtils() - Constructor for class org.lockss.laaws.crawler.impl.ApiUtils

APPEND_LOG_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

Logging parameters

ATTR_COMPRESS_WARC - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

ATTR_COMPRESSED_WARC_FILE_EXTENSION - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

ATTR_CRAWL_EXECUTOR_SPEC - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

Controls the number of AUs running cmd line crawls

ATTR_CRAWLER_ID - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

The constant CRAWLER_ID.

ATTR_CRAWLER_NAME - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

The constant CRAWLER_NAME.

ATTR_CRAWLING_ENABLED - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

The constant CRAWLING_ENABLED.

ATTR_ERROR_LOG_LEVEL - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

ATTR_EXCLUDE_STATUS_PATTERN - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

ATTR_JOIN_OUTPUT_STREAMS - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

ATTR_OUTPUT_LEVEL - Static variable in class org.lockss.laaws.crawler.wget.WgetCmdLineCrawler

The constant ATTR_OUTPUT_LEVEL.

ATTR_OUTPUT_LOG_LEVEL - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

ATTR_PROC_EXIT_WAIT - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

ATTR_STARTER_ENABLED - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

The constant CRAWL_STARTER_ENABLED.

ATTR_SUCCESS_CODE - Static variable in class org.lockss.laaws.crawler.wget.WgetCmdLineCrawler

The constant ATTR_SUCCESS_CODE.

ATTR_UNCOMPRESSED_WARC_FILE_EXTENSION - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

ATTR_UNSUPPORTED_PARAMS - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

attributes(Map<String, String>) - Method in class org.lockss.laaws.crawler.model.CrawlerConfig

au - Variable in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

AU_HAS_QUEUED_OR_ACTIVE_CRAWL - Static variable in class org.lockss.laaws.crawler.impl.JobsApiServiceImpl

auId(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

auId(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

auName(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

auName(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

B

BooleanCommandOption - Class in org.lockss.laaws.crawler.impl.pluggable.command

Representation of a boolean command line option.

BooleanCommandOption(String) - Constructor for class org.lockss.laaws.crawler.impl.pluggable.command.BooleanCommandOption

Constructor.

buildCommandLine(CrawlDesc, File) - Method in interface org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler.CommandLineBuilder

buildCommandLine(CrawlDesc, File) - Method in class org.lockss.laaws.crawler.wget.WgetCommandLineBuilder

Builds the wget command line.

bytesFetched(Long) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

bytesFetchedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

bytesPattern - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

C

cmdLineBuilder - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

CmdLineCrawl - Class in org.lockss.laaws.crawler.impl.pluggable

A class to wrap a single CommandLineCrawl

CmdLineCrawl(CmdLineCrawler, ArchivalUnit, CrawlJob) - Constructor for class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

Instantiates a new Cmd line crawl.

CmdLineCrawler - Class in org.lockss.laaws.crawler.impl.pluggable

A Base implementation of a CmdLineCrawler.

CmdLineCrawler() - Constructor for class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

Instantiates a new Cmd line crawler.

CmdLineCrawler.CommandLineBuilder - Interface in org.lockss.laaws.crawler.impl.pluggable

CmdLineCrawler.RunnableCrawlJob - Class in org.lockss.laaws.crawler.impl.pluggable

code(Integer) - Method in class org.lockss.laaws.crawler.model.ErrorResult

command - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

CommandOption - Class in org.lockss.laaws.crawler.impl.pluggable.command

Base class for all command line options

CommandOption(String) - Constructor for class org.lockss.laaws.crawler.impl.pluggable.command.CommandOption

Constructor.

ComparableFutureTask(Runnable, T) - Constructor for class org.lockss.laaws.crawler.utils.ExecutorUtils.ComparableFutureTask

ComparableFutureTask(Callable<T>) - Constructor for class org.lockss.laaws.crawler.utils.ExecutorUtils.ComparableFutureTask

compareTo(Object) - Method in class org.lockss.laaws.crawler.utils.ExecutorUtils.ComparableFutureTask

compareTo(CmdLineCrawler.RunnableCrawlJob) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler.RunnableCrawlJob

compressWarc - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

config - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

The Configuration for this crawler.

CONNECT_TIMEOUT_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

continuationToken(String) - Method in class org.lockss.laaws.crawler.model.PageInfo

ContinuationToken - Class in org.lockss.laaws.crawler.utils

ContinuationToken(Long, Long) - Constructor for class org.lockss.laaws.crawler.utils.ContinuationToken

ContinuationToken(String) - Constructor for class org.lockss.laaws.crawler.utils.ContinuationToken

convert(String) - Method in class org.lockss.laaws.crawler.config.LocalDateConverter

convert(String) - Method in class org.lockss.laaws.crawler.config.LocalDateTimeConverter

coreThreads - Variable in class org.lockss.laaws.crawler.utils.ExecutorUtils.ExecSpec

coreThreads(int) - Method in class org.lockss.laaws.crawler.utils.ExecutorUtils.ExecSpec

count(Integer) - Method in class org.lockss.laaws.crawler.model.Counter

count(Integer) - Method in class org.lockss.laaws.crawler.model.MimeCounter

Counter - Class in org.lockss.laaws.crawler.model

A counter for urls.

Counter() - Constructor for class org.lockss.laaws.crawler.model.Counter

counterLink(String) - Method in class org.lockss.laaws.crawler.model.MimeCounter

crawlDesc - Variable in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Description of the crawl requested.

crawler - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

CRAWLER_IDS - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

The constant CRAWLER_IDS.

CRAWLER_PREFIX - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

CrawlerApplication - Class in org.lockss.laaws.crawler

The Spring-Boot application.

CrawlerApplication() - Constructor for class org.lockss.laaws.crawler.CrawlerApplication

crawlerConfig - Variable in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

The configuration of the crawler when this crawl began.

CrawlerConfig - Class in org.lockss.laaws.crawler.model

Configuration information about a specific crawler.

CrawlerConfig() - Constructor for class org.lockss.laaws.crawler.model.CrawlerConfig

crawlerId(String) - Method in class org.lockss.laaws.crawler.model.CrawlerConfig

crawlerId(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

crawlerMap(Map<String, CrawlerStatus>) - Method in class org.lockss.laaws.crawler.model.CrawlerStatuses

CrawlersApi - Interface in org.lockss.laaws.crawler.api

CrawlersApiController - Class in org.lockss.laaws.crawler.api

CrawlersApiController(CrawlersApiDelegate) - Constructor for class org.lockss.laaws.crawler.api.CrawlersApiController

CrawlersApiDelegate - Interface in org.lockss.laaws.crawler.api

A delegate to be called by the CrawlersApiController}.

CrawlersApiServiceImpl - Class in org.lockss.laaws.crawler.impl

Service for accessing crawlers.

CrawlersApiServiceImpl() - Constructor for class org.lockss.laaws.crawler.impl.CrawlersApiServiceImpl

crawlerStatus - Variable in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

The current status of a crawl as understood by the internal LOCKSS crawler.

CrawlerStatus - Class in org.lockss.laaws.crawler.model

Status about a specific crawler.

CrawlerStatus() - Constructor for class org.lockss.laaws.crawler.model.CrawlerStatus

CrawlerStatuses - Class in org.lockss.laaws.crawler.model

The metadata generated for a single item

CrawlerStatuses() - Constructor for class org.lockss.laaws.crawler.model.CrawlerStatuses

CrawlHelper - Class in org.lockss.laaws.crawler.impl

Helper of the DaemonStatus web service implementation of crawl queries.

CrawlHelper() - Constructor for class org.lockss.laaws.crawler.impl.CrawlHelper

crawlJob - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler.RunnableCrawlJob

crawlJob - Variable in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

The job for this crawl.

crawlKey(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

crawlMap - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

The map of crawls for this crawler.

CrawlPager - Class in org.lockss.laaws.crawler.model

A display page of crawl status

CrawlPager() - Constructor for class org.lockss.laaws.crawler.model.CrawlPager

crawls(List<CrawlStatus>) - Method in class org.lockss.laaws.crawler.model.CrawlPager

CrawlsApi - Interface in org.lockss.laaws.crawler.api

CrawlsApiController - Class in org.lockss.laaws.crawler.api

CrawlsApiController(CrawlsApiDelegate) - Constructor for class org.lockss.laaws.crawler.api.CrawlsApiController

CrawlsApiDelegate - Interface in org.lockss.laaws.crawler.api

A delegate to be called by the CrawlsApiController}.

CrawlsApiServiceImpl - Class in org.lockss.laaws.crawler.impl

Service for accessing crawls.

CrawlsApiServiceImpl(HttpServletRequest) - Constructor for class org.lockss.laaws.crawler.impl.CrawlsApiServiceImpl

crawlStatus(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

CrawlStatus - Class in org.lockss.laaws.crawler.model

The status of a single crawl.

CrawlStatus() - Constructor for class org.lockss.laaws.crawler.model.CrawlStatus

crawlType(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

CrawlWsResult - Class in org.lockss.laaws.crawler.model

CrawlWsResult

CrawlWsResult() - Constructor for class org.lockss.laaws.crawler.model.CrawlWsResult

CrawlWsResultPagesWithErrors - Class in org.lockss.laaws.crawler.model

CrawlWsResultPagesWithErrors

CrawlWsResultPagesWithErrors() - Constructor for class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

CrawlWsSource - Class in org.lockss.laaws.crawler.impl

Container for the information that is used as the source for a query related to crawls.

CrawlWsSource(CrawlerStatus) - Constructor for class org.lockss.laaws.crawler.impl.CrawlWsSource

CrawlWsSource(CrawlReq) - Constructor for class org.lockss.laaws.crawler.impl.CrawlWsSource

createOrReConfigureExecutor(ThreadPoolExecutor, String, String) - Static method in class org.lockss.laaws.crawler.utils.ExecutorUtils

curLink(String) - Method in class org.lockss.laaws.crawler.model.PageInfo

D

DB_FILENAME - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

The constant DB_FILENAME.

DEBUG_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

DEFAULT_CMDLINE_CRAWL_EXECUTOR_SPEC - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

DEFAULT_COMPRESS_WARC - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

DEFAULT_COMPRESSED_WARC_FILE_EXTENSION - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

DEFAULT_CONFIG - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandLineBuilder

DEFAULT_CRAWL_DB_PATH - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

The constant DEFAULT_CRAWL_DB_PATH.

DEFAULT_ERROR_LOG_LEVEL - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

DEFAULT_EXCLUDE_STATUS_PATTERN - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

DEFAULT_EXECUTOR_SPEC - Static variable in class org.lockss.laaws.crawler.utils.ExecutorUtils

DEFAULT_JOIN_OUTPUT_STREAMS - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

DEFAULT_OUTPUT_LOG_LEVEL - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

DEFAULT_PROC_EXIT_WAIT - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

DEFAULT_REQUEUE_ON_RESTART - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

DEFAULT_THREAD_TIMEOUT - Static variable in class org.lockss.laaws.crawler.utils.ExecutorUtils

DEFAULT_UNCOMPRESSED_WARC_FILE_EXTENSION - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

defaultCrawlerIds - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

The default list of known crawlers.

DELETE_AFTER_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

deleteAllCrawls() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

deleteAllCrawls() - Method in interface org.lockss.laaws.crawler.impl.pluggable.PluggableCrawler

Stop all crawls and clear the crawl queue managed by this crawler

deleteAllCrawls() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

Delete all crawls.

deleteCrawlJob(String) - Method in interface org.lockss.laaws.crawler.api.JobsApi

deleteCrawlJob(String) - Method in interface org.lockss.laaws.crawler.api.JobsApiDelegate

deleteCrawlJob(String) - Method in class org.lockss.laaws.crawler.impl.JobsApiServiceImpl

Deletes a crawl previously added to the crawl queue, stopping the crawl if already running.

deleteJobs() - Method in interface org.lockss.laaws.crawler.api.JobsApi

deleteJobs() - Method in interface org.lockss.laaws.crawler.api.JobsApiDelegate

deleteJobs() - Method in class org.lockss.laaws.crawler.impl.JobsApiServiceImpl

Deletes all the currently queued and active crawl requests.

depth(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

destroy() - Method in class org.lockss.laaws.crawler.api.ApiOriginFilter

didCrawlSucceed(int) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

didCrawlSucceed(int) - Method in class org.lockss.laaws.crawler.wget.WgetCmdLineCrawler

disable(boolean) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

disable(boolean) - Method in interface org.lockss.laaws.crawler.impl.pluggable.PluggableCrawler

disable this crawler clearing any queued crawls.

DNS_TIMEOUT_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

doFilter(ServletRequest, ServletResponse, FilterChain) - Method in class org.lockss.laaws.crawler.api.ApiOriginFilter

DOMAINS_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

duration(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

E

ENABLED - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

The constant ENABLED.

endTime(Long) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

equals(Object) - Method in class org.lockss.laaws.crawler.model.Counter

equals(Object) - Method in class org.lockss.laaws.crawler.model.CrawlerConfig

equals(Object) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

equals(Object) - Method in class org.lockss.laaws.crawler.model.CrawlerStatuses

equals(Object) - Method in class org.lockss.laaws.crawler.model.CrawlPager

equals(Object) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

equals(Object) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

equals(Object) - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

equals(Object) - Method in class org.lockss.laaws.crawler.model.ErrorResult

equals(Object) - Method in class org.lockss.laaws.crawler.model.JobPager

equals(Object) - Method in class org.lockss.laaws.crawler.model.MimeCounter

equals(Object) - Method in class org.lockss.laaws.crawler.model.PageInfo

equals(Object) - Method in class org.lockss.laaws.crawler.model.UrlError

equals(Object) - Method in class org.lockss.laaws.crawler.model.UrlInfo

equals(Object) - Method in class org.lockss.laaws.crawler.model.UrlPager

equals(Object) - Method in class org.lockss.laaws.crawler.utils.ExecutorUtils.ExecSpec

errMessage(String) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

error(UrlError) - Method in class org.lockss.laaws.crawler.model.UrlInfo

ERROR - Enum constant in enum class org.lockss.laaws.crawler.model.UrlError.SeverityEnum

ERROR - Static variable in class org.lockss.laaws.crawler.api.ApiResponseMessage

errorLogLevel - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

errorLogLevel - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

The level to use when logging error from a process

errorPattern - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

ErrorResult - Class in org.lockss.laaws.crawler.model

ErrorResult

ErrorResult() - Constructor for class org.lockss.laaws.crawler.model.ErrorResult

errors(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

EXCLUDE_DIRECTORIES_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

excludedItems(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

excludeStatusPattern - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

The http response codes to exclude from warc import.

EXEC_PREFIX - Static variable in class org.lockss.laaws.crawler.utils.ExecutorUtils

ExecSpec() - Constructor for class org.lockss.laaws.crawler.utils.ExecutorUtils.ExecSpec

ExecutorUtils - Class in org.lockss.laaws.crawler.utils

ExecutorUtils() - Constructor for class org.lockss.laaws.crawler.utils.ExecutorUtils

ExecutorUtils.ComparableFutureTask<T> - Class in org.lockss.laaws.crawler.utils

ExecutorUtils.ExecSpec - Class in org.lockss.laaws.crawler.utils

extractBytes(String) - Static method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

extractUrls(String) - Static method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

Returns a list with all links contained in the input

F

FATAL - Enum constant in enum class org.lockss.laaws.crawler.model.UrlError.SeverityEnum

fetchedItems(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

FileCommandOption - Class in org.lockss.laaws.crawler.impl.pluggable.command

Representation of a file command line option.

FileCommandOption(String) - Constructor for class org.lockss.laaws.crawler.impl.pluggable.command.FileCommandOption

Constructor.

format(Date, StringBuffer, FieldPosition) - Method in class org.lockss.laaws.crawler.RFC3339DateFormat

fromValue(String) - Static method in enum class org.lockss.laaws.crawler.model.UrlError.SeverityEnum

G

generateKey() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Generate key string.

getAcceptHeader() - Method in interface org.lockss.laaws.crawler.api.CrawlersApiDelegate

getAcceptHeader() - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getAcceptHeader() - Method in interface org.lockss.laaws.crawler.api.JobsApiDelegate

getAcceptHeader() - Method in interface org.lockss.laaws.crawler.api.StatusApiDelegate

getAcceptHeader() - Method in interface org.lockss.laaws.crawler.api.WsApiDelegate

getApiStatus() - Method in class org.lockss.laaws.crawler.impl.StatusApiServiceImpl

Provides the status object.

getAttributes() - Method in class org.lockss.laaws.crawler.model.CrawlerConfig

key value pairs specific providing attributes and configuration information.

getAu() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

getAuId() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getAuId() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Gets au id.

getAuId() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The id for the au.

getAuId() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get auId

getAuName() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getAuName() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The name for the au.

getAuName() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get auName

getBytesFetched() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The number of bytes fetched.

getBytesFetchedCount() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getBytesFetchedCount() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get bytesFetchedCount

getCmdLineBuilder() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getCode() - Method in class org.lockss.laaws.crawler.api.ApiResponseMessage

getCode() - Method in class org.lockss.laaws.crawler.model.ErrorResult

Get code

getCommand() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

Gets command.

getCompressedWarcExtension() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getConfig() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getConfigOptions() - Method in class org.lockss.laaws.crawler.wget.WgetCmdLineCrawler

getConnectTimeout() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

getConnectTimeout() - Method in class org.lockss.laaws.crawler.wget.WgetCmdLineCrawler

getContinuationToken() - Method in class org.lockss.laaws.crawler.model.PageInfo

The continuation token.

getCount() - Method in class org.lockss.laaws.crawler.model.Counter

The number of elements

getCount() - Method in class org.lockss.laaws.crawler.model.MimeCounter

The number of elements of mime type

getCounterLink() - Method in class org.lockss.laaws.crawler.model.MimeCounter

A link to the list of count elements or to a pager with count elements.

getCrawl(String) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getCrawl(String) - Method in interface org.lockss.laaws.crawler.impl.pluggable.PluggableCrawler

Get a Crawl for a given crawl id.

getCrawlById(String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApi

getCrawlById(String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getCrawlById(String) - Method in class org.lockss.laaws.crawler.impl.CrawlsApiServiceImpl

Provides the status of a requested crawl.

getCrawlByMimeType(String, String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApi

getCrawlByMimeType(String, String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getCrawlByMimeType(String, String, Integer, String) - Method in class org.lockss.laaws.crawler.impl.CrawlsApiServiceImpl

Returns all (or a pageful of) the items in a crawl by MIME type..

getCrawlDesc() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Gets crawl desc.

getCrawler(String) - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

Gets crawler.

getCrawlerConfig() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getCrawlerConfig() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Gets crawler config.

getCrawlerConfig() - Method in interface org.lockss.laaws.crawler.impl.pluggable.PluggableCrawler

Return the configuration for this crawler

getCrawlerConfig(String) - Method in interface org.lockss.laaws.crawler.api.CrawlersApi

getCrawlerConfig(String) - Method in interface org.lockss.laaws.crawler.api.CrawlersApiDelegate

getCrawlerConfig(String) - Method in class org.lockss.laaws.crawler.impl.CrawlersApiServiceImpl

getCrawlerConfig(String) - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

Gets crawler config.

getCrawlerId() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getCrawlerId() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Gets crawler id.

getCrawlerId() - Method in interface org.lockss.laaws.crawler.impl.pluggable.PluggableCrawler

Return the unique Id for this crawler.

getCrawlerId() - Method in class org.lockss.laaws.crawler.model.CrawlerConfig

The identifier for this crawler

getCrawlerId() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The id of the crawler used for this crawl.

getCrawlerIds() - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

getCrawlerIds() - Method in class org.lockss.laaws.crawler.impl.CrawlersApiServiceImpl

getCrawlerIds() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

Gets crawler ids.

getCrawlerMap() - Method in class org.lockss.laaws.crawler.model.CrawlerStatuses

An map of crawler status objects

getCrawlErrors(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApi

getCrawlErrors(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getCrawlErrors(String, Integer, String) - Method in class org.lockss.laaws.crawler.impl.CrawlsApiServiceImpl

Returns all (or a pageful of) the error URLS in a crawl.

getCrawlers() - Method in interface org.lockss.laaws.crawler.api.CrawlersApi

getCrawlers() - Method in interface org.lockss.laaws.crawler.api.CrawlersApiDelegate

getCrawlers() - Method in class org.lockss.laaws.crawler.impl.CrawlersApiServiceImpl

Return the list of configured crawlers.

getCrawlerStatus() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Provides the crawler status.

getCrawlerStatus(String) - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

getCrawlExcluded(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApi

getCrawlExcluded(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getCrawlExcluded(String, Integer, String) - Method in class org.lockss.laaws.crawler.impl.CrawlsApiServiceImpl

Returns all (or a pageful of) the excluded URLS in a crawl.

getCrawlFetched(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApi

getCrawlFetched(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getCrawlFetched(String, Integer, String) - Method in class org.lockss.laaws.crawler.impl.CrawlsApiServiceImpl

Returns all (or a pageful of) the fetched URLS in a crawl.

getCrawlJob(String) - Method in interface org.lockss.laaws.crawler.api.JobsApi

getCrawlJob(String) - Method in interface org.lockss.laaws.crawler.api.JobsApiDelegate

getCrawlJob(String) - Method in class org.lockss.laaws.crawler.impl.JobsApiServiceImpl

Provides the status of a requested crawl.

getCrawlJob(String) - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

Gets crawl status.

getCrawlJobsWithAuId(String) - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

Gets crawl jobs with au id.

getCrawlKey() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getCrawlKey() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Gets crawl key.

getCrawlKey() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get crawlKey

getCrawlKind() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Gets crawl kind.

getCrawlNotModified(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApi

getCrawlNotModified(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getCrawlNotModified(String, Integer, String) - Method in class org.lockss.laaws.crawler.impl.CrawlsApiServiceImpl

Returns all (or a pageful of) the not-modified URLS in a crawl.

getCrawlParsed(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApi

getCrawlParsed(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getCrawlParsed(String, Integer, String) - Method in class org.lockss.laaws.crawler.impl.CrawlsApiServiceImpl

Returns all (or a pageful of) the parsed URLS in a crawl.

getCrawlPending(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApi

getCrawlPending(String, Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getCrawlPending(String, Integer, String) - Method in class org.lockss.laaws.crawler.impl.CrawlsApiServiceImpl

Returns all (or a pageful of) the pending URLS in a crawl.

getCrawls() - Method in class org.lockss.laaws.crawler.model.CrawlPager

The crawls displayed in the page

getCrawls(Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApi

getCrawls(Integer, String) - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getCrawls(Integer, String) - Method in class org.lockss.laaws.crawler.impl.CrawlsApiServiceImpl

Provides all (or a pageful of) the crawls in the service.

getCrawlStatus() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getCrawlStatus() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Gets crawl status.

getCrawlStatus() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get crawlStatus

getCrawlStatus(String) - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

getCrawlType() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getCrawlType() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get crawlType

getCurLink() - Method in class org.lockss.laaws.crawler.model.PageInfo

The link to the current page.

getDelegate() - Method in interface org.lockss.laaws.crawler.api.CrawlersApi

getDelegate() - Method in class org.lockss.laaws.crawler.api.CrawlersApiController

getDelegate() - Method in interface org.lockss.laaws.crawler.api.CrawlsApi

getDelegate() - Method in class org.lockss.laaws.crawler.api.CrawlsApiController

getDelegate() - Method in interface org.lockss.laaws.crawler.api.JobsApi

getDelegate() - Method in class org.lockss.laaws.crawler.api.JobsApiController

getDelegate() - Method in interface org.lockss.laaws.crawler.api.StatusApi

getDelegate() - Method in class org.lockss.laaws.crawler.api.StatusApiController

getDelegate() - Method in interface org.lockss.laaws.crawler.api.WsApi

getDelegate() - Method in class org.lockss.laaws.crawler.api.WsApiController

getDepth() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The depth of the crawl.

getDuration() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getDuration() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get duration

getEndTime() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The timestamp for the end of the crawl.

getErrMessage() - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

Get errMessage

getError() - Method in class org.lockss.laaws.crawler.model.UrlInfo

Get error

getErrorLogLevel() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getErrors() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

Get errors

getExcludedItems() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

Get excludedItems

getFetchDelay() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

getFetchDelay() - Method in class org.lockss.laaws.crawler.wget.WgetCmdLineCrawler

getFetchedItems() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

Get fetchedItems

getItemsLink() - Method in class org.lockss.laaws.crawler.model.Counter

A link to the list of count items or to a pager with count\\ \\ items.

getJobId() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The id for the crawl.

getJobs() - Method in class org.lockss.laaws.crawler.model.JobPager

The jobs displayed in the page

getJobs(Integer, String) - Method in interface org.lockss.laaws.crawler.api.JobsApi

getJobs(Integer, String) - Method in interface org.lockss.laaws.crawler.api.JobsApiDelegate

getJobs(Integer, String) - Method in class org.lockss.laaws.crawler.impl.JobsApiServiceImpl

Get all crawl jobs

getJobStatus() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Gets job status.

getJobStatus() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

Get jobStatus

getLastElement() - Method in class org.lockss.laaws.crawler.utils.ContinuationToken

getLinkDepth() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getLinkDepth() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get linkDepth

getLockssCrawlManager() - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

Provide the Lockss CrawlManager

getLongKey() - Method in class org.lockss.laaws.crawler.impl.pluggable.command.CommandOption

Provides the long key of the command line option.

getMaxRetries() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

getMaxRetries() - Method in class org.lockss.laaws.crawler.wget.WgetCmdLineCrawler

getMessage() - Method in class org.lockss.laaws.crawler.api.ApiResponseMessage

getMessage() - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

Get message

getMessage() - Method in class org.lockss.laaws.crawler.model.ErrorResult

Get message

getMessage() - Method in class org.lockss.laaws.crawler.model.UrlError

The error message

getMimeType() - Method in class org.lockss.laaws.crawler.model.MimeCounter

The mime type to count.

getMimeTypeCount() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getMimeTypeCount() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get mimeTypeCount

getMimeTypes() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getMimeTypes() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The list of urls by mimeType.

getMimeTypes() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get mimeTypes

getNextLink() - Method in class org.lockss.laaws.crawler.model.PageInfo

The link to the next page.

getNotModifiedItems() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

Get notModifiedItems

getNumJobsActive() - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

The number of jobs running.

getNumJobsFailed() - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

The number of jobs failed.

getNumJobsPending() - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

The number of active jobs

getNumJobsSuccessful() - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

The number of jobs succeeded

getObjectMapper() - Method in interface org.lockss.laaws.crawler.api.CrawlersApiDelegate

getObjectMapper() - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getObjectMapper() - Method in interface org.lockss.laaws.crawler.api.JobsApiDelegate

getObjectMapper() - Method in interface org.lockss.laaws.crawler.api.StatusApiDelegate

getObjectMapper() - Method in interface org.lockss.laaws.crawler.api.WsApiDelegate

getOffSiteUrlsExcludedCount() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getOffSiteUrlsExcludedCount() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get offSiteUrlsExcludedCount

getOutputLogLevel() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getPageInfo() - Method in class org.lockss.laaws.crawler.model.CrawlPager

Get pageInfo

getPageInfo() - Method in class org.lockss.laaws.crawler.model.JobPager

Get pageInfo

getPageInfo() - Method in class org.lockss.laaws.crawler.model.UrlPager

Get pageInfo

getPageInfo(Integer, Long, int, Long) - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

getPagesExcluded() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesExcluded() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesExcluded

getPagesExcludedCount() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesExcludedCount() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesExcludedCount

getPagesFetched() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesFetched() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesFetched

getPagesFetchedCount() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesFetchedCount() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesFetchedCount

getPagesNotModified() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesNotModified() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesNotModified

getPagesNotModifiedCount() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesNotModifiedCount() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesNotModifiedCount

getPagesParsed() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesParsed() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesParsed

getPagesParsedCount() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesParsedCount() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesParsedCount

getPagesPending() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesPending() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesPending

getPagesPendingCount() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesPendingCount() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesPendingCount

getPagesWithErrors() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesWithErrors() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesWithErrors

getPagesWithErrorsCount() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPagesWithErrorsCount() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get pagesWithErrorsCount

getParsedItems() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

Get parsedItems

getPendingItems() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

Get pendingItems

getPluggableCrawlManager() - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

Provides the Pluggable Crawl manager.

getPluggableCrawlManager() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getPriority() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getPriority() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler.RunnableCrawlJob

getPriority() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The priority for this crawl.

getPriority() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get priority

getProcExitWait() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getProxy() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The proxy used for crawling.

getReadTimeout() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

getReadTimeout() - Method in class org.lockss.laaws.crawler.wget.WgetCmdLineCrawler

getReferrers() - Method in class org.lockss.laaws.crawler.model.UrlInfo

An optional list of referrers.

getRefetchDepth() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getRefetchDepth() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The refetch depth of the crawl.

getRefetchDepth() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get refetchDepth

getRepositoryManager() - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

Provide the Lockss RepositoryManager

getRequest() - Method in interface org.lockss.laaws.crawler.api.CrawlersApiDelegate

getRequest() - Method in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

getRequest() - Method in interface org.lockss.laaws.crawler.api.JobsApiDelegate

getRequest() - Method in interface org.lockss.laaws.crawler.api.StatusApiDelegate

getRequest() - Method in interface org.lockss.laaws.crawler.api.WsApiDelegate

getRequestDate() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler.RunnableCrawlJob

getReqUrls() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

getResultsPerPage() - Method in class org.lockss.laaws.crawler.model.PageInfo

The number of results per page.

getRetryDelay() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

getRetryDelay() - Method in class org.lockss.laaws.crawler.wget.WgetCmdLineCrawler

getRootCause() - Method in class org.lockss.laaws.crawler.model.ErrorResult

Get rootCause

getRunnable() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

getSeverity() - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

Get severity

getSeverity() - Method in class org.lockss.laaws.crawler.model.UrlError

the severity of the error.

getSources() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getSources() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The sources to use for the crawl.

getSources() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get sources

getStartingUrls() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getStartingUrls() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get startingUrls

getStartTime() - Method in class org.lockss.laaws.crawler.impl.CrawlWsSource

getStartTime() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The timestamp for the start of crawl.

getStartTime() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

Get startTime

getStartUrls() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The array of start urls.

getStatus() - Method in interface org.lockss.laaws.crawler.api.StatusApi

getStatus() - Method in interface org.lockss.laaws.crawler.api.StatusApiDelegate

getStems() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

getTimestamp() - Method in class org.lockss.laaws.crawler.utils.ContinuationToken

getTmpDir() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

Gets tmp dir.

getTotalCount() - Method in class org.lockss.laaws.crawler.model.PageInfo

The total number of elements to be paginated

getType() - Method in class org.lockss.laaws.crawler.api.ApiResponseMessage

getType() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

The type of crawl.

getUncompressedWarcExtension() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getUnsupportedParams() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getUrl() - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

Get url

getUrl() - Method in class org.lockss.laaws.crawler.model.UrlInfo

The url string

getUrls() - Method in class org.lockss.laaws.crawler.model.UrlPager

An list of url with related info.

getV2Namespace() - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

getV2Repo() - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

getValue() - Method in class org.lockss.laaws.crawler.impl.pluggable.command.CommandOption

Provides the value of the command line option.

getWarcFileFilter() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

getWarcFiles(List<String>) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

getWsCrawls(String) - Method in interface org.lockss.laaws.crawler.api.WsApi

getWsCrawls(String) - Method in interface org.lockss.laaws.crawler.api.WsApiDelegate

getWsCrawls(String) - Method in class org.lockss.laaws.crawler.impl.WsApiServiceImpl

H

handleCrawlComplete(CrawlerStatus) - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

handle the complete crawl.

handleCrawlComplete(CrawlEvent) - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

handle the complete crawl.

hashCode() - Method in class org.lockss.laaws.crawler.model.Counter

hashCode() - Method in class org.lockss.laaws.crawler.model.CrawlerConfig

hashCode() - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

hashCode() - Method in class org.lockss.laaws.crawler.model.CrawlerStatuses

hashCode() - Method in class org.lockss.laaws.crawler.model.CrawlPager

hashCode() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

hashCode() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

hashCode() - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

hashCode() - Method in class org.lockss.laaws.crawler.model.ErrorResult

hashCode() - Method in class org.lockss.laaws.crawler.model.JobPager

hashCode() - Method in class org.lockss.laaws.crawler.model.MimeCounter

hashCode() - Method in class org.lockss.laaws.crawler.model.PageInfo

hashCode() - Method in class org.lockss.laaws.crawler.model.UrlError

hashCode() - Method in class org.lockss.laaws.crawler.model.UrlInfo

hashCode() - Method in class org.lockss.laaws.crawler.model.UrlPager

hashCode() - Method in class org.lockss.laaws.crawler.utils.ExecutorUtils.ExecSpec

HEADER_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

HTTP Options

HomeController - Class in org.lockss.laaws.crawler.config

Home redirection to swagger api documentation

HomeController() - Constructor for class org.lockss.laaws.crawler.config.HomeController

I

INCLUDE_DIRECTORIES_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

index() - Method in class org.lockss.laaws.crawler.config.HomeController

INFO - Static variable in class org.lockss.laaws.crawler.api.ApiResponseMessage

init(FilterConfig) - Method in class org.lockss.laaws.crawler.api.ApiOriginFilter

initCrawlScheduler(String) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

INPUT_FILE_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

isActive(Boolean) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

isAutoCrawlEnabled(Boolean) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

isCrawlerEnabled() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

isCrawlerEnabled() - Method in interface org.lockss.laaws.crawler.impl.pluggable.PluggableCrawler

is this crawler enabled

isCrawlerEnabled() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

is crawling enabled

isCrawlerEnabled(String) - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

Is a specific crawler enabled

isCrawlStarterEnabled() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

is the crawl starter enabled

isElgibleForCrawl(String) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

isEligibleForCrawl(String) - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

Is eligible Au elgible for crawl boolean.

isEnabled(Boolean) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

isError(Boolean) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

isIsActive() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

True if the crawl is active.

isIsAutoCrawlEnabled() - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

Does crawler autocrawl AUs when needed.

isIsEnabled() - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

Is the crawler enabled

isIsError() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

True if the crawl has errored.

isIsWaiting() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

True if the crawl waiting to start.

isJoinOutputStreams() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

isWaiting(Boolean) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

itemsLink(String) - Method in class org.lockss.laaws.crawler.model.Counter

J

jobId(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

JobPager - Class in org.lockss.laaws.crawler.model

A display page of jobs

JobPager() - Constructor for class org.lockss.laaws.crawler.model.JobPager

jobs(List<CrawlJob>) - Method in class org.lockss.laaws.crawler.model.JobPager

JobsApi - Interface in org.lockss.laaws.crawler.api

JobsApiController - Class in org.lockss.laaws.crawler.api

JobsApiController(JobsApiDelegate) - Constructor for class org.lockss.laaws.crawler.api.JobsApiController

JobsApiDelegate - Interface in org.lockss.laaws.crawler.api

A delegate to be called by the JobsApiController}.

JobsApiServiceImpl - Class in org.lockss.laaws.crawler.impl

JobsApiServiceImpl(HttpServletRequest) - Constructor for class org.lockss.laaws.crawler.impl.JobsApiServiceImpl

jobStatus(JobStatus) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

L

LEVEL_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

linkDepth(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

ListStringCommandOption - Class in org.lockss.laaws.crawler.impl.pluggable.command

Representation of a command line option containing a list of strings.

ListStringCommandOption(String) - Constructor for class org.lockss.laaws.crawler.impl.pluggable.command.ListStringCommandOption

Constructor.

LocalDateConverter - Class in org.lockss.laaws.crawler.config

LocalDateConverter(String) - Constructor for class org.lockss.laaws.crawler.config.LocalDateConverter

LocalDateTimeConverter - Class in org.lockss.laaws.crawler.config

LocalDateTimeConverter(String) - Constructor for class org.lockss.laaws.crawler.config.LocalDateTimeConverter

log - Static variable in interface org.lockss.laaws.crawler.api.CrawlersApiDelegate

log - Static variable in interface org.lockss.laaws.crawler.api.CrawlsApiDelegate

log - Static variable in interface org.lockss.laaws.crawler.api.JobsApiDelegate

log - Static variable in interface org.lockss.laaws.crawler.api.StatusApiDelegate

log - Static variable in interface org.lockss.laaws.crawler.api.WsApiDelegate

M

main(String[]) - Static method in class org.lockss.laaws.crawler.CrawlerApplication

The entry point of the application.

makeCounter(ApiUtils.COUNTER_KIND, String, CrawlerStatus.UrlCount) - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

makeCrawlDesc(CrawlerStatus) - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

makeCrawlLink(String) - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

makeCrawlStatus(CrawlerStatus) - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

makeJobStatus(CrawlerStatus) - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

makePriorityExecutor(int, long, int, int) - Static method in class org.lockss.laaws.crawler.utils.ExecutorUtils

markInterruptedCrawls() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

maxThreads - Variable in class org.lockss.laaws.crawler.utils.ExecutorUtils.ExecSpec

maxThreads(int) - Method in class org.lockss.laaws.crawler.utils.ExecutorUtils.ExecSpec

message(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

message(String) - Method in class org.lockss.laaws.crawler.model.ErrorResult

message(String) - Method in class org.lockss.laaws.crawler.model.UrlError

MimeCounter - Class in org.lockss.laaws.crawler.model

A counter for mimeTypes seen during a crawl.

MimeCounter() - Constructor for class org.lockss.laaws.crawler.model.MimeCounter

mimeType(String) - Method in class org.lockss.laaws.crawler.model.MimeCounter

mimeTypeCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

mimeTypes(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

mimeTypes(List<MimeCounter>) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

MIRROR_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

N

nextLink(String) - Method in class org.lockss.laaws.crawler.model.PageInfo

NO_DIRECTORIES_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

Directories

NO_PARENT_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

NO_WARC_COMPRESSION_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

notModifiedItems(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

numJobsActive(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

numJobsFailed(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

numJobsPending(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

numJobsSuccessful(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

O

offSiteUrlsExcludedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

OK - Static variable in class org.lockss.laaws.crawler.api.ApiResponseMessage

openApi() - Method in class org.lockss.laaws.crawler.config.SwaggerDocumentationConfig

org.lockss.laaws.crawler - package org.lockss.laaws.crawler

org.lockss.laaws.crawler.api - package org.lockss.laaws.crawler.api

org.lockss.laaws.crawler.config - package org.lockss.laaws.crawler.config

org.lockss.laaws.crawler.impl - package org.lockss.laaws.crawler.impl

org.lockss.laaws.crawler.impl.pluggable - package org.lockss.laaws.crawler.impl.pluggable

org.lockss.laaws.crawler.impl.pluggable.command - package org.lockss.laaws.crawler.impl.pluggable.command

org.lockss.laaws.crawler.model - package org.lockss.laaws.crawler.model

org.lockss.laaws.crawler.security - package org.lockss.laaws.crawler.security

org.lockss.laaws.crawler.utils - package org.lockss.laaws.crawler.utils

org.lockss.laaws.crawler.wget - package org.lockss.laaws.crawler.wget

outputLogLevel - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

outputLogLevel - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

The level to use when logging output from a process

P

PAGE_REQUISITES_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

pageInfo(PageInfo) - Method in class org.lockss.laaws.crawler.model.CrawlPager

pageInfo(PageInfo) - Method in class org.lockss.laaws.crawler.model.JobPager

pageInfo(PageInfo) - Method in class org.lockss.laaws.crawler.model.UrlPager

PageInfo - Class in org.lockss.laaws.crawler.model

The information related to pagination of content

PageInfo() - Constructor for class org.lockss.laaws.crawler.model.PageInfo

pagesExcluded(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

pagesExcludedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

pagesFetched(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

pagesFetchedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

pagesNotModified(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

pagesNotModifiedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

pagesParsed(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

pagesParsedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

pagesPending(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

pagesPendingCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

pagesWithErrors(List<CrawlWsResultPagesWithErrors>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

pagesWithErrorsCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

PARAM_CRAWL_DB_PATH - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

The constant PARAM_CRAWL_DB_PATH.

PARAM_EXECUTOR_SPEC - Static variable in class org.lockss.laaws.crawler.utils.ExecutorUtils

Executor Spec: queue-max;thread-max or queue-max;core-threads;max-threads

PARAM_REQUEUE_ON_RESTART - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

PARAM_THREAD_TIMEOUT - Static variable in class org.lockss.laaws.crawler.utils.ExecutorUtils

Executor thread timeout

parsedItems(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

parseLine(String, String) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

parsePoolSpec(String) - Static method in class org.lockss.laaws.crawler.utils.ExecutorUtils

parsePoolSpecInto(String, ExecutorUtils.ExecSpec) - Static method in class org.lockss.laaws.crawler.utils.ExecutorUtils

pcManager - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

pendingItems(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

PLUGGABLE_CRAWL_MANAGER - Static variable in class org.lockss.laaws.crawler.CrawlerApplication

PLUGGABLE_CRAWL_MANAGER_DESC - Static variable in class org.lockss.laaws.crawler.CrawlerApplication

PluggableCrawl - Class in org.lockss.laaws.crawler.impl.pluggable

Basic Pluggable crawl - extend to provide functionality for a specific crawler

PluggableCrawl(CrawlerConfig, ArchivalUnit, CrawlJob) - Constructor for class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Instantiates a new Pluggable crawl.

PluggableCrawl.PluggableCrawlerStatus - Class in org.lockss.laaws.crawler.impl.pluggable

A wrapper around a Rest CrawlStatus that can be used inside the daemon code.

PluggableCrawler - Interface in org.lockss.laaws.crawler.impl.pluggable

An interface to defines the basic functions of a pluggable crawler

PluggableCrawlerStatus(PluggableCrawl) - Constructor for class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl.PluggableCrawlerStatus

Instantiates a new Pluggable crawler status.

PluggableCrawlManager - Class in org.lockss.laaws.crawler.impl

The type Pluggable crawl manager.

PluggableCrawlManager() - Constructor for class org.lockss.laaws.crawler.impl.PluggableCrawlManager

PREFIX - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

PREFIX - Static variable in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

The constant PREFIX.

priority(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

priority(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

process(String, Object, File, List<String>) - Static method in class org.lockss.laaws.crawler.impl.pluggable.command.FileCommandOption

Processes a file command line option.

process(String, Object, List<String>) - Static method in class org.lockss.laaws.crawler.impl.pluggable.command.BooleanCommandOption

Processes a boolean command line option.

process(String, Object, List<String>) - Static method in class org.lockss.laaws.crawler.impl.pluggable.command.ListStringCommandOption

Processes a command line option containing a list of strings.

process(String, Object, List<String>) - Static method in class org.lockss.laaws.crawler.impl.pluggable.command.StringCommandOption

Processes a string command line option.

procExitWait - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

proxy(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

putAttributesItem(String, String) - Method in class org.lockss.laaws.crawler.model.CrawlerConfig

putCrawlerMapItem(String, CrawlerStatus) - Method in class org.lockss.laaws.crawler.model.CrawlerStatuses

Q

queueJob(CrawlDesc) - Method in interface org.lockss.laaws.crawler.api.JobsApi

queueJob(CrawlDesc) - Method in interface org.lockss.laaws.crawler.api.JobsApiDelegate

queueJob(CrawlDesc) - Method in class org.lockss.laaws.crawler.impl.JobsApiServiceImpl

Requests a crawl.

queueSize - Variable in class org.lockss.laaws.crawler.utils.ExecutorUtils.ExecSpec

queueSize(int) - Method in class org.lockss.laaws.crawler.utils.ExecutorUtils.ExecSpec

QUIET_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

R

READ_TIMEOUT_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

RECURSIVE_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

Recursive download parameters

referrers(List<String>) - Method in class org.lockss.laaws.crawler.model.UrlInfo

refetchDepth(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

refetchDepth(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

REJECT_REGEX_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

requestCrawl(ArchivalUnit, CrawlJob) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

requestCrawl(ArchivalUnit, CrawlJob) - Method in interface org.lockss.laaws.crawler.impl.pluggable.PluggableCrawler

restartCrawls() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

restart unfinished crawls.

resultsPerPage(Integer) - Method in class org.lockss.laaws.crawler.model.PageInfo

RFC3339DateFormat - Class in org.lockss.laaws.crawler

RFC3339DateFormat() - Constructor for class org.lockss.laaws.crawler.RFC3339DateFormat

rootCause(String) - Method in class org.lockss.laaws.crawler.model.ErrorResult

run() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler.RunnableCrawlJob

run(String...) - Method in class org.lockss.laaws.crawler.CrawlerApplication

Callback used to run the application starting the LOCKSS daemon.

RunnableCrawlJob(CrawlJob, CmdLineCrawl) - Constructor for class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler.RunnableCrawlJob

S

SecurityConfigurer - Class in org.lockss.laaws.crawler.security

Custom Spring security configurator.

SecurityConfigurer() - Constructor for class org.lockss.laaws.crawler.security.SecurityConfigurer

setAttributes(Map<String, String>) - Method in class org.lockss.laaws.crawler.model.CrawlerConfig

setAuId(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setAuId(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setAuName(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setAuName(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setBytesFetched(Long) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setBytesFetchedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setCmdLineBuilder(CmdLineCrawler.CommandLineBuilder) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

setCode(int) - Method in class org.lockss.laaws.crawler.api.ApiResponseMessage

setCode(Integer) - Method in class org.lockss.laaws.crawler.model.ErrorResult

setConfig(Configuration, Configuration, Configuration.Differences) - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

setConfig(CrawlerConfig) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

setContinuationToken(String) - Method in class org.lockss.laaws.crawler.model.PageInfo

setCount(Integer) - Method in class org.lockss.laaws.crawler.model.Counter

setCount(Integer) - Method in class org.lockss.laaws.crawler.model.MimeCounter

setCounterLink(String) - Method in class org.lockss.laaws.crawler.model.MimeCounter

setCrawlerId(String) - Method in class org.lockss.laaws.crawler.model.CrawlerConfig

setCrawlerId(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setCrawlerMap(Map<String, CrawlerStatus>) - Method in class org.lockss.laaws.crawler.model.CrawlerStatuses

setCrawlerStatus(CrawlerStatus) - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Saves the crawler status.

setCrawlKey(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setCrawlManager(PluggableCrawlManager) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

setCrawls(List<CrawlStatus>) - Method in class org.lockss.laaws.crawler.model.CrawlPager

setCrawlStatus(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setCrawlType(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setCurLink(String) - Method in class org.lockss.laaws.crawler.model.PageInfo

setDepth(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setDuration(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setEndTime(Long) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setErrMessage(String) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

setError(UrlError) - Method in class org.lockss.laaws.crawler.model.UrlInfo

setErrors(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setExcludedItems(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setFetchedItems(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setIsActive(Boolean) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setIsAutoCrawlEnabled(Boolean) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

setIsEnabled(Boolean) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

setIsError(Boolean) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setIsWaiting(Boolean) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setItemsLink(String) - Method in class org.lockss.laaws.crawler.model.Counter

setJobId(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setJobs(List<CrawlJob>) - Method in class org.lockss.laaws.crawler.model.JobPager

setJobStatus(JobStatus) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setLinkDepth(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setMessage(String) - Method in class org.lockss.laaws.crawler.api.ApiResponseMessage

setMessage(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

setMessage(String) - Method in class org.lockss.laaws.crawler.model.ErrorResult

setMessage(String) - Method in class org.lockss.laaws.crawler.model.UrlError

setMimeType(String) - Method in class org.lockss.laaws.crawler.model.MimeCounter

setMimeTypeCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setMimeTypes(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setMimeTypes(List<MimeCounter>) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setNamespace(String) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

setNextLink(String) - Method in class org.lockss.laaws.crawler.model.PageInfo

setNotModifiedItems(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setNumJobsActive(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

setNumJobsFailed(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

setNumJobsPending(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

setNumJobsSuccessful(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

setOffSiteUrlsExcludedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPageInfo(PageInfo) - Method in class org.lockss.laaws.crawler.model.CrawlPager

setPageInfo(PageInfo) - Method in class org.lockss.laaws.crawler.model.JobPager

setPageInfo(PageInfo) - Method in class org.lockss.laaws.crawler.model.UrlPager

setPagesExcluded(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPagesExcludedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPagesFetched(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPagesFetchedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPagesNotModified(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPagesNotModifiedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPagesParsed(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPagesParsedCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPagesPending(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPagesPendingCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPagesWithErrors(List<CrawlWsResultPagesWithErrors>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setPagesWithErrorsCount(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setParsedItems(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setPendingItems(Counter) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setPluggableCrawlManager(PluggableCrawlManager) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

setPluggableCrawlManager(PluggableCrawlManager) - Method in interface org.lockss.laaws.crawler.impl.pluggable.PluggableCrawler

Set the Crawl Manager which created and maintains this crawler.

setPriority(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setPriority(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setProxy(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setReferrers(List<String>) - Method in class org.lockss.laaws.crawler.model.UrlInfo

setRefetchDepth(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setRefetchDepth(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setResultsPerPage(Integer) - Method in class org.lockss.laaws.crawler.model.PageInfo

setRootCause(String) - Method in class org.lockss.laaws.crawler.model.ErrorResult

setSeverity(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

setSeverity(UrlError.SeverityEnum) - Method in class org.lockss.laaws.crawler.model.UrlError

setSources(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setSources(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setStartingUrls(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setStartTime(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

setStartTime(Long) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setStartUrls(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setTotalCount(Integer) - Method in class org.lockss.laaws.crawler.model.PageInfo

setType(String) - Method in class org.lockss.laaws.crawler.api.ApiResponseMessage

setType(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

setUrl(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

setUrl(String) - Method in class org.lockss.laaws.crawler.model.UrlInfo

setUrls(List<UrlInfo>) - Method in class org.lockss.laaws.crawler.model.UrlPager

setV2Repo(LockssRepository) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

setValue(String) - Method in class org.lockss.laaws.crawler.impl.pluggable.command.CommandOption

Saves the value of the command line option.

severity(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

severity(UrlError.SeverityEnum) - Method in class org.lockss.laaws.crawler.model.UrlError

shutdown() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

shutdown() - Method in interface org.lockss.laaws.crawler.impl.pluggable.PluggableCrawler

Shutdown the crawler.

shutdownWithWait(ExecutorService) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

sources(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

sources(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

SPAN_HOSTS_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

SPIDER_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

splitToken(String) - Method in class org.lockss.laaws.crawler.utils.ContinuationToken

START_URL_KEY - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

startCrawl() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

startCrawl() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Enqueue a crawl request.

startingUrls(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

startService() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

startTime(Integer) - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

startTime(Long) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

startUrls(List<String>) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

StatusApi - Interface in org.lockss.laaws.crawler.api

StatusApiController - Class in org.lockss.laaws.crawler.api

StatusApiController(StatusApiDelegate) - Constructor for class org.lockss.laaws.crawler.api.StatusApiController

StatusApiDelegate - Interface in org.lockss.laaws.crawler.api

A delegate to be called by the StatusApiController}.

StatusApiServiceImpl - Class in org.lockss.laaws.crawler.impl

Service for accessing the status.

StatusApiServiceImpl() - Constructor for class org.lockss.laaws.crawler.impl.StatusApiServiceImpl

stopCrawl() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

stopCrawl() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl

Stop crawl crawler status.

stopCrawl(String) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

stopCrawl(String) - Method in interface org.lockss.laaws.crawler.impl.pluggable.PluggableCrawler

Stop a crawl a specific crawl

stopService() - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

storeInRepository(String, File, boolean) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

StringCommandOption - Class in org.lockss.laaws.crawler.impl.pluggable.command

Representation of a string command line option.

StringCommandOption(String) - Constructor for class org.lockss.laaws.crawler.impl.pluggable.command.StringCommandOption

Constructor.

successPattern - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

SwaggerDocumentationConfig - Class in org.lockss.laaws.crawler.config

SwaggerDocumentationConfig() - Constructor for class org.lockss.laaws.crawler.config.SwaggerDocumentationConfig

SwaggerUiConfiguration - Class in org.lockss.laaws.crawler.config

SwaggerUiConfiguration() - Constructor for class org.lockss.laaws.crawler.config.SwaggerUiConfiguration

T

threadName - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

TIMEOUT_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

tmpDir - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

The temp directory used to store any files.

TOO_BUSY - Static variable in class org.lockss.laaws.crawler.api.ApiResponseMessage

toString() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

toString() - Method in class org.lockss.laaws.crawler.impl.pluggable.PluggableCrawl.PluggableCrawlerStatus

toString() - Method in class org.lockss.laaws.crawler.model.Counter

toString() - Method in class org.lockss.laaws.crawler.model.CrawlerConfig

toString() - Method in class org.lockss.laaws.crawler.model.CrawlerStatus

toString() - Method in class org.lockss.laaws.crawler.model.CrawlerStatuses

toString() - Method in class org.lockss.laaws.crawler.model.CrawlPager

toString() - Method in class org.lockss.laaws.crawler.model.CrawlStatus

toString() - Method in class org.lockss.laaws.crawler.model.CrawlWsResult

toString() - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

toString() - Method in class org.lockss.laaws.crawler.model.ErrorResult

toString() - Method in class org.lockss.laaws.crawler.model.JobPager

toString() - Method in class org.lockss.laaws.crawler.model.MimeCounter

toString() - Method in class org.lockss.laaws.crawler.model.PageInfo

toString() - Method in enum class org.lockss.laaws.crawler.model.UrlError.SeverityEnum

toString() - Method in class org.lockss.laaws.crawler.model.UrlError

toString() - Method in class org.lockss.laaws.crawler.model.UrlInfo

toString() - Method in class org.lockss.laaws.crawler.model.UrlPager

toString() - Method in class org.lockss.laaws.crawler.utils.ContinuationToken

toString() - Method in class org.lockss.laaws.crawler.utils.ExecutorUtils.ExecSpec

totalCount(Integer) - Method in class org.lockss.laaws.crawler.model.PageInfo

toToken() - Method in class org.lockss.laaws.crawler.utils.ContinuationToken

TRIES_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

Download parameters

type(String) - Method in class org.lockss.laaws.crawler.model.CrawlStatus

U

unsupportedParams - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

updateAuConfig(ArchivalUnit, boolean, List<String>, List<String>) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

updateCrawlerConfig(CrawlerConfig) - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

updateCrawlerConfig(CrawlerConfig) - Method in interface org.lockss.laaws.crawler.impl.pluggable.PluggableCrawler

set the configuration parameters for this crawler

updateCrawlerConfig(CrawlerConfig) - Method in class org.lockss.laaws.crawler.wget.WgetCmdLineCrawler

updateCrawlJob(CrawlJob) - Method in class org.lockss.laaws.crawler.impl.PluggableCrawlManager

Update a crawl Jobs status.

url(String) - Method in class org.lockss.laaws.crawler.model.CrawlWsResultPagesWithErrors

url(String) - Method in class org.lockss.laaws.crawler.model.UrlInfo

URL_STEMS_KEY - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

UrlError - Class in org.lockss.laaws.crawler.model

information related to an error for a url.

UrlError() - Constructor for class org.lockss.laaws.crawler.model.UrlError

UrlError.SeverityEnum - Enum Class in org.lockss.laaws.crawler.model

the severity of the error.

UrlInfo - Class in org.lockss.laaws.crawler.model

information related to an url.

UrlInfo() - Constructor for class org.lockss.laaws.crawler.model.UrlInfo

UrlPager - Class in org.lockss.laaws.crawler.model

A Pager for urls with maps.

UrlPager() - Constructor for class org.lockss.laaws.crawler.model.UrlPager

urlPattern - Static variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawl

urls(List<UrlInfo>) - Method in class org.lockss.laaws.crawler.model.UrlPager

useCompressWarc() - Method in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

USER_AGENT_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

V

validateContinuationToken(long, ContinuationToken) - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

Checks that a continuation token is valid.

validateLimit(Integer) - Static method in class org.lockss.laaws.crawler.impl.ApiUtils

Checks that a limit field is valid.

valueOf(String) - Static method in enum class org.lockss.laaws.crawler.model.UrlError.SeverityEnum

Returns the enum constant of this class with the specified name.

values() - Static method in enum class org.lockss.laaws.crawler.model.UrlError.SeverityEnum

Returns an array containing the constants of this enum class, in the order they are declared.

VERBOSE_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

W

WAIT_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

WAIT_RETRY_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

WARC_CDX_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

WARC parameter options

WARC_DEDUP_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

WARC_FILE_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

WARC_FILE_NAME - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandLineBuilder

WARC_HEADER_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

WARC_MAX_SIZE_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

WARC_TEMPDIR_KEY - Static variable in class org.lockss.laaws.crawler.wget.WgetCommandOptions

warcFileFilter - Variable in class org.lockss.laaws.crawler.impl.pluggable.CmdLineCrawler

WARNING - Enum constant in enum class org.lockss.laaws.crawler.model.UrlError.SeverityEnum

WARNING - Static variable in class org.lockss.laaws.crawler.api.ApiResponseMessage

WgetCmdLineCrawler - Class in org.lockss.laaws.crawler.wget

The type Wget cmd line crawler.

WgetCmdLineCrawler() - Constructor for class org.lockss.laaws.crawler.wget.WgetCmdLineCrawler

WgetCommandLineBuilder - Class in org.lockss.laaws.crawler.wget

The builder of a wget command line.

WgetCommandOptions - Class in org.lockss.laaws.crawler.wget

Representation of wget command line options.

WgetCommandOptions() - Constructor for class org.lockss.laaws.crawler.wget.WgetCommandOptions

WsApi - Interface in org.lockss.laaws.crawler.api

WsApiController - Class in org.lockss.laaws.crawler.api

WsApiController(WsApiDelegate) - Constructor for class org.lockss.laaws.crawler.api.WsApiController

WsApiDelegate - Interface in org.lockss.laaws.crawler.api

A delegate to be called by the WsApiController}.

WsApiServiceImpl - Class in org.lockss.laaws.crawler.impl

WsApiServiceImpl() - Constructor for class org.lockss.laaws.crawler.impl.WsApiServiceImpl

A B C D E F G H I J L M N O P Q R S T U V W
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form