@Queue public class DefaultLocalQueue extends Object implements SeimiQueue
| Constructor and Description |
|---|
DefaultLocalQueue() |
| Modifier and Type | Method and Description |
|---|---|
Request |
bPop(String crawlerName)
阻塞式出队一个请求
|
ConcurrentSkipListSet<String> |
getProcessedSet(String crawlerName) |
LinkedBlockingQueue<Request> |
getQueue(String crawlerName) |
boolean |
isProcessed(Request req)
判断一个URL是否处理过了
|
long |
len(String crawlerName)
任务队列剩余长度
|
boolean |
push(Request req)
入队一个请求
|
long |
totalCrawled(String crawlerName)
目前总共的抓取数量
|
public Request bPop(String crawlerName)
SeimiQueuebPop in interface SeimiQueuepublic boolean push(Request req)
SeimiQueuepush in interface SeimiQueuepublic long len(String crawlerName)
SeimiQueuelen in interface SeimiQueuepublic boolean isProcessed(Request req)
SeimiQueueisProcessed in interface SeimiQueuepublic long totalCrawled(String crawlerName)
SeimiQueuetotalCrawled in interface SeimiQueuepublic LinkedBlockingQueue<Request> getQueue(String crawlerName)
public ConcurrentSkipListSet<String> getProcessedSet(String crawlerName)
Copyright © 2015. All Rights Reserved.