| Package | Description |
|---|---|
| cn.wanghaomiao.seimi.core | |
| cn.wanghaomiao.seimi.def | |
| cn.wanghaomiao.seimi.struct |
| Modifier and Type | Method and Description |
|---|---|
Request |
SeimiQueue.bPop(String crawlerName)
阻塞式出队一个请求
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
SeimiQueue.isProcessed(Request req)
判断一个URL是否处理过了
|
boolean |
SeimiQueue.push(Request req)
入队一个请求
|
| Modifier and Type | Method and Description |
|---|---|
Request |
DefaultLocalQueue.bPop(String crawlerName) |
Request |
DefaultRedisQueue.bPop(String crawlerName) |
| Modifier and Type | Method and Description |
|---|---|
LinkedBlockingQueue<Request> |
DefaultLocalQueue.getQueue(String crawlerName) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
DefaultLocalQueue.isProcessed(Request req) |
boolean |
DefaultRedisQueue.isProcessed(Request req) |
boolean |
DefaultLocalQueue.push(Request req) |
boolean |
DefaultRedisQueue.push(Request req) |
protected void |
BaseSeimiCrawler.push(Request request) |
| Modifier and Type | Method and Description |
|---|---|
static Request |
Request.build(String url,
String callBack) |
static Request |
Request.build(String url,
String callBack,
HttpMethod httpMethod,
Map<String,String> params,
Map<String,Object> meta) |
Request |
Response.getRequest() |
| Modifier and Type | Method and Description |
|---|---|
void |
Response.setRequest(Request request) |
Copyright © 2015. All Rights Reserved.