cn.wanghaomiao.seimi.def

Class DefaultRedisQueue

java.lang.Object

cn.wanghaomiao.seimi.def.DefaultRedisQueue

All Implemented Interfaces:

SeimiQueue

@Queue
public class DefaultRedisQueue
extends Object
implements SeimiQueue

Since:

2015/8/21.

Author:

汪浩淼 [et.tw@163.com]

Constructor Summary

Constructors

Constructor and Description
DefaultRedisQueue()

Method Summary

Methods

Modifier and Type	Method and Description
void	addProcessed(Request req) 记录一个处理过的请求
Request	bPop(String crawlerName) 阻塞式出队一个请求
String	getHost()
String	getPassword()
int	getPort()
String	getQuueNamePrefix()
redis.clients.jedis.Jedis	getWClient()
redis.clients.jedis.JedisPool	getWritePool()
void	init()
boolean	isProcessed(Request req) 判断一个URL是否处理过了
long	len(String crawlerName) 任务队列剩余长度
boolean	push(Request req) 入队一个请求
void	refresh()
void	setHost(String host)
void	setPassword(String password)
void	setPort(int port)
void	setQuueNamePrefix(String quueNamePrefix)
long	totalCrawled(String crawlerName) 目前总共的抓取数量

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DefaultRedisQueue

public DefaultRedisQueue()

Method Detail

init

@PostConstruct
public void init()

refresh

public void refresh()

getWritePool

public redis.clients.jedis.JedisPool getWritePool()

getWClient

public redis.clients.jedis.Jedis getWClient()

bPop

public Request bPop(String crawlerName)

Description copied from interface: SeimiQueue

阻塞式出队一个请求

Specified by:

bPop in interface SeimiQueue

Returns:

push

public boolean push(Request req)

Description copied from interface: SeimiQueue

入队一个请求

Specified by:

push in interface SeimiQueue

Returns:

len

public long len(String crawlerName)

Description copied from interface: SeimiQueue

任务队列剩余长度

Specified by:

len in interface SeimiQueue

Returns:

isProcessed

public boolean isProcessed(Request req)

Description copied from interface: SeimiQueue

判断一个URL是否处理过了

Specified by:

isProcessed in interface SeimiQueue

Returns:

addProcessed

public void addProcessed(Request req)

Description copied from interface: SeimiQueue

记录一个处理过的请求

Specified by:

addProcessed in interface SeimiQueue

totalCrawled

public long totalCrawled(String crawlerName)

Description copied from interface: SeimiQueue

目前总共的抓取数量

Specified by:

totalCrawled in interface SeimiQueue

Returns:

getHost

public String getHost()

setHost

public void setHost(String host)

getPort

public int getPort()

setPort

public void setPort(int port)

getPassword

public String getPassword()

setPassword

public void setPassword(String password)

getQuueNamePrefix

public String getQuueNamePrefix()

setQuueNamePrefix

public void setQuueNamePrefix(String quueNamePrefix)