cn.wanghaomiao.seimi.core

Interface SeimiCrawler

All Known Implementing Classes:

BaseSeimiCrawler

public interface SeimiCrawler

Author:

汪浩淼 [et.tw@163.com] Date: 2015/5/28.

Method Summary

Methods

Modifier and Type	Method and Description
java.lang.String[]	allowRules() 用于设置允许的请求URL匹配规则
java.lang.String[]	denyRules() 用于设置要放弃访问的请求URL匹配规则
org.apache.http.client.CookieStore	getCookieStore() 如果开启cookies通过此方法获取cookiesStore
java.lang.String	getUserAgent()
void	start(Response response) 针对startUrl生成首批的response回调这个初始接口
java.lang.String[]	startUrls() 设置起始url

Method Detail

getUserAgent

java.lang.String getUserAgent()

getCookieStore

org.apache.http.client.CookieStore getCookieStore()

如果开启cookies通过此方法获取cookiesStore

Returns:

CookieStore

startUrls

java.lang.String[] startUrls()

设置起始url

Returns:

allowRules

java.lang.String[] allowRules()

用于设置允许的请求URL匹配规则

Returns:

白名单规则正则表达式列表

denyRules

java.lang.String[] denyRules()

用于设置要放弃访问的请求URL匹配规则

Returns:

黑名单规则正则表达式列表

start

void start(Response response)

针对startUrl生成首批的response回调这个初始接口

Parameters:

response -