cn.wanghaomiao.seimi.core

Interface SeimiCrawler

All Known Implementing Classes:

BaseSeimiCrawler

public interface SeimiCrawler

Author:

汪浩淼 [et.tw@163.com] Date: 2015/5/28.

Method Summary

Methods

Modifier and Type	Method and Description
String[]	allowRules() 用于设置允许的请求URL匹配规则
String[]	denyRules() 用于设置要放弃访问的请求URL匹配规则
org.apache.http.client.CookieStore	getCookieStore() 如果开启cookies通过此方法获取cookiesStore
String	getUserAgent()
String	proxy() 可以自定义返回随机的代理
void	start(Response response) 针对startUrl生成首批的response回调这个初始接口
String[]	startUrls() 设置起始url

Method Detail

getUserAgent

String getUserAgent()

proxy

String proxy()

可以自定义返回随机的代理

Returns:

getCookieStore

org.apache.http.client.CookieStore getCookieStore()

如果开启cookies通过此方法获取cookiesStore

Returns:

CookieStore

startUrls

String[] startUrls()

设置起始url

Returns:

allowRules

String[] allowRules()

用于设置允许的请求URL匹配规则

Returns:

白名单规则正则表达式列表

denyRules

String[] denyRules()

用于设置要放弃访问的请求URL匹配规则

Returns:

黑名单规则正则表达式列表

start

void start(Response response)

针对startUrl生成首批的response回调这个初始接口

Parameters:

response -