org.webharvest.utils

Class SystemUtilities

java.lang.Object

org.webharvest.utils.SystemUtilities

public class SystemUtilities
extends Object

Collection of useful constants and functions that are available in each scraper context.

Field Summary

Fields

Modifier and Type	Field and Description
static Variable	apos
static Variable	backspace
static Variable	cr
static Variable	lf
static Variable	quot
static Variable	space
static Variable	tab

Constructor Summary

Constructors

Constructor and Description
SystemUtilities(Scraper scraper)

Method Summary

Modifier and Type	Method and Description
String	date() Returns current date formated as "yyyyMMdd".
String	datetime(Object format) Returns formatted date/time for specified format string.
void	defineVariable(String varName, Object varValue) Adds or/replaces variable in scraper's context.
void	defineVariable(String varName, Object varValue, boolean overwrite) Adds or/replaces variable in scraper's context.
String	escapeXml(Object s) Escapes XML string - special characters: &'"<> are replaced with XML escape sequences: & ' " < >
String	fullUrl(Object pageUrl, Object link) Calculates full URL for specified page URL and link which could be full, absolute or relative like there can be found in A or IMG tags.
String	getFilename(String path)
Variable	getVar(String varName) Returns variable from scraper context
boolean	isVariableDefined(String varName)
void	setScraper(Scraper scraper)
String	time()
Variable	xpath(Object expression, Object xml) Evaluates XPath expression on specified XML

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

lf

public static final Variable lf

tab

public static final Variable tab

cr

public static final Variable cr

space

public static final Variable space

quot

public static final Variable quot

apos

public static final Variable apos

backspace

public static final Variable backspace

Constructor Detail

SystemUtilities

public SystemUtilities(Scraper scraper)

Method Detail

setScraper

public void setScraper(Scraper scraper)

isVariableDefined

public boolean isVariableDefined(String varName)

Parameters:

varName -

Returns:

True if scraper's context contain not-null variable with specified name.

getVar

public Variable getVar(String varName)

Returns variable from scraper context

Parameters:

varName - Name of the variable

defineVariable

public void defineVariable(String varName,
                           Object varValue,
                           boolean overwrite)

Adds or/replaces variable in scraper's context. If overwrite is false and variable with specified name already exists, it won't be updated.

Parameters:

varName -

varValue -

overwrite -

defineVariable

public void defineVariable(String varName,
                           Object varValue)

Adds or/replaces variable in scraper's context.

Parameters:

varName -

varValue -

datetime

public String datetime(Object format)

Returns formatted date/time for specified format string.

Parameters:

format -

date

public String date()

Returns current date formated as "yyyyMMdd".

time

public String time()

escapeXml

public String escapeXml(Object s)

Escapes XML string - special characters: &'"<> are replaced with XML escape sequences: & ' " < >

fullUrl

public String fullUrl(Object pageUrl,
                      Object link)

Calculates full URL for specified page URL and link which could be full, absolute or relative like there can be found in A or IMG tags.

xpath

public Variable xpath(Object expression,
                      Object xml)

Evaluates XPath expression on specified XML

Parameters:

expression -

xml -

getFilename

public String getFilename(String path)

Parameters:

path -

Returns:

Filename for the full path