eus.ixa.ixa.pipe.tok

Class Token

java.lang.Object

eus.ixa.ixa.pipe.tok.Token

public class Token
extends Object

A Token object contains a single String, a startOffset and the length of the String. These attributes are set or returned in response to requests.

Version:

2015-04-14

Author:

ragerri

Constructor Summary

Constructors

Constructor and Description
Token() Create a new token with a null content.
Token(String str)
Token(String str, int startOffset, int tokenLength) Creates a new Token with the given content.

Method Summary

Modifier and Type	Method and Description
String	getTokenValue()
void	setStartOffset(int beginPosition) Set the token offset.
void	setTokenLength(int tokLength) Set the length of the token.
void	setTokenValue(String value) Set the value for the token.
int	startOffset() Get the token starting offset.
int	tokenLength() Get the token length.
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Token

public Token()

Create a new token with a null content.

Token

public Token(String str)

Token

public Token(String str,
             int startOffset,
             int tokenLength)

Creates a new Token with the given content.

Parameters:

str - The new token's value

startOffset - Start offset in original text

tokenLength - End offset in original text

Method Detail

getTokenValue

public String getTokenValue()

setTokenValue

public void setTokenValue(String value)

Set the value for the token.

Parameters:

value - The value for the token

toString

public String toString()

Overrides:

toString in class Object

startOffset

public int startOffset()

Get the token starting offset.

Returns:

the offset

tokenLength

public int tokenLength()

Get the token length.

Returns:

the length

setStartOffset

public void setStartOffset(int beginPosition)

Set the token offset.

Parameters:

beginPosition - the startOffset

setTokenLength

public void setTokenLength(int tokLength)

Set the length of the token.

Parameters:

tokLength - the length