| Modifier and Type | Method and Description |
|---|---|
static SToken |
SaltFactory.createSToken()
Creates a new
SToken object. |
SToken |
ISaltFactory.createSToken()
Creates a new
SToken object. |
| Modifier and Type | Method and Description |
|---|---|
SToken |
SDocumentGraph.createToken(DataSourceSequence sequence)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraph.createToken(List<DataSourceSequence> sequences)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraph.createToken(SSequentialDS sequentialDS,
Integer start,
Integer end)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraph.insertTokenAt(STextualDS textualDS,
Integer posInText,
String text,
Boolean insertSpace)
Inserts a token to the graph starting at position posInText and
relates them to the given
STextualDS object. |
| Modifier and Type | Method and Description |
|---|---|
List<SToken> |
SDocumentGraph.getOverlappedTokens(SNode overlappingNode)
Returns all tokens in the graph, which are overlapped by the passed node
and are reachable via
SALT_TYPE.STEXT_OVERLAPPING_RELATION having
at least one of the passed types. |
List<SToken> |
SDocumentGraph.getOverlappedTokens(SNode overlappingNode,
SALT_TYPE... overlappingRelationTypes)
Returns all tokens in the graph, which are overlapped by the passed node
and are reachable via relations having at least one of the passed types.
|
List<SToken> |
SDocumentGraph.getSortedTokenByText()
Returns all
SToken objects being contained in the list
SDocumentGraph.getTokens() and sorts them by the
SSequentialRelation.getStart() value of SToken object. |
List<SToken> |
SDocumentGraph.getSortedTokenByText(List<SToken> tokens2sort)
Returns all
SToken objects being contained in the given list and
sorts them by the SSequentialRelation.getStart() value of
SToken object. |
List<SToken> |
SDocumentGraph.getTokens()
Returns all tokens contained contained in this document structure.
|
List<SToken> |
SDocumentGraph.getTokensBySequence(DataSourceSequence sequence)
Returns all
SToken objects which refer to the passed
DataSourceSequence object. |
List<SToken> |
SDocumentGraph.insertTokensAt(STextualDS textualDS,
Integer posInText,
List<String> texts,
Boolean insertSpace)
Inserts n tokens (where n is the size of the given list texts)
to the graph starting at position posInText and relates them to
the given
STextualDS object. |
List<SToken> |
SDocumentGraph.tokenize()
Tokenizes all
STextualDS object being contained in this
SDocumentGraph object. |
| Modifier and Type | Method and Description |
|---|---|
SSpan |
SDocumentGraph.createSpan(SToken... sourceToken)
Creates a new
SSpan object, adds it to the graph and returns the
new object. |
| Modifier and Type | Method and Description |
|---|---|
SSpan |
SDocumentGraph.createSpan(List<SToken> sourceTokens)
Creates a
SSpan object, adds it to the graph and returns the new
object. |
List<SToken> |
SDocumentGraph.getSortedTokenByText(List<SToken> tokens2sort)
Returns all
SToken objects being contained in the given list and
sorts them by the SSequentialRelation.getStart() value of
SToken object. |
| Modifier and Type | Class and Description |
|---|---|
class |
STokenImpl |
| Modifier and Type | Method and Description |
|---|---|
SToken |
SDocumentGraphImpl.createToken(DataSourceSequence sDSSequence)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraphImpl.createToken(List<DataSourceSequence> sequences)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraphImpl.createToken(SSequentialDS sequentialDS,
Integer start,
Integer end)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraphImpl.insertTokenAt(STextualDS sTextualDS,
Integer posInText,
String text,
Boolean insertSpace)
Inserts a token to the graph starting at position posInText and
relates them to the given
STextualDS object. |
| Modifier and Type | Method and Description |
|---|---|
List<SToken> |
SDocumentGraphImpl.getOverlappedTokens(SNode overlappingNode)
Returns all tokens in the graph, which are overlapped by the passed node
and are reachable via
SALT_TYPE.STEXT_OVERLAPPING_RELATION having
at least one of the passed types. |
List<SToken> |
SDocumentGraphImpl.getOverlappedTokens(SNode overlappingNode,
SALT_TYPE... relationTypes)
Returns all tokens in the graph, which are overlapped by the passed node
and are reachable via relations having at least one of the passed types.
|
List<SToken> |
SDocumentGraphImpl.getSortedTokenByText()
Returns all
SToken objects being contained in the list
SDocumentGraph.getTokens() and sorts them by the
SSequentialRelation.getStart() value of SToken object. |
List<SToken> |
SDocumentGraphImpl.getSortedTokenByText(List<SToken> tokens2sort)
Returns all
SToken objects being contained in the given list and
sorts them by the SSequentialRelation.getStart() value of
SToken object. |
List<SToken> |
SDocumentGraphImpl.getTokens()
Returns all tokens contained contained in this document structure.
|
List<SToken> |
SDocumentGraphImpl.getTokensBySequence(DataSourceSequence sequence)
Returns all
SToken objects which refer to the passed
DataSourceSequence object. |
List<SToken> |
SDocumentGraphImpl.insertTokensAt(STextualDS sTextualDS,
Integer posInText,
List<String> texts,
Boolean insertSpace)
Inserts n tokens (where n is the size of the given list texts)
to the graph starting at position posInText and relates them to
the given
STextualDS object. |
List<SToken> |
SDocumentGraphImpl.tokenize()
Tokenizes all
STextualDS object being contained in this
SDocumentGraph object. |
| Modifier and Type | Method and Description |
|---|---|
SSpan |
SDocumentGraphImpl.createSpan(SToken... tokens)
Creates a new
SSpan object, adds it to the graph and returns the
new object. |
| Modifier and Type | Method and Description |
|---|---|
SSpan |
SDocumentGraphImpl.createSpan(List<SToken> tokens)
Creates a
SSpan object, adds it to the graph and returns the new
object. |
List<SToken> |
SDocumentGraphImpl.getSortedTokenByText(List<SToken> tokens2sort)
Returns all
SToken objects being contained in the given list and
sorts them by the SSequentialRelation.getStart() value of
SToken object. |
| Modifier and Type | Method and Description |
|---|---|
List<SToken> |
Tokenizer.tokenize(STextualDS sTextualDSs)
Sets the
STextualDS to be tokenized. |
List<SToken> |
SimpleTokenizer.tokenize(STextualDS textualDSs,
Character... separator)
Sets the
STextualDS to be tokenized. |
List<SToken> |
SimpleTokenizer.tokenize(STextualDS textualDS,
Integer startPos,
Integer endPos,
Character... separator)
Sets the
STextualDS to be tokenized and the language of the text. |
List<SToken> |
Tokenizer.tokenize(STextualDS sTextualDSs,
com.neovisionaries.i18n.LanguageCode language)
Sets the
STextualDS to be tokenized and the language of the text. |
List<SToken> |
Tokenizer.tokenize(STextualDS sTextualDS,
com.neovisionaries.i18n.LanguageCode language,
Integer startPos,
Integer endPos)
Sets the
STextualDS to be tokenized and the language of the text. |
List<SToken> |
Tokenizer.tokenizeToToken(STextualDS sTextualDS,
com.neovisionaries.i18n.LanguageCode language,
Integer startPos,
Integer endPos)
The general task of this class is to tokenize a given text in the same
order as the tool TreeTagger will do.
|
| Modifier and Type | Method and Description |
|---|---|
SToken |
SaltFactoryImpl.createSToken()
Creates a new
SToken object. |
| Modifier and Type | Method and Description |
|---|---|
static SToken |
SampleGenerator.createToken(int start,
int end,
STextualDS textualDS,
SDocument document,
SLayer layer)
Creates a
SToken covering the passed position and returns it. |
| Modifier and Type | Method and Description |
|---|---|
static List<SToken> |
SampleGenerator.createTokens(SDocument document,
STextualDS textualDS)
Creates a set of
SToken objects tokenizing the primary text
SampleGenerator.PRIMARY_TEXT_EN or
SampleGenerator.PRIMARY_TEXT_DE depending on the given
STextualDS object in to the following tokens:
Is
this
example
more
complicated
than
it
appears
to
be
? |
| Modifier and Type | Method and Description |
|---|---|
int |
TokenStartComparator.compare(SToken o1,
SToken o2)
Returns -1 if o1 has less text position than o2, 0 if both have equal
positions and 1 if o1 has higher text position than o2.
|
| Modifier and Type | Method and Description |
|---|---|
static List<SToken> |
DataSourceAccessor.getOverlappedSTokens(SDocumentGraph documentGraph,
SNode overlappingNode,
SALT_TYPE... relationTypes)
|
static List<SToken> |
DataSourceAccessor.getSortedSTokenByText(SDocumentGraph documentGraph) |
static List<SToken> |
DataSourceAccessor.getSortedSTokenByText(SDocumentGraph documentGraph,
List<SToken> sTokens2sort) |
static List<SToken> |
DataSourceAccessor.getTokensBySequence(SDocumentGraph documentGraph,
DataSourceSequence DataSourceSequence)
Returns all
SToken objects which refer to the passed
DataSourceSequence object. |
| Modifier and Type | Method and Description |
|---|---|
static List<SToken> |
DataSourceAccessor.getSortedSTokenByText(SDocumentGraph documentGraph,
List<SToken> sTokens2sort) |
Copyright © 2009–2015 Humboldt-Universität zu Berlin, INRIA. All rights reserved.