| Modifier and Type | Method and Description |
|---|---|
SToken |
ISaltFactory.createSToken()
Creates a new
SToken object. |
static SToken |
SaltFactory.createSToken()
Creates a new
SToken object. |
| Modifier and Type | Method and Description |
|---|---|
SToken |
SDocumentGraph.createToken(DataSourceSequence sequence)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraph.createToken(List<DataSourceSequence> sequences)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraph.createToken(SSequentialDS sequentialDS,
Integer start,
Integer end)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraph.insertTokenAt(STextualDS textualDS,
Integer posInText,
String text,
Boolean insertSpace)
Inserts a token to the graph starting at position posInText and
relates them to the given
STextualDS object. |
| Modifier and Type | Method and Description |
|---|---|
List<SToken> |
SDocumentGraph.getOverlappedTokens(SNode overlappingNode)
Returns all tokens in the graph, which are overlapped by the passed node
and are reachable via
SALT_TYPE.STEXT_OVERLAPPING_RELATION having
at least one of the passed types. |
List<SToken> |
SDocumentGraph.getOverlappedTokens(SNode overlappingNode,
SALT_TYPE... overlappingRelationTypes)
Returns all tokens in the graph, which are overlapped by the passed node
and are reachable via relations having at least one of the passed types.
|
List<SToken> |
SDocumentGraph.getSortedTokenByText()
Returns all
SToken objects being contained in the list
SDocumentGraph.getTokens() and sorts them by the
SSequentialRelation.getStart() value of SToken object. |
List<SToken> |
SDocumentGraph.getSortedTokenByText(List<SToken> tokens2sort)
Returns all
SToken objects being contained in the given list and
sorts them by the SSequentialRelation.getStart() value of
SToken object. |
List<SToken> |
SDocumentGraph.getTokens()
Returns all tokens contained contained in this document structure.
|
List<SToken> |
SDocumentGraph.getTokensBySequence(DataSourceSequence sequence)
Returns all
SToken objects which refer to the passed
DataSourceSequence object. |
List<SToken> |
SDocumentGraph.insertTokensAt(STextualDS textualDS,
Integer posInText,
List<String> texts,
Boolean insertSpace)
Inserts n tokens (where n is the size of the given list texts)
to the graph starting at position posInText and relates them to
the given
STextualDS object. |
List<SToken> |
STextualDS.tokenize() |
List<SToken> |
SDocumentGraph.tokenize()
Tokenizes all
STextualDS object being contained in this
SDocumentGraph object. |
| Modifier and Type | Method and Description |
|---|---|
SSpan |
SDocumentGraph.createSpan(SToken... sourceToken)
Creates a new
SSpan object, adds it to the graph and returns the
new object. |
STimelineRelation |
SDocumentGraph.createTimelineRelation(SToken token,
int timeSteps)
Creates a
STimelineRelation object being contained in this
SDocumentGraph object, and attaches the SToken parameter
to the document graph's timeline at the end, its start being the
current end of the timeline, its end being the current end of the
timeline + the time steps passed in as the second parameter. |
| Modifier and Type | Method and Description |
|---|---|
SSpan |
SDocumentGraph.createSpan(List<SToken> sourceTokens)
Creates a
SSpan object, adds it to the graph and returns the new
object. |
List<SToken> |
SDocumentGraph.getSortedTokenByText(List<SToken> tokens2sort)
Returns all
SToken objects being contained in the given list and
sorts them by the SSequentialRelation.getStart() value of
SToken object. |
| Modifier and Type | Class and Description |
|---|---|
class |
STokenImpl |
| Modifier and Type | Method and Description |
|---|---|
SToken |
SDocumentGraphImpl.createToken(DataSourceSequence sDSSequence)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraphImpl.createToken(List<DataSourceSequence> sequences)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraphImpl.createToken(SSequentialDS sequentialDS,
Integer start,
Integer end)
Creates a new
SToken object and adds it to the graph. |
SToken |
SDocumentGraphImpl.insertTokenAt(STextualDS sTextualDS,
Integer posInText,
String text,
Boolean insertSpace)
Inserts a token to the graph starting at position posInText and
relates them to the given
STextualDS object. |
| Modifier and Type | Method and Description |
|---|---|
List<SToken> |
SDocumentGraphImpl.getOverlappedTokens(SNode overlappingNode)
Returns all tokens in the graph, which are overlapped by the passed node
and are reachable via
SALT_TYPE.STEXT_OVERLAPPING_RELATION having
at least one of the passed types. |
List<SToken> |
SDocumentGraphImpl.getOverlappedTokens(SNode overlappingNode,
SALT_TYPE... relationTypes)
Returns all tokens in the graph, which are overlapped by the passed node
and are reachable via relations having at least one of the passed types.
|
List<SToken> |
SDocumentGraphImpl.getSortedTokenByText()
Returns all
SToken objects being contained in the list
SDocumentGraph.getTokens() and sorts them by the
SSequentialRelation.getStart() value of SToken object. |
List<SToken> |
SDocumentGraphImpl.getSortedTokenByText(List<SToken> tokens2sort)
Returns all
SToken objects being contained in the given list and
sorts them by the SSequentialRelation.getStart() value of
SToken object. |
List<SToken> |
SDocumentGraphImpl.getTokens()
Returns all tokens contained contained in this document structure.
|
List<SToken> |
SDocumentGraphImpl.getTokensBySequence(DataSourceSequence sequence)
Returns all
SToken objects which refer to the passed
DataSourceSequence object. |
List<SToken> |
SDocumentGraphImpl.insertTokensAt(STextualDS sTextualDS,
Integer posInText,
List<String> texts,
Boolean insertSpace)
Inserts n tokens (where n is the size of the given list texts)
to the graph starting at position posInText and relates them to
the given
STextualDS object. |
List<SToken> |
SDocumentGraphImpl.tokenize()
Tokenizes all
STextualDS object being contained in this
SDocumentGraph object. |
List<SToken> |
STextualDSImpl.tokenize()
Bug fix 69.
|
| Modifier and Type | Method and Description |
|---|---|
SSpan |
SDocumentGraphImpl.createSpan(SToken... tokens)
Creates a new
SSpan object, adds it to the graph and returns the
new object. |
STimelineRelation |
SDocumentGraphImpl.createTimelineRelation(SToken token,
int timeSteps)
Creates a
STimelineRelation object being contained in this
SDocumentGraph object, and attaches the SToken parameter
to the document graph's timeline at the end, its start being the
current end of the timeline, its end being the current end of the
timeline + the time steps passed in as the second parameter. |
| Modifier and Type | Method and Description |
|---|---|
SSpan |
SDocumentGraphImpl.createSpan(List<SToken> tokens)
Creates a
SSpan object, adds it to the graph and returns the new
object. |
List<SToken> |
SDocumentGraphImpl.getSortedTokenByText(List<SToken> tokens2sort)
Returns all
SToken objects being contained in the given list and
sorts them by the SSequentialRelation.getStart() value of
SToken object. |
| Modifier and Type | Method and Description |
|---|---|
List<SToken> |
Tokenizer.tokenize(STextualDS sTextualDSs)
Sets the
STextualDS to be tokenized. |
List<SToken> |
SimpleTokenizer.tokenize(STextualDS textualDSs,
Character... separator)
Sets the
STextualDS to be tokenized. |
List<SToken> |
SimpleTokenizer.tokenize(STextualDS textualDS,
Integer startPos,
Integer endPos,
Character... separator)
Sets the
STextualDS to be tokenized and the language of the text. |
List<SToken> |
Tokenizer.tokenize(STextualDS sTextualDSs,
com.neovisionaries.i18n.LanguageCode language)
Sets the
STextualDS to be tokenized and the language of the text. |
List<SToken> |
Tokenizer.tokenize(STextualDS sTextualDS,
com.neovisionaries.i18n.LanguageCode language,
Integer startPos,
Integer endPos)
Sets the
STextualDS to be tokenized and the language of the text. |
List<SToken> |
Tokenizer.tokenizeToToken(STextualDS sTextualDS,
com.neovisionaries.i18n.LanguageCode language,
Integer startPos,
Integer endPos)
The general task of this class is to tokenize a given text in the same
order as the tool TreeTagger will do.
|
| Modifier and Type | Method and Description |
|---|---|
SToken |
SaltFactoryImpl.createSToken()
Creates a new
SToken object. |
| Modifier and Type | Method and Description |
|---|---|
static SToken |
SampleGenerator.createToken(int start,
int end,
STextualDS textualDS,
SDocument document,
SLayer layer)
Creates a
SToken covering the passed position and returns it. |
| Modifier and Type | Method and Description |
|---|---|
static List<SToken> |
SampleGenerator.createTokens(SDocument document,
STextualDS textualDS)
Creates a set of
SToken objects tokenizing the primary text
SampleGenerator.PRIMARY_TEXT_EN or
SampleGenerator.PRIMARY_TEXT_DE depending on the given
STextualDS object in to the following tokens:
Is
this
example
more
complicated
than
it
appears
to
be
? |
| Modifier and Type | Method and Description |
|---|---|
int |
TokenStartComparator.compare(SToken o1,
SToken o2)
Returns -1 if o1 has less text position than o2, 0 if both have equal
positions and 1 if o1 has higher text position than o2.
|
| Modifier and Type | Method and Description |
|---|---|
static List<SToken> |
DataSourceAccessor.getOverlappedSTokens(SDocumentGraph documentGraph,
SNode overlappingNode,
SALT_TYPE... relationTypes)
|
static List<SToken> |
DataSourceAccessor.getSortedSTokenByText(SDocumentGraph documentGraph) |
static List<SToken> |
DataSourceAccessor.getSortedSTokenByText(SDocumentGraph documentGraph,
List<SToken> sTokens2sort) |
List<SToken> |
GetXBySequence.getTokensBySequence(DataSourceSequence DataSourceSequence) |
| Modifier and Type | Method and Description |
|---|---|
static List<SToken> |
DataSourceAccessor.getSortedSTokenByText(SDocumentGraph documentGraph,
List<SToken> sTokens2sort) |
Copyright © 2009–2020 Humboldt-Universität zu Berlin, INRIA. All rights reserved.