edu.washington.cs.knowitall.extractor

Class HtmlSentenceExtractor

java.lang.Object

edu.washington.cs.knowitall.extractor.Extractor<String,String>

edu.washington.cs.knowitall.extractor.SentenceExtractor

edu.washington.cs.knowitall.extractor.HtmlSentenceExtractor

public class HtmlSentenceExtractor
extends SentenceExtractor

An Extractor class for extracting NpChunkedSentence objects from a String containing HTML. Is backed by an OpenNLP SentenceDetector object. Uses the code in HtmlUtils to extract plain text from HTML.

Author:

afader

Constructor Summary

Constructors

Constructor and Description
HtmlSentenceExtractor() Constructs a new HtmlSentenceExtractor object using the default OpenNLP SentenceDetector object, as returned by DefaultObjects.getDefaultSentenceDetector().
HtmlSentenceExtractor(opennlp.tools.sentdetect.SentenceDetector detector) Constructs a new SentenceExtractor object using the given OpenNLP SentenceDetector object.

Method Summary

Methods

Modifier and Type	Method and Description
protected Collection<String>	extractCandidates(String htmlBlock) Runs the OpenNLP SentenceDetector object on the given String source, and returns an Iterable object over the detected sentences.
static void	main(String[] args) Extracts sentences from HTML passed via standard input, or through a file given as an argument to the program.

Methods inherited from class edu.washington.cs.knowitall.extractor.SentenceExtractor

getSentenceDetector

Methods inherited from class edu.washington.cs.knowitall.extractor.Extractor

addMapper, compose, extract, getMappers

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HtmlSentenceExtractor

public HtmlSentenceExtractor(opennlp.tools.sentdetect.SentenceDetector detector)

Constructs a new SentenceExtractor object using the given OpenNLP SentenceDetector object.

Parameters:

detector -

HtmlSentenceExtractor

public HtmlSentenceExtractor()
                      throws IOException

Constructs a new HtmlSentenceExtractor object using the default OpenNLP SentenceDetector object, as returned by DefaultObjects.getDefaultSentenceDetector().

Throws:

IOException

Method Detail

extractCandidates

protected Collection<String> extractCandidates(String htmlBlock)

Description copied from class: SentenceExtractor

Runs the OpenNLP SentenceDetector object on the given String source, and returns an Iterable object over the detected sentences.

Overrides:

extractCandidates in class SentenceExtractor

Parameters:

htmlBlock - the source to extract from.

Returns:

an iterable object over the candidate extractions.

main

public static void main(String[] args)
                 throws Exception

Extracts sentences from HTML passed via standard input, or through a file given as an argument to the program. Removes brackets from sentences using the BracketsRemover mapper class, and filters sentences using the SentenceEndFilter, SentenceStartFilter, and SentenceLengthFilter mapper classes. Prints the resulting sentences to standard output, one sentence per line.

Parameters:

args -

Throws:

Exception