eus.ixa.ixa.pipe.ml.utils

Class IOUtils

java.lang.Object

eus.ixa.ixa.pipe.ml.utils.IOUtils

public final class IOUtils
extends Object

Utility functions to read and save ObjectStreams.

Version:

2016-07-13

Author:

ragerri

Field Summary

Fields

Modifier and Type	Field and Description
static int	BUFFER_SIZE
static String	SPACE_DELIMITER
static String	TAB_DELIMITER

Method Summary

Modifier and Type	Method and Description
static InputStream	getDictionaryResource(String resource) Get an input stream from a resource name.
static opennlp.tools.util.TrainingParameters	loadTrainingParameters(String paramFile) Load the parameters in the TrainingParameters file.
static String	normalizeLexiconName(String resource) Remove punctuation.
static InputStream	openFromFile(File file) Open file to an input stream.
static opennlp.tools.util.ObjectStream<String>	readFileIntoMarkableStreamFactory(String infile) Read the file into an ObjectStream.
static <T> T	readGzipObjectFromInputStream(InputStream is)
static <T> T	readObjectFromInputStream(InputStream is)
static <K,V> File	writeClusterToFile(Map<K,V> tokenToClusterMap, String fileName, String delimiter)
static File	writeDictionaryLemmatizerToFile(Map<List<String>,String> dictMap, String fileName, String delimiter)
static void	writeGzipObjectToStream(Object o, OutputStream out) Serialized gzipped java object to an ObjectOutputStream.
static <K,V> File	writeMultimapToFile(com.google.common.collect.ListMultimap<K,V> tokenToClusterMap, String fileName, String delimiter)
static File	writeObjectToFile(Object o, String fileName) Serialize java object to a file.
static void	writeObjectToStream(Object o, OutputStream out) Serialize java object to an ObjectOutputStream.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

BUFFER_SIZE

public static final int BUFFER_SIZE

See Also:

Constant Field Values

SPACE_DELIMITER

public static final String SPACE_DELIMITER

See Also:

Constant Field Values

TAB_DELIMITER

public static final String TAB_DELIMITER

See Also:

Constant Field Values

Method Detail

normalizeLexiconName

public static final String normalizeLexiconName(String resource)

Remove punctuation.

Parameters:

resource - the dictionary path

Returns:

the dictionary path without punctuation

getDictionaryResource

public static final InputStream getDictionaryResource(String resource)

Get an input stream from a resource name. This could be either an absolute path pointing to a resource in the classpath or a file or a directory in the file system. If found in the classpath that will be loaded first.

Parameters:

resource - the name of the resource (absolute path with no starting /)

Returns:

the inputstream of the dictionary

loadTrainingParameters

public static opennlp.tools.util.TrainingParameters loadTrainingParameters(String paramFile)

Load the parameters in the TrainingParameters file.

Parameters:

paramFile - the training parameters file

Returns:

default loading of the parameters

readFileIntoMarkableStreamFactory

public static opennlp.tools.util.ObjectStream<String> readFileIntoMarkableStreamFactory(String infile)

Read the file into an ObjectStream.

Parameters:

infile - the string pointing to the file

Returns:

the object stream

writeClusterToFile

public static <K,V> File writeClusterToFile(Map<K,V> tokenToClusterMap,
                                            String fileName,
                                            String delimiter)
                                     throws IOException

Throws:

IOException

writeMultimapToFile

public static <K,V> File writeMultimapToFile(com.google.common.collect.ListMultimap<K,V> tokenToClusterMap,
                                             String fileName,
                                             String delimiter)
                                      throws IOException

Throws:

IOException

writeDictionaryLemmatizerToFile

public static File writeDictionaryLemmatizerToFile(Map<List<String>,String> dictMap,
                                                   String fileName,
                                                   String delimiter)
                                            throws IOException

Throws:

IOException

writeObjectToFile

public static File writeObjectToFile(Object o,
                                     String fileName)
                              throws IOException

Serialize java object to a file.

Parameters:

o - the java object

fileName - the name of the file

Returns:

the file

Throws:

IOException - if io problems

writeGzipObjectToStream

public static void writeGzipObjectToStream(Object o,
                                           OutputStream out)

Serialized gzipped java object to an ObjectOutputStream. The stream remains open.

Parameters:

o - the java object

out - the output stream

writeObjectToStream

public static void writeObjectToStream(Object o,
                                       OutputStream out)

Serialize java object to an ObjectOutputStream. The stream remains open.

Parameters:

o - the java object

out - the output stream

openFromFile

public static InputStream openFromFile(File file)

Open file to an input stream.

Parameters:

file - the file

Returns:

the input stream

readObjectFromInputStream

public static <T> T readObjectFromInputStream(InputStream is)
                                       throws IOException,
                                              ClassNotFoundException

Throws:

IOException

ClassNotFoundException

readGzipObjectFromInputStream

public static <T> T readGzipObjectFromInputStream(InputStream is)
                                           throws IOException,
                                                  ClassNotFoundException

Throws:

IOException

ClassNotFoundException