Package ciir.umass.edu.eval

Class Analyzer

  • public class Analyzer
extends java.lang.Object

    • Constructor Summary

      Constructors 
      Constructor Description
      Analyzer()  

    • Method Summary

      All Methods Static Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void compare​(java.lang.String directory, java.lang.String baseFile)
      Compare the performance of a set of systems to that of a baseline system
      ciir.umass.edu.eval.Analyzer.Result compare​(java.util.HashMap<java.lang.String,​java.lang.Double> base, java.util.HashMap<java.lang.String,​java.lang.Double> target)
      Compare the performance of a target system to that of a baseline system
      ciir.umass.edu.eval.Analyzer.Result[] compare​(java.util.HashMap<java.lang.String,​java.lang.Double> base, java.util.List<java.util.HashMap<java.lang.String,​java.lang.Double>> targets)
      Compare the performance of a set of systems to that of a baseline system
      void compare​(java.util.List<java.lang.String> targetFiles, java.lang.String baseFile)
      Compare the performance of a set of systems to that of a baseline system
      static void main​(java.lang.String[] args)  
      java.util.HashMap<java.lang.String,​java.lang.Double> read​(java.lang.String filename)
      Read performance (in some measure of effectiveness) file.

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • Analyzer

        public Analyzer()

    • Method Detail

      • main

        public static void main​(java.lang.String[] args)
        Parameters:
        args -

      • read

        public java.util.HashMap<java.lang.String,​java.lang.Double> read​(java.lang.String filename)
        Read performance (in some measure of effectiveness) file. Expecting: id [space]* metric-text [space]* performance
        Parameters:
        filename -
        Returns:
        Mapping from ranklist-id --> performance

      • compare

        public void compare​(java.lang.String directory,
                    java.lang.String baseFile)
        Compare the performance of a set of systems to that of a baseline system
        Parameters:
        directory - Contain files denoting the performance of the target systems to be compared
        baseFile - Performance file for the baseline system

      • compare

        public void compare​(java.util.List<java.lang.String> targetFiles,
                    java.lang.String baseFile)
        Compare the performance of a set of systems to that of a baseline system
        Parameters:
        targetFiles - Performance files of the target systems to be compared (full path)
        baseFile - Performance file for the baseline system

      • compare

        public ciir.umass.edu.eval.Analyzer.Result[] compare​(java.util.HashMap<java.lang.String,​java.lang.Double> base,
                                                     java.util.List<java.util.HashMap<java.lang.String,​java.lang.Double>> targets)
        Compare the performance of a set of systems to that of a baseline system
        Parameters:
        base -
        targets -
        Returns:

      • compare

        public ciir.umass.edu.eval.Analyzer.Result compare​(java.util.HashMap<java.lang.String,​java.lang.Double> base,
                                                   java.util.HashMap<java.lang.String,​java.lang.Double> target)
        Compare the performance of a target system to that of a baseline system
        Parameters:
        base -
        target -
        Returns: