Packages

trait Partitioner extends AnyRef

A method for Mothra packers to determine into which single partition (if any) on one level of a partitioning hierarchy a Record should be stored. Partitioners are used to partition (split) records into various directories in the long-term data storage location.

A single Partitioner typically splits on one attribute of a Record, such as its source IP address, IP protocol, or destination port.

A sequence of multiple Partitioners is used by PartitionerConfigurator to partition on multiple attributes in order.

See also

the companion object for numerous ways to define simple Partitioners on various data types. These allow you to quickly specify ranges or specific values for different partitions.

Linear Supertypes
AnyRef, Any
Known Subclasses
Float32, Float64, Int16, Int32, Int64, Int8, NumericPartitioner, UInt16, UInt32, UInt64, UInt8, UniqueValue
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Partitioner
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def pathForFilename(filename: String): Option[String]

    Returns the path component extracted from a String representing a filename created by super_mediator running in invariant mode as an Option.

    Returns the path component extracted from a String representing a filename created by super_mediator running in invariant mode as an Option. Returns None when either the String does not include the field or when the Partitioner does not designate a specific path component.

  2. abstract def pathForRecord(rec: Record): Option[String]

    Returns the path component for the Record rec based on this Partitioner as an Option.

    Returns the path component for the Record rec based on this Partitioner as an Option. Returns None when either the Record lacks the necessary information for the Partitioner or when the Partitioner does not designate a specific path component for the Record.

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. val delim: String

    In the directory name generated by this partitoiner, the delimiter between the operator, field name, and argument(s)

  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. val max_path_component: Int

    The maximum length of a path component that the file system supports.

  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  18. def toString(): String
    Definition Classes
    AnyRef → Any
  19. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped