Packages

abstract class BatchConsumer extends BaseThreadedConsumer

Consumer that will process messages in batch, with guaranteed at-least-once processing

Linear Supertypes
BaseThreadedConsumer, LazyLogging, Closeable, AutoCloseable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. BatchConsumer
  2. BaseThreadedConsumer
  3. LazyLogging
  4. Closeable
  5. AutoCloseable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new BatchConsumer(consumers: Seq[Consumer[Array[Byte], Array[Byte]]], frequency: Duration)

    consumers

    consumers

    frequency

    poll frequency

Type Members

  1. class ConsumerCoordinator extends Runnable

    Invokes a callback on a batch of messages and commits offsets

  2. class ConsumerRunnable extends Runnable

Abstract Value Members

  1. abstract def consume(records: Seq[ConsumerRecord[Array[Byte], Array[Byte]]]): BatchResult

    Consume a batch of records.

    Consume a batch of records.

    The response from this method will determine the continued processing of messages. If Commit is returned, the batch is considered complete and won't be presented again. If Continue is returned, the batch will be presented again in the future, and more messages will be read off the topic in the meantime. If Pause is returned, the batch will be presented again in the future, but no more messages will be read off the topic in the meantime.

    This method should return in a reasonable amount of time. If too much time is spent processing messages, consumers may be considered inactive and be dropped from processing. See https://kafka.apache.org/26/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html

    Note: if there is an error committing the batch or something else goes wrong, some messages may be repeated in a subsequent call, regardless of the response from this method

    records

    records

    returns

    commit, continue, or pause

    Attributes
    protected

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. def close(): Unit
    Definition Classes
    BaseThreadedConsumer → Closeable → AutoCloseable
  7. def createConsumerRunnable(id: String, consumer: Consumer[Array[Byte], Array[Byte]], handler: ConsumerErrorHandler): Runnable
    Attributes
    protected
    Definition Classes
    BatchConsumer → BaseThreadedConsumer
  8. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  14. def isOpen: Boolean
    Attributes
    protected
    Definition Classes
    BaseThreadedConsumer
  15. lazy val logger: Logger
    Attributes
    protected
    Definition Classes
    LazyLogging
  16. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  17. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  18. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  19. def startConsumers(handler: Option[ConsumerErrorHandler] = None): Unit
    Definition Classes
    BaseThreadedConsumer
  20. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  21. def toString(): String
    Definition Classes
    AnyRef → Any
  22. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from BaseThreadedConsumer

Inherited from LazyLogging

Inherited from Closeable

Inherited from AutoCloseable

Inherited from AnyRef

Inherited from Any

Ungrouped