nl.grons.sentries.core

AdaptiveThroughputSentry

class AdaptiveThroughputSentry extends ChainableSentry

A sentry that adapts throughput with the success ratio of invoking the protected resource. Think of it as a gradual circuit breaker.

The goal of this sentry is to protect the caller from a resource that slows down, or starts to produce errors when overloaded. By reducing throughput until success ratio is at an expected level, the resource can recover and work at its optimal efficiency.

For resources that behave correct most of the time, the target success ratio can be set quite high, e.g. 0.95. When exceptions are more 'normal', you may have to lower this parameter.

The success ratio is calculated per evaluationDelay with a simple 1 - (fail count / success count). When the success ratio is below targetSuccessRatio, the throughput is reduced to currentSuccessRatio * currentThroughputRatio. When the success ratio is again equal to or above the target ratio, throughput is increased by successIncreaseFactor (defaults to +20%) with a minimum of 0.0001D (1 in thousand calls may proceed). Note that regardless of the currentThroughputRatio, at least 1 call per evaluation period is allowed to continue.

When there is a calamity, this sentry only reacts as fast as the given evaluationDelay (1 second by default). When the resource becomes fully available, it takes at most 39 evaluation before throughput is back at 100%. You can test this by evaluating the following code in a Scala REPL:

scala> val successIncreaseFactor = 1.2D
successIncreaseFactor: Double = 1.2

scala> Stream.iterate(0.0D)(x => (x * successIncreaseFactor).max(0.001).min(1.0D)).zipWithIndex.takeWhile(_._1 < 1.0).last._2 + 1
res0 Int = 39

A new instance can be obtained through the SentrySupport mixin.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. Hide All
  2. Show all
  1. AdaptiveThroughputSentry
  2. ChainableSentry
  3. NamedSentry
  4. Sentry
  5. AnyRef
  6. Any
Visibility
  1. Public
  2. All

Instance Constructors

  1. new AdaptiveThroughputSentry(resourceName: String, targetSuccessRatio: Double, owner: Class[_], evaluationDelay: Duration = ..., successIncreaseFactor: Double = 1.2)

    resourceName

    name of the resource

    targetSuccessRatio

    target success ratio, 0 < targetSuccessRatio < 1

    owner

    the owner class of this sentry

    evaluationDelay

    the time between calculations of the current throughput, defaults to 1 second

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. def andThen(s: Sentry): Sentry

    Composes two instances of Sentry in a new Sentry, with this sentries context applied first.

    Composes two instances of Sentry in a new Sentry, with this sentries context applied first.

    returns

    a new sentry t such that t(x) == s(this(x))

    Definition Classes
    Sentry
  7. def apply[T](r: ⇒ T): T

    Run the given code block in the context of this sentry, and return its value.

    Run the given code block in the context of this sentry, and return its value.

    Definition Classes
    AdaptiveThroughputSentrySentry
  8. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  9. def clone(): AnyRef

    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws()
  10. def compose(s: Sentry): Sentry

    Composes two instances of Sentry in a new Sentry, with this sentries context applied last.

    Composes two instances of Sentry in a new Sentry, with this sentries context applied last.

    returns

    a new sentry t such that t(x) == this(s(x))

    Definition Classes
    Sentry
  11. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  13. val evaluationDelay: Duration

    the time between calculations of the current throughput, defaults to 1 second

  14. def failRatio: Double

    The current fail ratio (0 <= ratio <= 1).

  15. def finalize(): Unit

    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws()
  16. final def getClass(): java.lang.Class[_]

    Definition Classes
    AnyRef → Any
  17. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  18. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  19. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  20. final def notify(): Unit

    Definition Classes
    AnyRef
  21. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  22. def reset(): Unit

    Go back to the initial state.

    Go back to the initial state.

    Definition Classes
    AdaptiveThroughputSentrySentry
  23. val resourceName: String

    name of the resource

    name of the resource

    Definition Classes
    AdaptiveThroughputSentryNamedSentry
  24. val sentryType: String

    returns

    a simple describing identifier that is unique per sentry chain, e.g. "rateLimit". ResourceName plus sentryType uniquely name each sentry. The sentry registry enforces this. The sentryType is also used in JMX to uniquely name bean properties for a resource. null for sentry wrappers, that must not be registered.

    Definition Classes
    AdaptiveThroughputSentryChainableSentry
  25. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  26. val targetSuccessRatio: Double

    target success ratio, 0 < targetSuccessRatio < 1

  27. def throughputRatio: Double

    The current throughput ratio (0 <= ratio <= 1).

  28. def toString(): String

    Definition Classes
    AnyRef → Any
  29. def trip(): Unit

    Reduce throughput to 0.

  30. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws()
  31. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws()
  32. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws()

Inherited from ChainableSentry

Inherited from NamedSentry

Inherited from Sentry

Inherited from AnyRef

Inherited from Any