object FileCommitStrategy
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- FileCommitStrategy
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- Protected
Type Members
- case class FuzzyReachedAnyOf(fileOpenDurationDistribution: Option[GaussianDistribution[Duration]] = None, fileSizeDistribution: Option[GaussianDistribution[Long]] = None, recordsWrittenDistribution: Option[GaussianDistribution[Long]] = None, fileSizeSamplingBatchSize: Option[Long] = None)(randomSeed: Option[Int] = None) extends FileCommitStrategy with Product with Serializable
Commit strategy that commits files once ANY of the parameters reaches a threshold value sampled from a given Gaussian distribution.
Commit strategy that commits files once ANY of the parameters reaches a threshold value sampled from a given Gaussian distribution. Optionally users can specify a batch size (in records) that triggers file size estimation, as doing it on every record can be too expensive. Note that the class maintains state, so it should not be re-used for multiple sinks.
- case class ReachedAnyOf(fileOpenDuration: Option[Duration] = None, fileSize: Option[Long] = None, recordsWritten: Option[Long] = None) extends FileCommitStrategy with Product with Serializable
Commit strategy that commits files once ANY of the parameters reaches the given threshold.
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()