package source
- Alphabetic
- Public
- Protected
Type Members
- trait KafkaContext extends AnyRef
Represents an active Kafka consumer, can be used to commit and query offsets.
- class KafkaSource extends Metrics
A source of data for stream loading that is backed by Kafka.
A source of data for stream loading that is backed by Kafka.
Not thread safe, create separate instances when loading data from multiple threads.
- class LockingKafkaContext extends KafkaContext
A KafkaContext that performs offset lookup/committing by synchronizing on the consumer, which out of the box is not thread safe.
A KafkaContext that performs offset lookup/committing by synchronizing on the consumer, which out of the box is not thread safe. The source that provides this context also synchronizes on the same lock during polls.
- class MaxWatermarkProvider extends WatermarkProvider with Logging
Watermark provider that sets the watermark to the maximum observed event time.
Watermark provider that sets the watermark to the maximum observed event time. In order to protect from malformed messages with timestamps from the future, values greater than a predefined threshold above the current time are rejected and do not advance the watermark.
- trait WatermarkProvider extends AnyRef
Trait for implementing watermark tracking in a stream.
Value Members
- object KafkaSource