Skip to main content

KafkaSource

Struct KafkaSource

pub struct KafkaSource;

Expand description

Kafka source entry points.

Implementations§

impl KafkaSource

pub fn plain( settings: KafkaConsumerSettings, subscription: Subscription, ) -> Source<ConsumerRecord, KafkaControl>

Creates a plain source of owned Kafka records.

Use KafkaSource::committable when records should advance consumer-group offsets after downstream checkpoints.

pub fn committable( settings: KafkaConsumerSettings, subscription: Subscription, ) -> SourceWithContext<ConsumerRecord, KafkaOffset, KafkaControl>

Creates a source whose records carry committable Kafka offsets as context.

Call KafkaOffset::commit only after the corresponding downstream checkpoint or side effect succeeds.

pub fn committable_payload_batches( settings: KafkaConsumerSettings, subscription: Subscription, ) -> Source<KafkaPayloadBatch, KafkaControl>

Creates a payload-only batched source with committable partition watermarks.

This is the throughput-oriented counterpart to KafkaSource::committable. It emits one Datum element per Kafka poll batch, copies payload bytes into a batch buffer, and exposes a single KafkaBatchOffset for the highest offset in each touched topic/partition. Downstream code should call KafkaPayloadBatch::commit only after the whole batch checkpoint succeeds.

Auto Trait Implementations§

impl Freeze for KafkaSource

impl RefUnwindSafe for KafkaSource

impl Send for KafkaSource

impl Sync for KafkaSource

impl Unpin for KafkaSource

impl UnsafeUnpin for KafkaSource

impl UnwindSafe for KafkaSource

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T> Instrument for T

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T> Message for T
where T: Any + Send + 'static,

fn from_boxed(m: BoxedMessage) -> Result<Self, BoxedDowncastErr>

Convert a BoxedMessage to this concrete type

fn box_message(self, pid: &ActorId) -> Result<BoxedMessage, BoxedDowncastErr>

Convert this message to a BoxedMessage

impl<T> Same for T

type Output = T

Should always be Self

impl<T> State for T
where T: Any + Send + 'static,

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.

impl<T> WithSubscriber for T

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more