Struct sea_streamer_kafka::KafkaConsumer

pub struct KafkaConsumer { /* private fields */ }

Implementations

impl KafkaConsumer

pub fn inner(&mut self) -> &RawConsumer

Borrow the inner KafkaConsumer. Use at your own risk.

pub fn stream_shards(&self) -> &[(StreamKey, ShardId)]

Stream-shards this consumer has been (manually) assigned to. Note that since this can be changing due to load-balancing, only ZERO is assigned by default.

pub async fn reassign_partitions(&mut self) -> KafkaResult<()>

Fetch the partition list of subscribed topics and assign all partitions.

pub async fn commit_message( &mut self, mess: &KafkaMessage<'_> ) -> KafkaResult<()>

Commit an “ack” to broker for having processed this message.

Warning

This async method is not cancel safe. You must await this future, and this Consumer will be unusable for any operations until it finishes.

pub async fn commit_with( &mut self, __arg1: &(StreamKey, ShardId, SeqNo) ) -> KafkaResult<()>

Commit an “ack” to broker for having processed up to this cursor.

Warning

This async method is not cancel safe. You must await this future, and this Consumer will be unusable for any operations until it finishes.

pub async fn commit( &mut self, stream: &StreamKey, shard: &ShardId, seq: &SeqNo ) -> KafkaResult<()>

Commit an “ack” to broker for having processed up to this cursor.

Warning

This async method is not cancel safe. You must await this future, and this Consumer will be unusable for any operations until it finishes.

pub fn store_offset( &mut self, stream: &StreamKey, shard: &ShardId, seq: &SeqNo ) -> KafkaResult<()>

Store the offset so that it will be committed. You must have set_enable_auto_offset_store to false.

pub fn store_offset_for_message( &mut self, mess: &KafkaMessage<'_> ) -> KafkaResult<()>

Store the offset for this message so that it will be committed. You must have set_enable_auto_offset_store to false.

pub fn store_offset_with( &mut self, (stream_key, shard_id, sequence): &(StreamKey, ShardId, SeqNo) ) -> KafkaResult<()>

Store the offset with message identifier so that it will be committed. You must have set_enable_auto_offset_store to false.

Trait Implementations

impl Consumer for KafkaConsumer

async fn seek(&mut self, timestamp: Timestamp) -> KafkaResult<()>

Seek all streams to the given point in time, with all partitions assigned.

Warning

This async method is not cancel safe. You must await this future, and this Consumer will be unusable for any operations until it finishes.

async fn rewind(&mut self, offset: SeqPos) -> KafkaResult<()>

Rewind all streams across all assigned partitions. Call Consumer::assign to assign a partition beforehand, or KafkaConsumer::reassign_partitions to assign all partitions.

fn stream<'a, 'b: 'a>(&'b mut self) -> Self::Stream<'a>

Note: Kafka stream never ends.

type Error = KafkaError

type Message<'a> = KafkaMessage<'a>

type NextFuture<'a> = Map<StreamFuture<MessageStream<'a, DefaultConsumerContext>>, fn(_: (Option<Result<BorrowedMessage<'a>, KafkaError>>, MessageStream<'a, DefaultConsumerContext>)) -> Result<KafkaMessage<'a>, StreamErr<KafkaError>>>

type Stream<'a> = Map<MessageStream<'a, DefaultConsumerContext>, fn(_: Result<BorrowedMessage<'a>, KafkaError>) -> Result<KafkaMessage<'a>, StreamErr<KafkaError>>>

fn assign(&mut self, (stream, shard): (StreamKey, ShardId)) -> KafkaResult<()>

Assign this consumer to a particular shard. Can be called multiple times to assign to multiple shards. Returns error StreamKeyNotFound if the stream is not currently subscribed.

fn unassign(&mut self, s: (StreamKey, ShardId)) -> KafkaResult<()>

Unassign a shard. Returns error StreamKeyNotFound if the stream is not currently subscribed. Returns error StreamKeyEmpty if all streams have been unassigned.

fn next(&self) -> Self::NextFuture<'_>

Poll and receive one message: it awaits until there are new messages. This method can be called from multiple threads.

impl Debug for KafkaConsumer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.