Module compaction

Module compaction 

Source

Structs§

KeyBasedRetention
The goal of key-based retention is to keep the latest record for a given key within a topic. This is the same as Kafka’s key-based retention and effectively makes the commit log a key value store.
MaxKeysReached
Returned by a compaction reducer function when there is no capacity to process any more keys. A compactor will use this information to determine whether another compaction pass is required.
NthKeyBasedRetention
Similar to KeyBasedRetention, but instead of retaining the latest offset for a key. this strategy retains the oldest nth offset associated with a key.

Traits§

CompactionStrategy
A compactor strategy’s role is to be fed consumer records for a single topic and ultimately determine, for each record key, what the earliest offset is that may be retained. Upon the consumer completing, logged will then proceed to remove unwanted records from the commit log.

Type Aliases§

CompactionMap
A map of keys to offsets
KeyBasedRetentionState
The state associated with key based retention.
NthKeyBasedRetentionState
The state associated with nth key based retention.
Qid
A qualified id is a string that identifies a type of a record and some key derived from the record e.g. a an entity and a primary key of the entity.