Struct SourceRecord 

pub struct SourceRecord {
    pub topic: String,
    pub payload: Value,
    pub attributes: HashMap<String, String>,
    pub key: Option<String>,
}

Record passed from source connectors (External System → Danube)

Source connectors emit typed data as serde_json::Value. The runtime handles schema-based serialization before sending to Danube.

Fields

topic: String

The topic to publish to

payload: Value

The message payload (typed data, not bytes)

attributes: HashMap<String, String>

Optional message attributes/headers

key: Option<String>

Optional routing key for partitioned topics (will be used when Danube supports it)

Implementations

impl SourceRecord

pub fn new(topic: impl Into<String>, payload: Value) -> Self

Create a new SourceRecord with typed payload

pub fn from_string(topic: impl Into<String>, payload: impl Into<String>) -> Self

Create a SourceRecord from a string payload

Use this for text-based data like log messages, plain text, or string values.

Example

let record = SourceRecord::from_string("/logs/application", "Server started successfully");
let record = SourceRecord::from_string("/events/notifications", format!("User {} logged in", user_id));

pub fn from_json<T: Serialize>( topic: impl Into<String>, data: T, ) -> ConnectorResult<Self>

Create a SourceRecord from any JSON-serializable object

Use this for structured data types that implement Serialize. The data will be converted to serde_json::Value.

Example

#[derive(Serialize)]
struct OrderEvent {
    order_id: String,
    amount: f64,
    currency: String,
}

let order = OrderEvent {
    order_id: "ORD-12345".to_string(),
    amount: 99.99,
    currency: "USD".to_string(),
};

let record = SourceRecord::from_json("/orders/created", &order)?;

pub fn from_number<T: Serialize>( topic: impl Into<String>, number: T, ) -> ConnectorResult<Self>

Create a SourceRecord from a numeric value

Supports integers and floats. The value will be stored as a JSON number.

Example

let record = SourceRecord::from_number("/metrics/counter", 42);
let record = SourceRecord::from_number("/metrics/temperature", 23.5);

pub fn from_avro<T: Serialize>( topic: impl Into<String>, data: T, ) -> ConnectorResult<Self>

Create a SourceRecord from an Avro-compatible struct

In Danube, Avro schemas use JSON serialization with schema validation. This is an alias for from_json() for clarity when working with Avro schemas.

Example

#[derive(Serialize)]
struct UserEvent {
    user_id: String,
    action: String,
    timestamp: i64,
}

let event = UserEvent { ... };
let record = SourceRecord::from_avro("/events/users", &event)?;

pub fn from_bytes(topic: impl Into<String>, data: Vec<u8>) -> Self

Create a SourceRecord from binary data (base64-encoded)

The bytes will be base64-encoded and stored as a JSON object.

Example

let binary_data = vec![0x48, 0x65, 0x6c, 0x6c, 0x6f]; // "Hello"
let record = SourceRecord::from_bytes("/binary/data", binary_data);

pub fn with_attribute( self, key: impl Into<String>, value: impl Into<String>, ) -> Self

Add an attribute

pub fn with_attributes(self, attrs: HashMap<String, String>) -> Self

Add multiple attributes

pub fn with_key(self, key: impl Into<String>) -> Self

Set the routing key for partitioned topics

pub fn payload(&self) -> &Value

Get the payload as a reference

Trait Implementations

impl Clone for SourceRecord

fn clone(&self) -> SourceRecord

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SourceRecord

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for SourceRecord

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.